Add M8.5 observability: pinned Prometheus, tested alerts, capacity metrics

An AEvolution-only Prometheus 3.13.3 and Alertmanager 0.34.1, pinned by
digest and delivered by Argo (ADR-0072), scrape each region's operations
Service through static targets (no API access, no RBAC); the region
namespaces admit port 9100 from Prometheus only. Sixteen alert rules
cover authority, lease, commits, backlog and object capacity and are
proven by promtool injection tests in CI with tools copied from the same
pinned images. Two new gauges expose object volume free space and the
reserve. Alerts route to a null receiver until a destination is chosen;
no broker is adopted and the database outbox stays.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
dingo
2026-09-30 06:16:36 -04:00
co-authored by Claude Opus 5.5
parent 2c79d4748c
commit b4493b3d0f
33 changed files with 1068 additions and 8 deletions
+3
View File
@@ -44,6 +44,9 @@ struct OpsCounters {
std::uint64_t checkpoint_age_ms{}; // Since the last confirmed commit or recovery.
std::uint64_t acks{}, outcomes{};
std::array<std::uint64_t, unacknowledged_count> dropped{}; // Indexed by Unacknowledged.
// M8.5: object volume free space and the store's reserve (ADR-0070), so capacity
// is alerted on before new objects are refused.
std::uint64_t objects_available_bytes{}, objects_reserve_bytes{};
};
[[nodiscard]] const char* phase_name(HostPhase phase) noexcept;
+4
View File
@@ -107,6 +107,10 @@ template <typename State> class RegionHost {
[[nodiscard]] const HostStatus& status() const noexcept {
return status_;
}
// Read-only, for operational reporting (free space against the reserve).
[[nodiscard]] const persistence::FilesystemObjectStore& objects() const noexcept {
return *objects_;
}
// Read-only view for diagnostics/tests; null unless recovered.
[[nodiscard]] const State* state() const noexcept {
return state_.get();