Eve library

DOD-004 Certification: Observability Completeness

Guide

Revision 1

On this page

Date: 2026-02-22
Checklist Item: DOD-004
Ticket: ISIS-0004

Scope#

Certify that Isis observability coverage is complete for lifecycle health, cost, latency, and failure signals with active validation gates.

Evidence Matrix#

Requirement Evidence Status
Lifecycle/cost/latency/failure observability surfaces are defined docs/domains/isis/remediation/operations-certification/GATE-007-observability-dashboards-alerts-validated.md certifies dashboard and alert coverage over generation lifecycle, provider latency/failures, queue health, and cost anomaly dimensions. Pass
Observability infrastructure contract remains valid node scripts/isis/validate_observability_stack.mjs passed (67 checks) validating dashboard definitions, alarms, metric filters, outputs, and SLO metric contracts. Pass
Readiness degradation alert path remains operational pnpm --filter @isis/generation-api exec vitest run src/services/readiness-alert.service.spec.ts passed (3 tests), confirming readiness alert dispatch and cooldown behavior. Pass
Canonical SLO contract is present for core reliability dimensions docs/domains/isis/remediation/ISIS_SLO_DEFINITIONS.md and docs/domains/isis/remediation/ISIS_SLO_DEFINITIONS.json define submit latency, queue delay, execution success, and end-to-end completion metrics. Pass

Reproduction Commands#

bash
node scripts/isis/validate_observability_stack.mjs
pnpm --filter @isis/generation-api exec vitest run src/services/readiness-alert.service.spec.ts