## Phase 152: Sovereign Incident Management & On-Call Platform — PagerDuty / Opsgenie / VictorOps (Splunk On-Call) / xMatters / FireHydrant / incident.io / Rootly / Blameless / Grafana OnCall / Better Stack Replacement

Closes the incident-management sovereignty gap. Phase 137 briefly mentions
"PagerDuty / sovereign" for live-ops. Phase 149 (Crash Analytics) and Phase 151
(EDR) both fire alerts but neither manages schedules, escalations, SLAs,
stakeholder comms, post-mortems, or retros. This phase delivers an end-to-end
incident platform for Oshun and external customers.

Sovereign replacement for PagerDuty, Opsgenie, Splunk On-Call (VictorOps),
xMatters, FireHydrant, incident.io, Rootly, Blameless, Jeli, Grafana OnCall,
Better Stack Uptime / Incidents, statuspage.io, StatusGator, ilert, and
Squadcast.

---

### 152.1 @neith/incident-core — Incident Model & Lifecycle

- [x] **152.1.1** Incident entity (id / title / severity / services / owner)
- [x] **152.1.2** Severity scale SEV-1 → SEV-5 with auto-bump rules
- [x] **152.1.3** Incident lifecycle (triggered / investigating / identified /
      mitigating / resolved)
- [x] **152.1.4** Status transitions with required fields
- [x] **152.1.5** Services / components taxonomy
- [x] **152.1.6** Dependency graph (upstream / downstream blast-radius)
- [x] **152.1.7** Incident linking (parent / child / related)
- [x] **152.1.8** Incident merge + split with full audit
- [x] **152.1.9** Custom fields per-team
- [x] **152.1.10** Tags + saved filters
- [x] **152.1.11** Timeline with automatic + manual entries
- [x] **152.1.12** Impact estimation (users / revenue / SLO burn)
- [x] **152.1.13** Incident closeout checklist
- [x] **152.1.14** Postmortem doc auto-scaffold on resolve
- [x] **152.1.15** Retention + anonymisation for long-term storage

---

### 152.2 @neith/oncall — On-Call Schedules & Rotations

- [x] **152.2.1** Weekly / daily / follow-the-sun rotation templates
- [x] **152.2.2** Layered schedule (primary / secondary / manager)
- [x] **152.2.3** Override window with audit trail
- [x] **152.2.4** Holiday + PTO calendar import (iCal / Google / sovereign cal)
- [x] **152.2.5** Shift swap request + approval
- [x] **152.2.6** On-call time-budget report (hours per person per period)
- [x] **152.2.7** Fair-distribution scheduler suggestions
- [x] **152.2.8** Regional / timezone aware routing
- [x] **152.2.9** Team rotation + escalation matrix composer
- [x] **152.2.10** Current + upcoming on-call view (who to page now)
- [x] **152.2.11** "Who is on-call" API for other tools
- [x] **152.2.12** Cross-team pager hand-off
- [x] **152.2.13** Burnout detection heuristic (nights / weekends / page count)
- [x] **152.2.14** Vacation embargo windows
- [x] **152.2.15** Trainee / shadow mode (dual-page with senior)

---

### 152.3 @neith/escalation — Escalation Policies & Routing

- [x] **152.3.1** Policy DSL (step → notify → wait → escalate)
- [x] **152.3.2** Round-robin + all-at-once + parallel modes
- [x] **152.3.3** Ack timer per step (configurable)
- [x] **152.3.4** Escalate on no-ack → next level
- [x] **152.3.5** Escalate on reject / unavailable
- [x] **152.3.6** Conditional routing (service / env / time-of-day / severity)
- [x] **152.3.7** Team-based routing (CODEOWNERS / service catalog)
- [x] **152.3.8** Role-based routing (incident commander, scribe, SME)
- [x] **152.3.9** Fallback to manager tree
- [x] **152.3.10** Loop prevention / max-cycle guard

---

### 152.4 @neith/alert-ingest — Alert Ingestion & Routing

- [x] **152.4.1** Generic webhook endpoint with signature verify
- [x] **152.4.2** Native integration: Phase 149 (crash)
- [x] **152.4.3** Native integration: Phase 151 (EDR)
- [x] **152.4.4** Native integration: Phase 98 (Nous observability)
- [x] **152.4.5** Prometheus Alertmanager sink
- [x] **152.4.6** Grafana alert sink
- [x] **152.4.7** Datadog / New Relic / Splunk compatibility endpoints
- [x] **152.4.8** AWS CloudWatch / Azure Monitor / GCP Cloud Monitoring
- [x] **152.4.9** PagerDuty Events API v2 compatibility (drop-in)
- [x] **152.4.10** Opsgenie Integrations API compatibility
- [x] **152.4.11** Email-to-alert with subject parser
- [x] **152.4.12** SMS-to-alert for legacy systems
- [x] **152.4.13** Slack / sovereign chat (Phase 139) command-based alert
- [x] **152.4.14** Mobile app ad-hoc page
- [x] **152.4.15** Synthetic monitor (Phase 98) integration

---

### 152.5 @neith/notify — Multi-Channel Notification

- [x] **152.5.1** Mobile push (sovereign APNS / FCM bridge)
- [x] **152.5.2** SMS via multi-provider failover (Twilio + sovereign carrier)
- [x] **152.5.3** Voice call with DTMF ack ("press 4 to acknowledge")
- [x] **152.5.4** Email (sovereign SMTP from Phase 139)
- [x] **152.5.5** Slack / Teams / Discord / sovereign chat DM + channel
- [x] **152.5.6** Web push (PWA)
- [x] **152.5.7** Custom webhook per user
- [x] **152.5.8** WhatsApp / Telegram / Signal bot (opt-in)
- [x] **152.5.9** IRC / Matrix bridge
- [x] **152.5.10** Channel preference per user + per severity
- [x] **152.5.11** Do-not-disturb with SEV-1 override
- [x] **152.5.12** Smart retry across channels
- [x] **152.5.13** Repeat-page cadence policy
- [x] **152.5.14** Delivery-receipt tracking
- [x] **152.5.15** Multi-device reachability

---

### 152.6 @neith/noise — Alert Grouping, Noise & ML

- [x] **152.6.1** De-duplication by alert key
- [x] **152.6.2** Time-window grouping into a single incident
- [x] **152.6.3** Dependency-aware suppression (upstream silences downstream)
- [x] **152.6.4** Flapping detection with hysteresis
- [x] **152.6.5** Scheduled maintenance windows (suppress automatically)
- [x] **152.6.6** ML pattern learner (group-same-cause)
- [x] **152.6.7** Auto-acknowledge low-confidence noise
- [x] **152.6.8** Alert fatigue report per team
- [x] **152.6.9** Symptom vs cause alert ranking
- [x] **152.6.10** Known-issue linking (auto attach context)

---

### 152.7 @neith/war-room — Live Incident War-Room

- [x] **152.7.1** Auto-create chat channel on incident (Phase 139)
- [x] **152.7.2** Auto-create video bridge (Phase 139 / Zoom-class)
- [x] **152.7.3** Commander / scribe / SME role assignment UI
- [x] **152.7.4** Live status chips (service / env / customer-impact)
- [x] **152.7.5** Drag-drop runbook attachment
- [x] **152.7.6** Action-item capture inline in chat
- [x] **152.7.7** Decision log timestamped
- [x] **152.7.8** Live stream of agent actions (Phase 151 EDR response)
- [x] **152.7.9** Audit recording of voice bridge (consent-gated)
- [x] **152.7.10** Auto-transcript with speaker tagging
- [x] **152.7.11** Stakeholder watch-only channel
- [x] **152.7.12** Role hand-off (new commander) with briefing
- [x] **152.7.13** Subincident spawn from war-room
- [x] **152.7.14** Priority bump / down-grade with rationale
- [x] **152.7.15** Timer widgets (MTTD / MTTR running)

---

### 152.8 @neith/status — Public Status Page & Communications

- [x] **152.8.1** Customer-facing status page per product
- [x] **152.8.2** Incident broadcast composer (approve-before-publish)
- [x] **152.8.3** Component hierarchy + per-component status
- [x] **152.8.4** Historical uptime percentage (90d rolling)
- [x] **152.8.5** RSS / Atom / iCal / webhook subscriber feed
- [x] **152.8.6** Email / SMS subscribers
- [x] **152.8.7** Custom domain + branding + i18n
- [x] **152.8.8** Template-library of updates
- [x] **152.8.9** Audience targeting (by tenant / plan)
- [x] **152.8.10** Maintenance-window pre-announce
- [x] **152.8.11** Auto-post from incident-state transitions
- [x] **152.8.12** Multi-region status (for data-residency offerings)
- [x] **152.8.13** API for embedding in app
- [x] **152.8.14** Translations (sovereign translation service)
- [x] **152.8.15** WCAG AA accessible page

---

### 152.9 @neith/runbook — Runbooks, Automation & Playbooks

- [x] **152.9.1** Runbook markdown with embedded commands
- [x] **152.9.2** One-click execute with audit
- [x] **152.9.3** Parameterised runbook inputs
- [x] **152.9.4** Suggested-runbook from alert signature
- [x] **152.9.5** Runbook library per service
- [x] **152.9.6** Git-backed versioned runbooks
- [x] **152.9.7** Automated diagnostic collection on trigger
- [x] **152.9.8** Auto-rollback on Phase 145 CI/CD when alert matches
- [x] **152.9.9** Auto-scale / failover actions
- [x] **152.9.10** Conditional playbook branches
- [x] **152.9.11** Human-in-the-loop approval gates
- [x] **152.9.12** Dry-run mode
- [x] **152.9.13** Runbook test fixture
- [x] **152.9.14** Runbook effectiveness metric
- [x] **152.9.15** LLM-drafted runbook from past incidents (Phase 47)

---

### 152.10 @neith/slo — SLO, Error Budgets & Alerting Policy

- [x] **152.10.1** SLI definition (latency / availability / quality /
      correctness)
- [x] **152.10.2** SLO target + window definition
- [x] **152.10.3** Error-budget computation + burn rate
- [x] **152.10.4** Multi-burn-rate alerts (Google SRE model)
- [x] **152.10.5** Dependency SLO composition
- [x] **152.10.6** Business-metric SLO (checkout / activation)
- [x] **152.10.7** SLO dashboard per service
- [x] **152.10.8** SLO review cadence
- [x] **152.10.9** SLO change history
- [x] **152.10.10** Error-budget policy engine (freeze releases when burned)

---

### 152.11 @neith/postmortem — Postmortem, Retro & Learning

- [x] **152.11.1** Blameless postmortem template
- [x] **152.11.2** Auto-populated timeline from war-room events
- [x] **152.11.3** Auto-populated impact (users, revenue, duration)
- [x] **152.11.4** Contributing-factors structured fields
- [x] **152.11.5** Action-item tracker with owner + due-date
- [x] **152.11.6** Follow-up verification on due-date
- [x] **152.11.7** Read-review-sign workflow
- [x] **152.11.8** Publication to internal wiki (Phase 139.10)
- [x] **152.11.9** Redact-and-share externally (for customers)
- [x] **152.11.10** Search across past postmortems
- [x] **152.11.11** Pattern miner (recurring themes)
- [x] **152.11.12** Knowledge-base linker (Phase 139.9 PKM)
- [x] **152.11.13** Retro facilitation mode (voting, grouping)
- [x] **152.11.14** Incident-cost report (SRE toil measured)
- [x] **152.11.15** LLM summariser producing exec-ready version

---

### 152.12 @neith/intel — Metrics, Reporting & SLA

- [x] **152.12.1** MTTA / MTTD / MTTR / MTTF per team + service
- [x] **152.12.2** Page volume + noise + ack-rate metrics
- [x] **152.12.3** On-call hours per engineer
- [x] **152.12.4** Customer SLA breach tracking
- [x] **152.12.5** Post-incident action-item completion rate
- [x] **152.12.6** Executive digest
- [x] **152.12.7** DORA-like incident metrics feeding Phase 145
- [x] **152.12.8** Benchmarks across teams
- [x] **152.12.9** Drill performance (game-day results)
- [x] **152.12.10** Export to Phase 142 analytics warehouse

---

### 152.13 @neith/customer-incident — Customer Support Bridge

- [x] **152.13.1** Zendesk / sovereign support (Phase 139) tickets linked
- [x] **152.13.2** Auto-attach related tickets to incident
- [x] **152.13.3** Mass-reply template once resolved
- [x] **152.13.4** VIP customer flag elevates severity
- [x] **152.13.5** Impact-segmentation per tenant
- [x] **152.13.6** CS / AM broadcast to named accounts
- [x] **152.13.7** Conference-line for enterprise customers
- [x] **152.13.8** Regulatory-notification workflow (GDPR / HIPAA)
- [x] **152.13.9** Legal / comms review handoff
- [x] **152.13.10** Customer-trust center export

---

### 152.14 @neith/gameday — Chaos & Game-Day Drills

- [x] **152.14.1** Scheduled drill generator (random scenario)
- [x] **152.14.2** Chaos-engine fault injection triggers
- [x] **152.14.3** Tabletop exercise facilitator
- [x] **152.14.4** Scenario library (network partition, region failure, key
      leak)
- [x] **152.14.5** Scoring rubric for drill retros
- [x] **152.14.6** Shadow on-call (trainee mode)
- [x] **152.14.7** Failure-mode catalogue per service
- [x] **152.14.8** Auto-generate from postmortem "what if next time"
- [x] **152.14.9** Recruit / simulate fake customer traffic
- [x] **152.14.10** Game-day leader-board

---

### 152.15 Testing & Validation

- [x] **152.15.1** Notification delivery SLA (< 30 s P99)
- [x] **152.15.2** Failover across SMS / voice providers drill
- [x] **152.15.3** Schedule fairness audit across teams
- [x] **152.15.4** Drop-in PagerDuty Events API conformance
- [x] **152.15.5** Drop-in Opsgenie Integrations API conformance
- [x] **152.15.6** Status-page cache-bust + high-traffic burst test
- [x] **152.15.7** War-room start time < 60 s from trigger
- [x] **152.15.8** Postmortem completeness rubric
- [ ] **152.15.9** Dogfood: manage every Oshun incident on this platform. This
      is an operational rollout — it needs the live Oshun production incident
      stream routed through the platform, which has not happened (stated
      2026-09-18). `blocked:release`
- [ ] **152.15.10** External customer pilot (3 teams, 6 months). A six-month
      field engagement with three external customer teams is a release/adoption
      event, not an in-repo task (stated 2026-09-18). `blocked:release`

---

Implementation and verification evidence:
[phase-152-evidence.md](phase-152-evidence.md).
