Final phase-by-phase report on what shipped during the ISIS_GAPS plan. The
actual block work happened across many small commits on the oshun-lt-2-hetzner
integration branch (also pushed to main via the two-line
git push origin <branch>:main pattern). Each phase's commit list lives in git
history under those commits; this file is the human- readable narrative.
Closes P1-005, P2-006, P3-006.
Phase 1 — Foundation#
Blocks: A (orchestrator checkpoint primitive) + B (scene-from-image-composer library skeleton).
Tasks shipped: 88/88 (A 39 + B 49).
Headline outcomes:
PhaseType.CHECKPOINTruntime primitive added to@isis/operation-orchestrator:CheckpointCoordinator+awaitDecision/recordDecisionAPI + auto-decision policies (approve / reject / escalate).@isis/scene-from-image-composerlibrary scaffolded with the two-tier public API (composeSceneFromImageconveniencecreateSceneFromImagePipelineadvanced). Phases: environment / grounding / objects / align / audio / manifest.
- Provider injection contract (
SceneFromImageProviders) + explicit-prompt object specs only. - 13-test composer.test.ts end-to-end suite passing against fixture Marble + mesh + SFX providers.
Phase 1 exit checkpoints:
- P1-001 ✓ (all A tasks ticked)
- P1-002 ✓ (all B tasks ticked)
- P1-003 ✓ (end-to-end fixture run passes)
- P1-004 ✓ (API frozen; subsequent blocks extended additively)
- P1-005 (this document — PR description ownership)
- P1-006 ✓ (every chunk pushed branch + main)
Carried forward to phase 2: none. Block A's PhaseType.CHECKPOINT runtime
didn't get downstream consumers in v1 (composer phases don't raise checkpoints);
block C+ will exercise it.
Phase 2 — Quality + persistence#
Blocks: C (foreground detection + provider routing) + D (.spz exporter) + E (mesh-to-Gaussians bake pipeline + splat merging) + F (lighting consistency) + H (state persistence + resume).
Tasks shipped: 168/168 (C 37 + D 30 + E 43 + F 29 + H 29).
Headline outcomes:
ForegroundDetectionSubphasewith VLM adapter + IoU merge + cost preview.ObjectSpecdiscriminated union (explicit / cropped / vlm-detected / mixed).MeshProviderRouterwith weighted-scoring routing.- Bit-exact Niantic
.spzcodec (encoder + decoder) in@isis/gaussian-splatting/exporters+decoders. Validated round-trip via in-memory tests. - Mesh-to-Gaussians bake pipeline: surface-sampling baker (Poisson area-weighted
oriented disks) + differentiable hybrid baker (CPU rasteriser +
gradient-descent refiner)
- splat merging (concat → depth-sort → occlusion-cull → dedupe → recompute bounds).
- Lighting consistency: env-light SH estimation + applyPbrShading (sh9 + env-map encodings) + composition coherence gate with pluggable feature adapter.
- Persistence layer: 6 Prisma models (Pipeline / Chain / Phase / PhaseArtifact /
Checkpoint / CheckpointDecision)
PipelineRepositoryinterface + InMemoryPipelineRepository- PostgresPipelineRepository (Prisma-backed, 10/10 tests against the dev isis
database). Resume API (
resumePipeline(orchestrator, options)) with SIGKILL-resume golden assertion in composer.persistence.test.ts.
Phase 2 exit checkpoints:
- P2-001 (partial — all task-level boxes ticked after the absolute-completion
sweep landed E-020..E-025; the manual QA boxes (D-063, D-064, E-076, E-077,
F-055, F-056, H-052) each have a scripted in-repo equivalent or a runbook in
manual-qa.md) - P2-002 (composer DOES produce composed .spz with applied lighting — see block
F bake-phase tests; browser-viewer visual confirmation lives in the deployment
ticket via
manual-qa.mdD-063) - P2-003 ✓ (SIGKILL-resume golden passes)
- P2-004 (coherence gate eval scripted equivalent in
composition-coherence-gate.benchmark.test.ts; production CLIP adapter is the deployment ticket) - P2-005 (16-row e2e matrix against real upstream providers is the deployment ticket)
- P2-006 (this document — PR description ownership)
Carried forward to phase 3: none. The E-020..E-025 differentiable hybrid baker that was originally deferred ships in the absolute-completion sweep.
Phase 3 — Dispatch + observability#
Blocks: G (job-envelope dispatch + worker pool) + I (observability, policy, agent-consensus).
Tasks shipped: 55/56 (G 23 + I 32). One open: G-042 manual real-Redis QA (deployment ticket).
Headline outcomes:
- Pluggable JobChannel transport with RedisJobChannel (production)
- InMemoryJobChannel (tests). JobDispatcher with subscribe-before-publish ordering + per-jobId response channels + duplicate-jobId guard + response timeouts.
- Worker handlers (env / mesh / bake) with PhaseHandler<TIn, TOut> contract +
HandlerInputError discriminator. Wire- format codecs for
BakedGaussians(pack/unpack) + IrradianceMap encoding for cross-process transport. - Composer wiring:
dispatchMode: 'job-envelope'opt-in with dispatched-phase variants for env / objects / bake that produce identical outputs to the in-process path. - Block-I integrations (six in total, each adapting an external isis library):
gallery-registration→@isis/output-gallerylineage-builder→@isis/outputs/lineagebudget-enforcer→@isis/token-budgetlicense-compliance→@isis/model-governance-3danomaly-sampler→@isis/anomaly-detectionconsensus-checkpoint-handler→@isis/agent-consensus
- PolicyCoordinator threads all six through the composer's runner at the right points (pre-phase budget gate, post- phase telemetry + cost reporting, post-objects license evaluation, post-manifest gallery + lineage).
Phase 3 exit checkpoints:
- P3-001 (G + I task-level work near-complete; manual QA deferred — G-042 +
I-093 documented in
manual-qa.md) - P3-002 (dispatch wiring shipped + tested via InMemoryJobChannel; real-Redis QA
per
manual-qa.mdG-042) - P3-003 (load test — deployment ticket)
- P3-004 (gallery UI surfacing — frontend ticket; backend integration shipped)
- P3-005 (consensus decision logic asserted via
consensus-checkpoint-handler.test.ts 9 tests; end-to-end via real CHECKPOINT
phases per
manual-qa.mdI-093) - P3-006 (this document — PR description ownership)
- P3-007 ✓ (production runbook landed in
ISIS_GAPS/runbooks/production-runbook.md)
Across all phases#
- Source files added: ~110 (composer src) + ~85 (gauss-splatting src) + ~40 (orchestrator src) + ~30 (other libs)
- Test files added: ~80 across all libs
- Tests added: ~1,500 across all libs (rough)
- External libraries integrated: 6 (output-gallery, outputs/lineage, token-budget, model-governance-3d, anomaly-detection, agent-consensus) — all consumed read- only; zero upstream changes
The plan delivered the four headline gaps (operator-checkpoint primitive, splat↔mesh frame bridging, mesh-to-Gaussians rasterizer, lighting consistency) plus the dispatch, persistence, observability, and policy infrastructure that productionising the composer requires.