Historical task source. The Eve task board holds current task state.
Phase 163: Neith Virtual Production Stack — Unreal nDisplay / ICVFX / LED Volume / disguise xR / Pixotope / Mo-Sys StarTracker / ZeroDensity Reality Parity#
Closes the virtual-production sovereignty gap. Phase 135.x mentions Virtual Production / LED volume. Phase 73 ships a Director's Workspace for AI-orchestrated previs. Phase 159.12 ships pixel streaming. None deliver a unified on-set VP stack — the nDisplay / ICVFX / disguise xR class system that drives multi-GPU LED walls with camera-tracked parallax, genlock, color pipeline, and set extension for feature-film and broadcast productions.
Sovereign replacement for Unreal nDisplay / ICVFX / Live Link OpenColorIO, disguise xR + rx / RenderStream, Pixotope virtual studio, ZeroDensity Reality, Mo-Sys VP Pro / StarTracker / L40 mixed reality, Stype RedSpy, Ncam Reality, Brainstorm InfinitySet, Ross Voyager / Vision[Ai]ry, Vizrt Trio / Arena broadcast VP, Aximmetry Broadcast / Composer.
163.1 @neith/vp-cluster — Multi-Node Render Cluster#
- 163.1.1 Cluster manager service (leader election)
- 163.1.2 Config-driven topology (N nodes × M outputs)
- 163.1.3 Master / render-node / sync-slave roles
- 163.1.4 Heartbeat + failover
- 163.1.5 Frame-lock (genlock) synchronisation across nodes
- 163.1.6 Swap-lock (NVIDIA Quadro Sync / AMD FirePro S400 / sovereign)
- 163.1.7 Software frame sync fallback (PTP + deadline scheduler)
- 163.1.8 Timecode master / slave
- 163.1.9 Command broadcast (OSC / gRPC fan-out)
- 163.1.10 Config hot-reload on set
- 163.1.11 Remote agent on each node
- 163.1.12 Log + telemetry aggregation (Phase 160)
- 163.1.13 Crash restart policy
- 163.1.14 Stage A / Stage B parallel cluster isolation
- 163.1.15 Per-node deterministic build pin
163.2 @neith/vp-wall — LED Volume Geometry & Mapping#
- 163.2.1 LED panel catalog (pitch / resolution / HDR capability)
- 163.2.2 Wall model (cylinder / curve / flat / ceiling / floor)
- 163.2.3 UV / pixel-mapping config
- 163.2.4 Per-panel bezel / gap compensation
- 163.2.5 Pixel-accurate warp + soft-edge blend
- 163.2.6 Ceiling / floor / wrap-around volume
- 163.2.7 Automated scan (projector-based) for geometry calibration
- 163.2.8 Nested wall (wall-inside-wall / split region)
- 163.2.9 Physical-to-virtual world alignment
- 163.2.10 Test pattern library (grid / colour / geometry)
- 163.2.11 Moiré mitigation shader
- 163.2.12 HDR brightness calibration (nit targets)
- 163.2.13 Per-panel luminance normalisation
- 163.2.14 Panel-health monitor
- 163.2.15 Processor (Brompton / Novastar / ROE) bridge
163.3 @neith/vp-camera — Camera Tracking & Metadata#
- 163.3.1 Stype RedSpy / Ncam / Mo-Sys StarTracker / OptiTrack / Vicon ingest
- 163.3.2 Lens encoder (zoom / focus / iris) ingest
- 163.3.3 IMU inertial integration
- 163.3.4 Optical-target inside-out tracking (stars or fiducials)
- 163.3.5 Plate-based markerless tracking fallback
- 163.3.6 Calibration wand / chessboard procedure
- 163.3.7 Delay calibration per camera
- 163.3.8 Multi-camera support (A / B / C cam)
- 163.3.9 Gimbal / crane / Steadicam latency model
- 163.3.10 Remote head / Technocrane bridge
- 163.3.11 Drone / handheld gyro ingest
- 163.3.12 Tracking prediction / smoothing
- 163.3.13 Metadata over FreeD / RTTrPM / OSC
- 163.3.14 Timecode-aligned tracking record
- 163.3.15 Live diagnostic HUD
163.4 @neith/vp-frustum — Inner / Outer Frustum Rendering#
- 163.4.1 Outer frustum (ambient fill for whole wall)
- 163.4.2 Inner frustum (camera-accurate parallax window)
- 163.4.3 Dynamic frustum update at sub-frame rate
- 163.4.4 Overshoot / safe-zone for camera lag
- 163.4.5 Frustum crossfade (multi-cam handoff)
- 163.4.6 Frustum resolution scaler
- 163.4.7 Frustum colour-match shader
- 163.4.8 Soft-edge fade around frustum
- 163.4.9 Frustum replay-mode (pre-baked for re-takes)
- 163.4.10 Live A / B inner-frustum compare
- 163.4.11 Disguise-xR-style set extension bypass
- 163.4.12 Talent eye-line overlay
- 163.4.13 Off-frustum content (non-diegetic UI plate)
- 163.4.14 Frustum latency meter
- 163.4.15 VFX-quality hero frame extraction
163.5 @neith/vp-color — Colour Pipeline On-Set#
- 163.5.1 OCIO 2.x end-to-end
- 163.5.2 ACES IDT / RRT / ODT chain
- 163.5.3 Per-LED calibration profile (primaries + white point)
- 163.5.4 Camera OETF → scene-linear inversion
- 163.5.5 Wall → camera colour roundtrip test
- 163.5.6 Dolby Vision / HDR10+ preserve
- 163.5.7 CDL / LUT apply per shot
- 163.5.8 Live-grade (Phase 147 colorist) integration
- 163.5.9 Grey card / colour chart verifier
- 163.5.10 ColorChecker auto-match
- 163.5.11 Warp-preserving colour transforms
- 163.5.12 Per-frustum colour override
- 163.5.13 Ambient light (practicals on set) reconciliation
- 163.5.14 Metamerism alert
- 163.5.15 Colour-signoff per setup
163.6 @neith/vp-scene — Virtual Scene Content Pipeline#
- 163.6.1 Ingest USD / glTF / FBX / Alembic / VDB scenes
- 163.6.2 Level streaming for large environments (Phase 42 reuse)
- 163.6.3 Live-lit 3D scene updates from DCC
- 163.6.4 Sky / time-of-day control
- 163.6.5 HDRI dome + dynamic sun
- 163.6.6 Weather system (Phase 79)
- 163.6.7 Particle / VFX (Phase 161) support
- 163.6.8 AI-generated plates / Gaussian splats (Phase 71)
- 163.6.9 360° plate image sequence
- 163.6.10 Stereoscopic scene (for large volume 3D)
- 163.6.11 Volumetric mist / atmospherics (Phase 157)
- 163.6.12 Editable content live in review
- 163.6.13 Version / take history per scene
- 163.6.14 Asset bundle shipment to cluster
- 163.6.15 Art-dept live annotation
163.7 @neith/vp-mr — In-Camera VFX, Green-Screen & Mixed Reality#
- 163.7.1 Green-screen keyer (Phase 147 reuse)
- 163.7.2 AR foreground composite
- 163.7.3 Set-extension beyond LED wall
- 163.7.4 Virtual prop attach to real actor
- 163.7.5 Real→virtual masking (object occluder)
- 163.7.6 Spill suppression
- 163.7.7 Depth-composite from LiDAR
- 163.7.8 Reflection matching between real + virtual
- 163.7.9 Light interaction (real-set lighting from wall)
- 163.7.10 Actor eye-light from wall content
- 163.7.11 Shadow cast from real actor onto virtual floor
- 163.7.12 Real-time roto assist
- 163.7.13 Final-pixel vs post-VFX switch per shot
- 163.7.14 Plate capture for post
- 163.7.15 Take-metadata bundling
163.8 @neith/vp-control — Operator Control Surface & UI#
- 163.8.1 Web / tablet control UI
- 163.8.2 Stream-deck / sovereign control panel
- 163.8.3 Scene / shot / take selector
- 163.8.4 Live parameter dials (time-of-day / focus / volumetric)
- 163.8.5 Pre-made cues with fade / wipe
- 163.8.6 Talent / AD / DP role dashboards
- 163.8.7 Colour pipeline operator view
- 163.8.8 Camera operator HUD
- 163.8.9 VFX supervisor view with pixel-stats
- 163.8.10 Live chat + walkie overlay
- 163.8.11 Emergency wall black
- 163.8.12 Auto-save project snapshot
- 163.8.13 Rehearsal vs record vs playback modes
- 163.8.14 On-set wrap + strike checklist
- 163.8.15 Crew-facing display throw (script / scene)
163.9 @neith/vp-broadcast — Broadcast Virtual Studio#
- 163.9.1 Real-time graphics + lower-thirds
- 163.9.2 Virtual set library (news / weather / sport)
- 163.9.3 Auto-rigged talent-avatar (Phase 162)
- 163.9.4 AR over-green-screen bridge
- 163.9.5 Data-driven graphics (live feed)
- 163.9.6 Multi-camera director integration (Phase 135 broadcast)
- 163.9.7 Instant-replay graphics
- 163.9.8 Virtual crowd + sports data
- 163.9.9 Election / results / map visualisation
- 163.9.10 NDI / SDI / ST-2110 output
163.10 @neith/vp-record — Capture, Recording & Playback#
- 163.10.1 Raw plate capture per camera
- 163.10.2 Camera tracking data recording (FreeD stream)
- 163.10.3 Synchronised multi-cam + audio timeline
- 163.10.4 Take Recorder (Sequencer-class, Phase 42 integration)
- 163.10.5 Re-render a take with different virtual scene (retake-less VFX)
- 163.10.6 Dailies package (plate + metadata + scene version)
- 163.10.7 Instant colour dailies via Phase 147
- 163.10.8 On-set review player with markers
- 163.10.9 Archival snapshot to cold storage
- 163.10.10 ShotOps (Phase 135) integration for publish
163.11 @neith/vp-pipeline — Editorial & VFX Handoff#
- 163.11.1 OTIO / AAF / EDL export with tracking data
- 163.11.2 USD scene publish per take
- 163.11.3 Virtual camera path export
- 163.11.4 Plate-with-metadata package (EXR + JSON)
- 163.11.5 VFX-ready plate (clean vs graded)
- 163.11.6 Post-production rebuild of scene
- 163.11.7 LUT / CDL persistence into edit
- 163.11.8 3D world geometry handoff
- 163.11.9 Virtual art-dept lineup doc
- 163.11.10 Live-link back-and-forth with DCC (Phase 138)
163.12 Testing & Validation#
Local completion and verification evidence:
phase-163-evidence.md.
- 163.12.1 Genlock jitter ≤ 1 line (
vp-testing::genlockanalyser + tests) - 163.12.2 Camera latency ≤ 1.5 frames @ 24 FPS (
vp-testing::latency) - 163.12.3 End-to-end colour round-trip ≤ ΔE 1 (
vp-testing::color, CIEDE2000) - 163.12.4 4K 120 Hz per-node sustained — the throughput analyser
(
vp-testing::throughput,vp-validate throughput) is built and synthetic-trace tested; the residual is a PASS from a live multi-GPU render node. Needs a multi-GPU virtual-production render node; the fleet has a single-GPU Mac and a GPU-less Linux server (stated 2026-09-18).blocked:hardware - 163.12.5 Multi-cluster (stage A + B) isolation
(
vp-testing::isolation) - 163.12.6 Weather / lighting change mid-take smoothness
(
vp-testing::smoothness) - 163.12.7 Re-take replay determinism (
vp-testing::determinism, bit-compare) - 163.12.8 Compatibility with ARRI / Sony / RED lens encoders — the
focus/focal/iris sweep validator (
vp-testing::lens_compat) is built; the residual is a sweep captured from the physical encoders. Needs the physical ARRI/Sony/RED lens encoders to capture a real sweep; the fleet has none (stated 2026-09-18).blocked:hardware - 163.12.9 Dogfood: Phase 27 Obsidian shoot virtualised — the scenario
driver (
vp-testing::scenario,vp-validate dogfood) is built; the residual is the real shoot content. Phase 27 was reclassified as a proposal on 2026-09-18; there is no Phase 27 shoot to virtualise, so this gate needs a different dogfood subject or withdrawal (owner decision).blocked:governance - 163.12.10 Broadcast live-operation 8 h soak — the soak grader
(
vp-testing::scenario::grade_broadcast_soak,vp-validate soak) is built; the residual is a real 8-hour broadcast run. Needs a live virtual-production broadcast operation (LED wall, cameras, tracking) run for 8 hours; the fleet has no such stage (stated 2026-09-18).blocked:hardware