Eve library

phase-163.md

Tracker

Revision 1

On this page

Historical task source. The Eve task board holds current task state.

Phase 163: Neith Virtual Production Stack — Unreal nDisplay / ICVFX / LED Volume / disguise xR / Pixotope / Mo-Sys StarTracker / ZeroDensity Reality Parity#

Closes the virtual-production sovereignty gap. Phase 135.x mentions Virtual Production / LED volume. Phase 73 ships a Director's Workspace for AI-orchestrated previs. Phase 159.12 ships pixel streaming. None deliver a unified on-set VP stack — the nDisplay / ICVFX / disguise xR class system that drives multi-GPU LED walls with camera-tracked parallax, genlock, color pipeline, and set extension for feature-film and broadcast productions.

Sovereign replacement for Unreal nDisplay / ICVFX / Live Link OpenColorIO, disguise xR + rx / RenderStream, Pixotope virtual studio, ZeroDensity Reality, Mo-Sys VP Pro / StarTracker / L40 mixed reality, Stype RedSpy, Ncam Reality, Brainstorm InfinitySet, Ross Voyager / Vision[Ai]ry, Vizrt Trio / Arena broadcast VP, Aximmetry Broadcast / Composer.


163.1 @neith/vp-cluster — Multi-Node Render Cluster#

  • 163.1.1 Cluster manager service (leader election)
  • 163.1.2 Config-driven topology (N nodes × M outputs)
  • 163.1.3 Master / render-node / sync-slave roles
  • 163.1.4 Heartbeat + failover
  • 163.1.5 Frame-lock (genlock) synchronisation across nodes
  • 163.1.6 Swap-lock (NVIDIA Quadro Sync / AMD FirePro S400 / sovereign)
  • 163.1.7 Software frame sync fallback (PTP + deadline scheduler)
  • 163.1.8 Timecode master / slave
  • 163.1.9 Command broadcast (OSC / gRPC fan-out)
  • 163.1.10 Config hot-reload on set
  • 163.1.11 Remote agent on each node
  • 163.1.12 Log + telemetry aggregation (Phase 160)
  • 163.1.13 Crash restart policy
  • 163.1.14 Stage A / Stage B parallel cluster isolation
  • 163.1.15 Per-node deterministic build pin

163.2 @neith/vp-wall — LED Volume Geometry & Mapping#

  • 163.2.1 LED panel catalog (pitch / resolution / HDR capability)
  • 163.2.2 Wall model (cylinder / curve / flat / ceiling / floor)
  • 163.2.3 UV / pixel-mapping config
  • 163.2.4 Per-panel bezel / gap compensation
  • 163.2.5 Pixel-accurate warp + soft-edge blend
  • 163.2.6 Ceiling / floor / wrap-around volume
  • 163.2.7 Automated scan (projector-based) for geometry calibration
  • 163.2.8 Nested wall (wall-inside-wall / split region)
  • 163.2.9 Physical-to-virtual world alignment
  • 163.2.10 Test pattern library (grid / colour / geometry)
  • 163.2.11 Moiré mitigation shader
  • 163.2.12 HDR brightness calibration (nit targets)
  • 163.2.13 Per-panel luminance normalisation
  • 163.2.14 Panel-health monitor
  • 163.2.15 Processor (Brompton / Novastar / ROE) bridge

163.3 @neith/vp-camera — Camera Tracking & Metadata#

  • 163.3.1 Stype RedSpy / Ncam / Mo-Sys StarTracker / OptiTrack / Vicon ingest
  • 163.3.2 Lens encoder (zoom / focus / iris) ingest
  • 163.3.3 IMU inertial integration
  • 163.3.4 Optical-target inside-out tracking (stars or fiducials)
  • 163.3.5 Plate-based markerless tracking fallback
  • 163.3.6 Calibration wand / chessboard procedure
  • 163.3.7 Delay calibration per camera
  • 163.3.8 Multi-camera support (A / B / C cam)
  • 163.3.9 Gimbal / crane / Steadicam latency model
  • 163.3.10 Remote head / Technocrane bridge
  • 163.3.11 Drone / handheld gyro ingest
  • 163.3.12 Tracking prediction / smoothing
  • 163.3.13 Metadata over FreeD / RTTrPM / OSC
  • 163.3.14 Timecode-aligned tracking record
  • 163.3.15 Live diagnostic HUD

163.4 @neith/vp-frustum — Inner / Outer Frustum Rendering#

  • 163.4.1 Outer frustum (ambient fill for whole wall)
  • 163.4.2 Inner frustum (camera-accurate parallax window)
  • 163.4.3 Dynamic frustum update at sub-frame rate
  • 163.4.4 Overshoot / safe-zone for camera lag
  • 163.4.5 Frustum crossfade (multi-cam handoff)
  • 163.4.6 Frustum resolution scaler
  • 163.4.7 Frustum colour-match shader
  • 163.4.8 Soft-edge fade around frustum
  • 163.4.9 Frustum replay-mode (pre-baked for re-takes)
  • 163.4.10 Live A / B inner-frustum compare
  • 163.4.11 Disguise-xR-style set extension bypass
  • 163.4.12 Talent eye-line overlay
  • 163.4.13 Off-frustum content (non-diegetic UI plate)
  • 163.4.14 Frustum latency meter
  • 163.4.15 VFX-quality hero frame extraction

163.5 @neith/vp-color — Colour Pipeline On-Set#

  • 163.5.1 OCIO 2.x end-to-end
  • 163.5.2 ACES IDT / RRT / ODT chain
  • 163.5.3 Per-LED calibration profile (primaries + white point)
  • 163.5.4 Camera OETF → scene-linear inversion
  • 163.5.5 Wall → camera colour roundtrip test
  • 163.5.6 Dolby Vision / HDR10+ preserve
  • 163.5.7 CDL / LUT apply per shot
  • 163.5.8 Live-grade (Phase 147 colorist) integration
  • 163.5.9 Grey card / colour chart verifier
  • 163.5.10 ColorChecker auto-match
  • 163.5.11 Warp-preserving colour transforms
  • 163.5.12 Per-frustum colour override
  • 163.5.13 Ambient light (practicals on set) reconciliation
  • 163.5.14 Metamerism alert
  • 163.5.15 Colour-signoff per setup

163.6 @neith/vp-scene — Virtual Scene Content Pipeline#

  • 163.6.1 Ingest USD / glTF / FBX / Alembic / VDB scenes
  • 163.6.2 Level streaming for large environments (Phase 42 reuse)
  • 163.6.3 Live-lit 3D scene updates from DCC
  • 163.6.4 Sky / time-of-day control
  • 163.6.5 HDRI dome + dynamic sun
  • 163.6.6 Weather system (Phase 79)
  • 163.6.7 Particle / VFX (Phase 161) support
  • 163.6.8 AI-generated plates / Gaussian splats (Phase 71)
  • 163.6.9 360° plate image sequence
  • 163.6.10 Stereoscopic scene (for large volume 3D)
  • 163.6.11 Volumetric mist / atmospherics (Phase 157)
  • 163.6.12 Editable content live in review
  • 163.6.13 Version / take history per scene
  • 163.6.14 Asset bundle shipment to cluster
  • 163.6.15 Art-dept live annotation

163.7 @neith/vp-mr — In-Camera VFX, Green-Screen & Mixed Reality#

  • 163.7.1 Green-screen keyer (Phase 147 reuse)
  • 163.7.2 AR foreground composite
  • 163.7.3 Set-extension beyond LED wall
  • 163.7.4 Virtual prop attach to real actor
  • 163.7.5 Real→virtual masking (object occluder)
  • 163.7.6 Spill suppression
  • 163.7.7 Depth-composite from LiDAR
  • 163.7.8 Reflection matching between real + virtual
  • 163.7.9 Light interaction (real-set lighting from wall)
  • 163.7.10 Actor eye-light from wall content
  • 163.7.11 Shadow cast from real actor onto virtual floor
  • 163.7.12 Real-time roto assist
  • 163.7.13 Final-pixel vs post-VFX switch per shot
  • 163.7.14 Plate capture for post
  • 163.7.15 Take-metadata bundling

163.8 @neith/vp-control — Operator Control Surface & UI#

  • 163.8.1 Web / tablet control UI
  • 163.8.2 Stream-deck / sovereign control panel
  • 163.8.3 Scene / shot / take selector
  • 163.8.4 Live parameter dials (time-of-day / focus / volumetric)
  • 163.8.5 Pre-made cues with fade / wipe
  • 163.8.6 Talent / AD / DP role dashboards
  • 163.8.7 Colour pipeline operator view
  • 163.8.8 Camera operator HUD
  • 163.8.9 VFX supervisor view with pixel-stats
  • 163.8.10 Live chat + walkie overlay
  • 163.8.11 Emergency wall black
  • 163.8.12 Auto-save project snapshot
  • 163.8.13 Rehearsal vs record vs playback modes
  • 163.8.14 On-set wrap + strike checklist
  • 163.8.15 Crew-facing display throw (script / scene)

163.9 @neith/vp-broadcast — Broadcast Virtual Studio#

  • 163.9.1 Real-time graphics + lower-thirds
  • 163.9.2 Virtual set library (news / weather / sport)
  • 163.9.3 Auto-rigged talent-avatar (Phase 162)
  • 163.9.4 AR over-green-screen bridge
  • 163.9.5 Data-driven graphics (live feed)
  • 163.9.6 Multi-camera director integration (Phase 135 broadcast)
  • 163.9.7 Instant-replay graphics
  • 163.9.8 Virtual crowd + sports data
  • 163.9.9 Election / results / map visualisation
  • 163.9.10 NDI / SDI / ST-2110 output

163.10 @neith/vp-record — Capture, Recording & Playback#

  • 163.10.1 Raw plate capture per camera
  • 163.10.2 Camera tracking data recording (FreeD stream)
  • 163.10.3 Synchronised multi-cam + audio timeline
  • 163.10.4 Take Recorder (Sequencer-class, Phase 42 integration)
  • 163.10.5 Re-render a take with different virtual scene (retake-less VFX)
  • 163.10.6 Dailies package (plate + metadata + scene version)
  • 163.10.7 Instant colour dailies via Phase 147
  • 163.10.8 On-set review player with markers
  • 163.10.9 Archival snapshot to cold storage
  • 163.10.10 ShotOps (Phase 135) integration for publish

163.11 @neith/vp-pipeline — Editorial & VFX Handoff#

  • 163.11.1 OTIO / AAF / EDL export with tracking data
  • 163.11.2 USD scene publish per take
  • 163.11.3 Virtual camera path export
  • 163.11.4 Plate-with-metadata package (EXR + JSON)
  • 163.11.5 VFX-ready plate (clean vs graded)
  • 163.11.6 Post-production rebuild of scene
  • 163.11.7 LUT / CDL persistence into edit
  • 163.11.8 3D world geometry handoff
  • 163.11.9 Virtual art-dept lineup doc
  • 163.11.10 Live-link back-and-forth with DCC (Phase 138)

163.12 Testing & Validation#

Local completion and verification evidence: phase-163-evidence.md.

  • 163.12.1 Genlock jitter ≤ 1 line (vp-testing::genlock analyser + tests)
  • 163.12.2 Camera latency ≤ 1.5 frames @ 24 FPS (vp-testing::latency)
  • 163.12.3 End-to-end colour round-trip ≤ ΔE 1 (vp-testing::color, CIEDE2000)
  • 163.12.4 4K 120 Hz per-node sustained — the throughput analyser (vp-testing::throughput, vp-validate throughput) is built and synthetic-trace tested; the residual is a PASS from a live multi-GPU render node. Needs a multi-GPU virtual-production render node; the fleet has a single-GPU Mac and a GPU-less Linux server (stated 2026-09-18). blocked:hardware
  • 163.12.5 Multi-cluster (stage A + B) isolation (vp-testing::isolation)
  • 163.12.6 Weather / lighting change mid-take smoothness (vp-testing::smoothness)
  • 163.12.7 Re-take replay determinism (vp-testing::determinism, bit-compare)
  • 163.12.8 Compatibility with ARRI / Sony / RED lens encoders — the focus/focal/iris sweep validator (vp-testing::lens_compat) is built; the residual is a sweep captured from the physical encoders. Needs the physical ARRI/Sony/RED lens encoders to capture a real sweep; the fleet has none (stated 2026-09-18). blocked:hardware
  • 163.12.9 Dogfood: Phase 27 Obsidian shoot virtualised — the scenario driver (vp-testing::scenario, vp-validate dogfood) is built; the residual is the real shoot content. Phase 27 was reclassified as a proposal on 2026-09-18; there is no Phase 27 shoot to virtualise, so this gate needs a different dogfood subject or withdrawal (owner decision). blocked:governance
  • 163.12.10 Broadcast live-operation 8 h soak — the soak grader (vp-testing::scenario::grade_broadcast_soak, vp-validate soak) is built; the residual is a real 8-hour broadcast run. Needs a live virtual-production broadcast operation (LED wall, cameras, tracking) run for 8 hours; the fleet has no such stage (stated 2026-09-18). blocked:hardware