## Phase 153: Sovereign VFX Match-Move & 3D Camera Tracking Suite — Science-D-Visions 3DEqualizer / Foundry PFTrack / Andersson SynthEyes / Boujou / Blender Motion Tracking / Blackmagic Fusion Tracker Replacement

Closes the match-move sovereignty gap. Phase 135 (VFX Compositor & Post) flags
"Nuke-class... does not cover 3DEqualizer, PFTrack, SynthEyes" and Phase 135.4
mentions matchmove only as a category. Phase 138 covers optical mocap ingest but
not 2D→3D camera solving. This phase delivers a full sovereign match-move
workstation for feature-film, episodic, VFX, virtual-production, and AR
placement pipelines.

Sovereign replacement for Science-D-Visions 3DEqualizer 4/R8/R9, Foundry
PFTrack, Andersson Technologies SynthEyes, 2d3 Boujou, Blender Motion Tracking
(camera / object), Blackmagic Fusion Tracker, After Effects Camera Tracker,
Mocha Pro Insert, Cinema 4D Motion Tracker.

---

### 153.1 @neith/matchmove-core — Project & Pipeline

- [x] **153.1.1** Project entity with shot / sequence / reel structure
- [x] **153.1.2** Per-shot metadata (camera, lens, aperture, FPS, gate)
- [x] **153.1.3** Slate / burn-in data import (ALE / CDL / XMP)
- [x] **153.1.4** Color management (OCIO 2.x, ACES working space)
- [x] **153.1.5** Multi-take shot versioning
- [x] **153.1.6** Cross-shot survey-data reuse
- [x] **153.1.7** Imperial / metric unit switching
- [x] **153.1.8** Geospatial georeferencing option
- [x] **153.1.9** USD / Alembic / FBX scene roundtrip
- [x] **153.1.10** Job queue with farm submission (Phase 138 farm)

---

### 153.2 @neith/matchmove-ingest — Media & Camera Metadata

- [x] **153.2.1** Video ingest (ProRes / DNx / Red / ARRI / BRAW / MP4 / EXR
      seq)
- [x] **153.2.2** Proxy generation with timestamp-exact sync
- [x] **153.2.3** Pulldown / field-handling (3:2, 2:3:2:3)
- [x] **153.2.4** Variable frame-rate stretch-to-constant
- [x] **153.2.5** Shutter angle / exposure metadata capture
- [x] **153.2.6** Timecode + reel name preservation
- [x] **153.2.7** Camera package database (sensor size, crop factor)
- [x] **153.2.8** Lens package database (prime, zoom, anamorphic squeeze)
- [x] **153.2.9** Cooke /i, Zeiss XD, ARRI LDS metadata parse
- [x] **153.2.10** Gyroscope / accelerometer IMU ingest (mobile / drone)
- [x] **153.2.11** Depth sensor (LiDAR / ToF) ingest
- [x] **153.2.12** Set LiDAR scan (E57 / PLY / LAS) ingest
- [x] **153.2.13** HDRI environment probe import (32-bit linear)
- [x] **153.2.14** Survey point cloud alignment
- [x] **153.2.15** Witness-camera / reference-camera multi-cam rig

---

### 153.3 @neith/matchmove-features — 2D Feature Tracking

#### 153.3.1 Trackers

- [x] **153.3.1.1** KLT point tracker with pyramid
- [x] **153.3.1.2** SIFT / AKAZE / ORB descriptor tracker
- [x] **153.3.1.3** LightGlue / SuperPoint learned matcher
- [x] **153.3.1.4** Planar tracker (homography)
- [x] **153.3.1.5** Spline tracker for curved features
- [x] **153.3.1.6** Patch tracker with photometric model
- [x] **153.3.1.7** Dense optical-flow (RAFT-class)
- [x] **153.3.1.8** Bi-directional tracking with loop-refine
- [x] **153.3.1.9** Track-through-occlusion (re-identification)
- [x] **153.3.1.10** User tracker cook-and-freeze

#### 153.3.2 Authoring

- [x] **153.3.2.1** Manual track placement on viewer
- [x] **153.3.2.2** Automatic feature harvesting (corner density targets)
- [x] **153.3.2.3** Grid / mask track-spawn constraints
- [x] **153.3.2.4** Track ripple edit (all → selected → one)
- [x] **153.3.2.5** Hold frame, keyframe, interpolate
- [x] **153.3.2.6** Confidence + residual score per track
- [x] **153.3.2.7** Track colouring by quality
- [x] **153.3.2.8** Garbage-matte / inclusion-mask region
- [x] **153.3.2.9** Markers-on-set (physical tape / chroma-dot) recognition
- [x] **153.3.2.10** Autocorrect drift with sub-pixel refine

#### 153.3.3 Constraints

- [x] **153.3.3.1** Survey-constraint (real-world XYZ)
- [x] **153.3.3.2** Distance constraint between two tracks
- [x] **153.3.3.3** Co-planar constraint
- [x] **153.3.3.4** Line / vanishing-point constraint
- [x] **153.3.3.5** Horizon constraint
- [x] **153.3.3.6** Rigid-body group constraint
- [x] **153.3.3.7** Moving-object constraint (different solve group)
- [x] **153.3.3.8** Static-only filter for background solve
- [x] **153.3.3.9** Weighted track importance
- [x] **153.3.3.10** Per-frame constraint activation

---

### 153.4 @neith/matchmove-lens — Lens Distortion

- [x] **153.4.1** Radial 3DE-class distortion model (k1, k2, k3 + anamorphic)
- [x] **153.4.2** Brown-Conrady radial + tangential
- [x] **153.4.3** OpenCV 5/8/12-parameter models
- [x] **153.4.4** Fisheye (equidistant / stereographic / orthographic)
- [x] **153.4.5** Anamorphic squeeze + cooke-Pin
- [x] **153.4.6** Per-frame distortion (zoom-breathing)
- [x] **153.4.7** ST-map / UV map export
- [x] **153.4.8** Lens-grid calibration tool (chessboard / checkerboard / dot)
- [x] **153.4.9** Distortion preview + grid overlay
- [x] **153.4.10** LDPK plug-in compatibility (3DE plug-ins)
- [x] **153.4.11** Undistort / redistort to / from filmback
- [x] **153.4.12** Focal-length vs distortion polynomial fit
- [x] **153.4.13** Principal point offset solve
- [x] **153.4.14** Entrance-pupil offset modelling
- [x] **153.4.15** Round-trip distortion diff verification

---

### 153.5 @neith/matchmove-solver — Camera Solver

- [x] **153.5.1** Structure-from-Motion (SfM) pipeline
- [x] **153.5.2** Incremental + global SfM modes
- [x] **153.5.3** Pair / triplet initialisation with F + E matrix RANSAC
- [x] **153.5.4** 5-point / 7-point / 8-point + Nister solver
- [x] **153.5.5** PnP pose estimation for known-3D points
- [x] **153.5.6** Bundle adjustment (Ceres / sovereign) with sparse Jacobian
- [x] **153.5.7** Robust loss (Huber / Cauchy / truncated)
- [x] **153.5.8** Focal-length auto-solve vs locked-focal
- [x] **153.5.9** Known-focal / partial-focal hybrid
- [x] **153.5.10** Variable-focal (zoom) solve
- [x] **153.5.11** Lens distortion joint solve
- [x] **153.5.12** Rolling-shutter correction during solve
- [x] **153.5.13** Gravity vector constraint from IMU
- [x] **153.5.14** Scale from survey / stereoscopic baseline
- [x] **153.5.15** Monocular scale from known-object
- [x] **153.5.16** Nodal-point tripod (panoramic) solver
- [x] **153.5.17** Stereo-pair rig solve
- [x] **153.5.18** Multi-camera rig solve
- [x] **153.5.19** Tracking reliability pruning + re-solve
- [x] **153.5.20** Solve-error heatmap per frame

---

### 153.6 @neith/matchmove-object — Object & Body Tracking

- [x] **153.6.1** Rigid-body object solver (car / prop / sign)
- [x] **153.6.2** Articulated-body solver (skeleton-aware)
- [x] **153.6.3** Non-rigid / morph (face performance capture 2D → 3D)
- [x] **153.6.4** Mesh-deform tracker for cloth / skin
- [x] **153.6.5** Known-geometry (CAD / scan) align + solve
- [x] **153.6.6** ML object segmentation (SAM-class) for mask
- [x] **153.6.7** Pose estimation (OpenPose-class) for actor
- [x] **153.6.8** Hand / facial landmark tracking
- [x] **153.6.9** Multi-object scene solve
- [x] **153.6.10** Occlusion handling with z-depth hint

---

### 153.7 @neith/matchmove-scan — Set Reconstruction & Dense 3D

- [x] **153.7.1** Multi-view stereo (MVS) dense point cloud
- [x] **153.7.2** Depth-map fusion (volumetric TSDF)
- [x] **153.7.3** Mesh reconstruction (Poisson / Delaunay / TSDF-mesh)
- [x] **153.7.4** Texture projection onto mesh
- [x] **153.7.5** Gaussian splatting ingest (Phase 71)
- [x] **153.7.6** Neural radiance field (NeRF) solve option
- [x] **153.7.7** LiDAR scan merge into photogrammetric solve
- [x] **153.7.8** Scale-from-scan enforcement
- [x] **153.7.9** Ground plane auto-detect
- [x] **153.7.10** Occlusion mesh (matte-object) export
- [x] **153.7.11** Point-cloud decimation / filter
- [x] **153.7.12** Surface normal estimation
- [x] **153.7.13** Albedo / lighting inverse-render
- [x] **153.7.14** Reflection / shadow probe extraction
- [x] **153.7.15** Hydra-compatible USD scene export

---

### 153.8 @neith/matchmove-stabilize — Stabilisation & Retime

- [x] **153.8.1** 2D stabilise (translation / rotation / scale / perspective)
- [x] **153.8.2** 3D stabilise (lock to 3D point / plane)
- [x] **153.8.3** Smooth-cam with path tension slider
- [x] **153.8.4** Rolling-shutter correction filter
- [x] **153.8.5** Motion-blur removal
- [x] **153.8.6** Motion-blur synthesize (for match)
- [x] **153.8.7** Retime with optical-flow warp
- [x] **153.8.8** Gyro-flow stabilisation from IMU
- [x] **153.8.9** Horizon auto-level
- [x] **153.8.10** Counter-animated lock to moving object

---

### 153.9 @neith/matchmove-export — Exporters & Roundtrip

- [x] **153.9.1** Nuke-class compositor (Phase 135) native
- [x] **153.9.2** Maya / Blender / sovereign DCC (Phase 138) camera + locators
- [x] **153.9.3** Neith Engine (Phase 42) virtual camera
- [x] **153.9.4** USD camera primitive + lens metadata
- [x] **153.9.5** Alembic camera + tracker points
- [x] **153.9.6** FBX camera + animation
- [x] **153.9.7** 3DE lens distortion STMap for re-render
- [x] **153.9.8** Ground-plane geo + matte object
- [x] **153.9.9** Shotgun / ftrack / sovereign ShotOps (Phase 135) publish
- [x] **153.9.10** Virtual-production (Phase 163) LED-volume camera feed
- [x] **153.9.11** Real-time nDisplay camera over OSC
- [x] **153.9.12** Lens-file export (3DE / Nuke / PFTrack LD / Blender)
- [x] **153.9.13** Survey data export (CSV / E57 / USD)
- [x] **153.9.14** Error-report PDF attachment to shot pub
- [x] **153.9.15** Preview render with render-preview pass

---

### 153.10 @neith/matchmove-viz — Viewer & Interaction

- [x] **153.10.1** Dual-pane (2D track viewer + 3D scene viewer)
- [x] **153.10.2** Per-frame onion-skin track trail
- [x] **153.10.3** Residual overlay per track
- [x] **153.10.4** Reprojection error graph
- [x] **153.10.5** 3D viewport with camera path
- [x] **153.10.6** VR headset preview of solved scene
- [x] **153.10.7** Interactive solve-and-preview
- [x] **153.10.8** Keyframe / graph editor for animated quantities
- [x] **153.10.9** Layer / group / colour per track
- [x] **153.10.10** Side-by-side before / after lens undistort

---

### 153.11 @neith/matchmove-ai — ML-Assisted Matchmove

- [x] **153.11.1** Auto-mask ("paint the moving car") (Phase 94)
- [x] **153.11.2** Deep-matcher feature correspondence
- [x] **153.11.3** Monocular depth prior
- [x] **153.11.4** Learned lens-distortion inference from single frame
- [x] **153.11.5** Auto-orient (up-vector) from semantic cues
- [x] **153.11.6** Scene understanding (ground / wall / sky) label
- [x] **153.11.7** LLM assistant for solve-failure diagnosis (Phase 47)
- [x] **153.11.8** Shot-graph classifier (handheld / steadicam / drone)
- [x] **153.11.9** Suggested-track-density heatmap
- [x] **153.11.10** Auto-QA before publish

---

### 153.12 @neith/matchmove-script — Python / Rust SDK & Scripting

- [x] **153.12.1** Python 3 bindings mirroring 3DE API style
- [x] **153.12.2** Rust core API
- [x] **153.12.3** Headless CLI batch solve
- [x] **153.12.4** Farm-distribute solve jobs
- [x] **153.12.5** Jupyter notebook tutorials
- [x] **153.12.6** PyPI mock-compat package for 3DE-plugins
- [x] **153.12.7** Custom solver extension API
- [x] **153.12.8** Event hooks (on-solve / on-export)
- [x] **153.12.9** Integration test harness
- [x] **153.12.10** Preset library shareable across studios

---

### 153.13 Testing & Validation

- [x] **153.13.1** Public benchmark datasets (ETH3D, Tanks & Temples, KITTI)
- [x] **153.13.2** Residual ≤ 0.3 px on clean 4K plates
- [x] **153.13.3** Anamorphic T1.3 calibration accuracy test
- [x] **153.13.4** Rolling-shutter camera benchmark
- [x] **153.13.5** Nodal-pan stitch regression
- [x] **153.13.6** Object-solve accuracy vs mocap ground truth
- [x] **153.13.7** 3DE / PFTrack / SynthEyes export compat conformance
- [x] **153.13.8** 1000-shot feature-film VFX pipeline dogfood
- [x] **153.13.9** Interactive solve on 4K plate < 3 min
- [x] **153.13.10** Licence cost benchmark (zero vs proprietary)

---

Implementation and verification evidence:
[phase-153-evidence.md](phase-153-evidence.md).
