Eve library

phase-166.md

Tracker

Revision 1

On this page

Historical task source. The Eve task board holds current task state.

Phase 166: Neith Spatial Computing & visionOS Runtime — Unity PolySpatial / Apple visionOS + RealityKit / Meta Quest Presence Platform / Google ARCore Scene Semantics / Snap Lens Studio Parity#

Closes the spatial-computing sovereignty gap. Phase 73 ships an immersive VR production studio. Phase 42 includes XR runtime. Phase 166 focuses specifically on the mixed-reality / spatial-computing application runtime — the visionOS / PolySpatial / Quest Presence Platform class layer that blends virtual content with the user's physical room, hands, gaze, and environment in a shared or immersive space.

Sovereign replacement for Apple visionOS + RealityKit + ARKit + Scene Understanding, Unity PolySpatial + PolySpatial XR + visionOS simulator, Meta Quest Presence Platform (Scene API, Interaction SDK, Voice SDK), Google ARCore Scene Semantics + Geospatial, Microsoft HoloLens / Mixed Reality Toolkit, Snap Lens Studio (AR), Niantic Lightship ARDK, and Magic Leap 2 runtime layer.


166.1 @neith/spatial-core — Session, Scene & World Anchors#

  • 166.1.1 Spatial session manager (cold-start / warm-resume)
  • 166.1.2 World-anchor persistence across sessions
  • 166.1.3 Cloud-anchor share (multi-user collocated)
  • 166.1.4 Scene-mesh reconstruction (room-scan)
  • 166.1.5 Semantic segmentation (floor / wall / ceiling / table / seat / door / window)
  • 166.1.6 Dynamic object detection (human / pet / furniture moved)
  • 166.1.7 Occlusion mesh with per-frame depth
  • 166.1.8 Lighting estimation (colour temperature + intensity + spherical harmonics)
  • 166.1.9 Plane detection (horizontal / vertical)
  • 166.1.10 Bounding-box anchor
  • 166.1.11 Image-target tracking
  • 166.1.12 Object-target tracking (2D + 3D)
  • 166.1.13 Geospatial anchor (Earth-scale)
  • 166.1.14 VPS (Visual Positioning System) sovereign pipeline
  • 166.1.15 Privacy-preserving world data (on-device only)

166.2 @neith/spatial-volumes — Volumes, Immersive Spaces & Shared Spaces#

  • 166.2.1 Bounded volume (fixed-size slot in shared space)
  • 166.2.2 Unbounded / immersive space
  • 166.2.3 Full-space takeover mode
  • 166.2.4 Shared-space with other apps
  • 166.2.5 Multi-app compositing
  • 166.2.6 Side-by-side 2D window + 3D volume
  • 166.2.7 Passthrough / mixed-reality blend
  • 166.2.8 Portal / window-into-virtual
  • 166.2.9 Virtual environment skybox
  • 166.2.10 Progressive immersion dial
  • 166.2.11 Auto-resize volume to fit room
  • 166.2.12 Multi-volume single app
  • 166.2.13 Privacy-aware passthrough masking
  • 166.2.14 Capture-to-2D mirror for spectators
  • 166.2.15 Accessibility zoom / magnify mode

166.3 @neith/spatial-input — Gaze, Pinch, Hand & Voice Input#

  • 166.3.1 Eye-tracking gaze ray
  • 166.3.2 Gaze-hover highlight
  • 166.3.3 Gaze + pinch primary gesture
  • 166.3.4 Two-hand pinch for scale / rotate
  • 166.3.5 Hand skeleton tracking (27 joints / hand)
  • 166.3.6 Direct touch on virtual content
  • 166.3.7 Poke / poke-through interactions
  • 166.3.8 Grab / drag / throw physics
  • 166.3.9 Pose recognition (thumbs-up / fist / open-palm / peace)
  • 166.3.10 Custom gesture recogniser
  • 166.3.11 Voice wake-word + commands
  • 166.3.12 Dictation with language-model post-edit
  • 166.3.13 Spatial keyboard with hover-type
  • 166.3.14 Controller support (Quest / Magic Leap / custom)
  • 166.3.15 Accessibility alt-input (head-tracking / switch)

166.4 @neith/spatial-avatars — Personas, Avatars & Presence#

  • 166.4.1 Persona capture (face + voice signature)
  • 166.4.2 Avatar rig from Phase 162 MetaHuman pipeline
  • 166.4.3 Stylised / abstract avatars
  • 166.4.4 Gaze + expression streaming to others
  • 166.4.5 Lip-sync from mic
  • 166.4.6 Body / pose tracking from upper-body cams
  • 166.4.7 Leg inferencer for seated / standing
  • 166.4.8 Spatial audio attenuation by avatar distance
  • 166.4.9 Self-avatar mirror
  • 166.4.10 Pronoun / identity settings
  • 166.4.11 Avatar wardrobe (Phase 162 + Phase 165 marketplace)
  • 166.4.12 Shared-session multi-user presence
  • 166.4.13 Cross-platform (headset ↔ phone AR ↔ desktop) presence
  • 166.4.14 Privacy controls (mute / hide avatar)
  • 166.4.15 Safety zone / bubble

166.5 @neith/spatial-render — Stereoscopic & Foveated Render#

  • 166.5.1 Stereo per-eye rendering
  • 166.5.2 Fixed foveated rendering (FFR)
  • 166.5.3 Eye-tracked dynamic foveation
  • 166.5.4 Motion reprojection (timewarp / spacewarp)
  • 166.5.5 Low-latency compositor
  • 166.5.6 Per-eye depth for late-latching
  • 166.5.7 90 / 120 Hz rendering target
  • 166.5.8 Reduced-resolution screen-scale with upscaler (Phase 154)
  • 166.5.9 Variable rate shading
  • 166.5.10 HDR passthrough compositing
  • 166.5.11 Power-aware downshift on thermal throttle
  • 166.5.12 Per-eye IPD calibration
  • 166.5.13 Geometric distortion (Zernike polynomial) correction
  • 166.5.14 Chromatic aberration correction
  • 166.5.15 Stereo 3D test-pattern suite

166.6 @neith/spatial-physics — Physics in Passthrough#

  • 166.6.1 Virtual-to-real collision with scene mesh
  • 166.6.2 Gravity alignment with real up-vector
  • 166.6.3 Object-resting-on-real-table simulation
  • 166.6.4 Hand-push-object physics
  • 166.6.5 Real-to-virtual occlusion + shadow
  • 166.6.6 Real-world lighting-to-virtual shading
  • 166.6.7 Dynamic occluder update as objects move
  • 166.6.8 Virtual object falls off table realistically
  • 166.6.9 Magnet / snap-to-plane helper
  • 166.6.10 Safety zone enforcement (prevent fly-through-wall)

166.7 @neith/spatial-audio — Spatial Audio Integration#

  • 166.7.1 HRTF binaural rendering
  • 166.7.2 Room-acoustics from scene mesh
  • 166.7.3 Occlusion / obstruction filtering
  • 166.7.4 Reverberation per-room
  • 166.7.5 Ambisonics ingest + render (Phase 167 reuse)
  • 166.7.6 Voice call spatialisation
  • 166.7.7 Directional pickup for mic
  • 166.7.8 Near / far field distinction
  • 166.7.9 Personalised HRTF calibration
  • 166.7.10 Passthrough audio blend

166.8 @neith/spatial-sdk — Developer SDK & Tooling#

  • 166.8.1 Swift / Objective-C native bindings
  • 166.8.2 C++ / Rust native runtime
  • 166.8.3 Unity / Unreal / Godot plug-ins
  • 166.8.4 Web (WebXR) parity layer
  • 166.8.5 RealityKit / USDZ compatibility
  • 166.8.6 Scene-authoring tool (Reality Composer-class)
  • 166.8.7 Simulator with room presets
  • 166.8.8 Record-and-replay of spatial session
  • 166.8.9 Debug overlay (mesh / anchors / frustum)
  • 166.8.10 Perf analyzer (Phase 160 integration)
  • 166.8.11 Sample gallery (Phase 138.11 asset library)
  • 166.8.12 Declarative UI DSL (SwiftUI-class / UI Toolkit)
  • 166.8.13 Imperative 3D scene graph API
  • 166.8.14 Hybrid 2D+3D UI
  • 166.8.15 Deep-link from 2D app to 3D volume

166.9 @neith/spatial-anchors-collab — Multi-User Collocated Sessions#

  • 166.9.1 Peer discovery on LAN
  • 166.9.2 Cloud-relay fallback
  • 166.9.3 Shared anchor network protocol
  • 166.9.4 Room-scan sharing
  • 166.9.5 CRDT for shared scene state
  • 166.9.6 Voice chat bridge (Phase 159 voice reuse)
  • 166.9.7 Gesture / gaze broadcast
  • 166.9.8 Latency optimisation for room-scale
  • 166.9.9 Permission / roles in session
  • 166.9.10 Recording of multi-user for replay

166.10 @neith/spatial-os — Spatial OS Integration Shell#

  • 166.10.1 Integrate with Phase 45 sovereign OS spatial shell
  • 166.10.2 Window manager for 3D volumes
  • 166.10.3 Multitasking (apps side-by-side in space)
  • 166.10.4 Home / launcher spatial view
  • 166.10.5 App install store (Phase 165)
  • 166.10.6 System gestures vs app gestures
  • 166.10.7 Recentering + space reset
  • 166.10.8 Guardian / chaperone boundary
  • 166.10.9 Accessibility features (Voice Over, zoom, captions)
  • 166.10.10 Shared clipboard 2D ↔ 3D

166.11 Testing & Validation#

Local implementation and external-gate evidence: phase-166-evidence.md.

  • 166.11.1 Motion-to-photon latency ≤ 12 ms
  • 166.11.2 Eye-tracking calibration accuracy ≤ 1°
  • 166.11.3 Hand-tracking jitter benchmark
  • 166.11.4 Room-mesh accuracy on 50 test rooms
  • 166.11.5 Occlusion fidelity score
  • 166.11.6 Battery life target on target hardware — the live-device endurance grader and spatial-validate battery gate are complete. Needs a two-hour capture on the target spatial headset (Apple Vision Pro / visionOS device); the fleet has none (stated 2026-09-18). blocked:hardware
  • 166.11.7 Thermal throttling gracefully
  • 166.11.8 Multi-user collocated drift ≤ 2 cm / 10 min
  • 166.11.9 WCAG-XR accessibility conformance
  • 166.11.10 Dogfood: Phase 73 VR production + Phase 166 MR mode — the cross-phase session grader and spatial-validate dogfood gate are complete. Needs a live headset session on the target device; the fleet has no headset (stated 2026-09-18). blocked:hardware