Eve library

phase-167.md

Tracker

Revision 1

On this page

Historical task source. The Eve task board holds current task state.

Phase 167: Neith Engine Audio Architecture Depth — Wwise / FMOD / Unreal MetaSounds / Unity Audio + Vivox / Dolby Atmos Runtime / DTS:X / Steam Audio / Oculus Audio SDK / Resonance / Project Acoustics Parity#

Closes the engine-audio sovereignty gap. Phase 132 ships audio drivers and plugin hosting. Phase 133 ships the Composer DAW. Phase 38 ships Euterpe music intelligence. None deliver a game-engine audio runtime — the bus graph, spatialisation, HRTF, reverb, procedural music, dialog system, and cinematic mixer that sits between the sound designer and the end player. Godot audio has ~20 tasks and many features are light across phases; this phase makes engine audio first-class.

Sovereign replacement for Audiokinetic Wwise (banks, RTPCs, states, switches, events, SoundSeed, Motion, Spatial Audio, Strata, Impacter), Firelight FMOD Studio + Core, Unreal MetaSounds + Quartz + Submixes + SoundClasses, Unity Audio + Audio Random Container + Vivox, Dolby Atmos game runtime, DTS:X, Valve Steam Audio, Meta Oculus Audio SDK, Google Resonance Audio, Microsoft Project Acoustics, Convolvr, Hexany Audio / Elias adaptive music.


167.1 @neith/audio-graph — Node Graph & Runtime#

  • 167.1.1 Directed audio graph (source → buses → output)
  • 167.1.2 Dynamic graph mutation at runtime
  • 167.1.3 Per-bus sample-rate / channel-count conversion
  • 167.1.4 Sample-accurate scheduling
  • 167.1.5 Sub-frame tick support (per-buffer)
  • 167.1.6 Cross-fade / gain automation
  • 167.1.7 Snapshot / state presets
  • 167.1.8 Multi-threaded decode
  • 167.1.9 Audio thread priority / real-time hints
  • 167.1.10 Glitch-free add / remove node
  • 167.1.11 Bus sidechain routing
  • 167.1.12 Auxiliary send / return buses
  • 167.1.13 Solo / mute bus with cascade
  • 167.1.14 Hierarchical groups (dialogue / music / SFX / UI)
  • 167.1.15 Hot-reload of graph asset

167.2 @neith/audio-source — Source Playback Types#

  • 167.2.1 Sample playback (WAV / FLAC / Opus / Vorbis)
  • 167.2.2 Streamed long-form audio
  • 167.2.3 Procedural oscillator / noise generator
  • 167.2.4 Physical modelling source (string / drum / wind)
  • 167.2.5 Granular synthesis
  • 167.2.6 Concatenative (Phase 133 reuse)
  • 167.2.7 MIDI instrument (sampler / synth)
  • 167.2.8 Ambisonic source
  • 167.2.9 Impulse-response convolution source
  • 167.2.10 Random container (weighted / sequential / shuffle)
  • 167.2.11 Switch container (context-driven)
  • 167.2.12 Sequence / layer container
  • 167.2.13 Stinger / one-shot
  • 167.2.14 Crossfade playlist
  • 167.2.15 Time-stretch + pitch-shift per source

167.3 @neith/audio-spatial — 3D Spatialisation#

  • 167.3.1 3D positional attenuation curves
  • 167.3.2 Distance attenuation with inverse / linear / custom
  • 167.3.3 Directional emitter cone
  • 167.3.4 Doppler with vmax clamp
  • 167.3.5 HRTF binaural (multi-HRIR database)
  • 167.3.6 Personalised HRTF import
  • 167.3.7 Near-field HRTF extension
  • 167.3.8 Ambisonic (1st / 3rd / 5th order) decode
  • 167.3.9 Atmos bed + object routing
  • 167.3.10 DTS:X object metadata
  • 167.3.11 Speaker panning 5.1 / 7.1 / 7.1.4 / 9.1.6
  • 167.3.12 Vector-base amplitude panning
  • 167.3.13 Headphone / speaker auto-switch
  • 167.3.14 Head-locked / world-locked mode
  • 167.3.15 Ear-to-ear ITD / ILD modelling

167.4 @neith/audio-environment — Acoustics & Environmental FX#

  • 167.4.1 Environment / reverb zones
  • 167.4.2 Convolution reverb with IR library
  • 167.4.3 Algorithmic (FDN / Schroeder) reverb
  • 167.4.4 Occlusion + obstruction ray cast
  • 167.4.5 Transmission through materials (wood / glass / concrete)
  • 167.4.6 Diffraction around corners
  • 167.4.7 Pre-baked wave-acoustics (Project Acoustics-class)
  • 167.4.8 Real-time ray-traced acoustics (Steam Audio-class)
  • 167.4.9 Reverb morph between zones
  • 167.4.10 Weather / wind ambience
  • 167.4.11 Crowd / roomtone layering
  • 167.4.12 Underwater filter
  • 167.4.13 Tunnel / canyon early reflection
  • 167.4.14 Hearing-damage / concussion filter
  • 167.4.15 Vehicle interior acoustics

167.5 @neith/audio-mix — Mixer, Ducking & Snapshots#

  • 167.5.1 Real-time mix snapshot interpolation
  • 167.5.2 Sidechain ducking (music under dialogue)
  • 167.5.3 Dynamic mix profiles (combat / dialogue / cinematic)
  • 167.5.4 Priority-based voice culling
  • 167.5.5 Bus DSP chain (EQ / compressor / limiter / saturator)
  • 167.5.6 True-peak limiter with ISP oversample
  • 167.5.7 LUFS live loudness metering
  • 167.5.8 Loudness normalisation (ITU-R BS.1770)
  • 167.5.9 Dialogue intelligibility booster
  • 167.5.10 Mix sheet export for audio lead
  • 167.5.11 Scene-specific sub-mix
  • 167.5.12 Multi-listener (split-screen) mix
  • 167.5.13 Cinematic vs gameplay auto-bias
  • 167.5.14 Accessibility: mono down-mix + clarity
  • 167.5.15 Visual mixer UI with metering

167.6 @neith/audio-dialogue — Dialogue System#

  • 167.6.1 Dialogue line database
  • 167.6.2 Character voice bank (Phase 162)
  • 167.6.3 Localisation per language + region
  • 167.6.4 Conditional line selection rules
  • 167.6.5 Barks / triggered short lines
  • 167.6.6 Conversation flow manager
  • 167.6.7 Branching dialogue system
  • 167.6.8 Radio-comm / walkie voice FX
  • 167.6.9 Procedural voice (TTS) fallback (Phase 162)
  • 167.6.10 Lip-sync phoneme export
  • 167.6.11 Subtitle / caption trigger (a11y)
  • 167.6.12 Speech-to-visemes at runtime
  • 167.6.13 Emotion tag drives mix
  • 167.6.14 ADR / dubbing pipeline integration
  • 167.6.15 Scripted-vs-emergent chatter

167.7 @neith/audio-music — Adaptive Music System#

  • 167.7.1 Vertical / horizontal layers
  • 167.7.2 Musical bar-/beat-aware transitions
  • 167.7.3 Stinger triggering on cue
  • 167.7.4 Tempo / key-aware crossfade
  • 167.7.5 Generative stems from Phase 38 Euterpe
  • 167.7.6 Mood graph (exploration → combat → epilogue)
  • 167.7.7 Tension parameter coupling
  • 167.7.8 Real-time mixing of live-composed music
  • 167.7.9 Theme motif retrieval system
  • 167.7.10 Ableton Link clock sync (Phase 133)
  • 167.7.11 MIDI-driven in-game instrument
  • 167.7.12 Procedural percussion for footstep
  • 167.7.13 Muffled / distant music FX
  • 167.7.14 Audio-reactive VFX binding (Phase 161)
  • 167.7.15 Licensing-aware cue-sheet export

167.8 @neith/audio-synth — Procedural Audio / SFX#

  • 167.8.1 Impact / breakage synthesis (modal)
  • 167.8.2 Footstep procedural with material / weight
  • 167.8.3 Weapon / gun SFX generator
  • 167.8.4 Vehicle engine (granular + additive)
  • 167.8.5 Wind / whooshes
  • 167.8.6 Water splash / flow
  • 167.8.7 Fire / electrical buzz / thunder
  • 167.8.8 Creature vocal synth
  • 167.8.9 UI sonification toolkit
  • 167.8.10 Foley assistive (from animation curves)

167.9 @neith/audio-vocie — Voice Chat & Mic Integration#

  • 167.9.1 Opus voice chat codec (reuse Phase 159)
  • 167.9.2 Spatial proximity voice
  • 167.9.3 Team channels
  • 167.9.4 Noise suppression (RNNoise-class)
  • 167.9.5 Echo cancellation
  • 167.9.6 Gain-normalise
  • 167.9.7 Voice changer / masking
  • 167.9.8 Speech-to-text moderation
  • 167.9.9 Mute / block / transcript
  • 167.9.10 Push-to-talk vs voice activated

167.10 @neith/audio-profiler — Audio Profiler & Diagnostics#

  • 167.10.1 Voice count + slot usage (Phase 160 integration)
  • 167.10.2 DSP budget per bus
  • 167.10.3 Plugin-host CPU cost
  • 167.10.4 Buffer-underrun events
  • 167.10.5 Mix-graph flamegraph
  • 167.10.6 Asset-load hitches
  • 167.10.7 Dialogue / music / SFX stem usage
  • 167.10.8 Latency trigger-to-sound meter
  • 167.10.9 Waveform scope view
  • 167.10.10 Reverb / occlusion cost breakdown

167.11 @neith/audio-tooling — Audio Designer Workflow#

  • 167.11.1 Event Designer (Wwise-class authoring UI)
  • 167.11.2 State / switch / RTPC editor
  • 167.11.3 Timeline action graph (MetaSounds-class)
  • 167.11.4 Bank / soundbank packaging
  • 167.11.5 Asset browser with waveform
  • 167.11.6 Offline bake of conditional content
  • 167.11.7 Localisation matrix view
  • 167.11.8 Compare A/B of two mixes
  • 167.11.9 Playthrough recorder for review
  • 167.11.10 Live-connect to running game
  • 167.11.11 Edit while game runs (tweak live)
  • 167.11.12 Version history per asset
  • 167.11.13 Snapshot & rollback of scene mix
  • 167.11.14 Import Wwise project
  • 167.11.15 Import FMOD project

167.12 @neith/audio-accessibility — Accessibility#

  • 167.12.1 Mono down-mix toggle
  • 167.12.2 Dialogue clarity boost
  • 167.12.3 Haptic substitute for sound
  • 167.12.4 Captions (full subtitle library)
  • 167.12.5 Directional-sound visual indicator
  • 167.12.6 Colour-coded sound source HUD
  • 167.12.7 Left-right balance slider
  • 167.12.8 Hearing-aid mode (speech EQ boost)
  • 167.12.9 Volume ceiling protection
  • 167.12.10 Dyslexia / cognitive fonts for captions

167.13 Testing & Validation#

  • 167.13.1 Voice-count stress (≥ 512 concurrent voices)
  • 167.13.2 Latency < 20 ms P99 trigger-to-ear
  • 167.13.3 HRTF ABX vs a reference renderer — the fail-loud evidence grading is complete. SteamAudio and OpenAL-Soft are open-source HRTF references that install freely, so the objective comparison is actionable; but the ABX itself is a double-blind human listening panel on calibrated headphones, which only people can perform (stated 2026-09-18). blocked:human
  • 167.13.4 Atmos object renderer bit-compare
  • 167.13.5 Wwise / FMOD project import fidelity
  • 167.13.6 24-hour soak without underrun — the evidence grading enforces a live device, ≥ 86,400 s and zero underruns. Run it on the fleet's real audio device (CoreAudio on the Mac or ALSA on the Linux server). Verify: a 24-hour continuous-render soak on a live audio device completes with zero underruns/dropouts and the grader accepts the captured duration and frame coverage.
  • 167.13.7 Multi-listener mix correctness
  • 167.13.8 Adaptive music transition test corpus
  • 167.13.9 Loudness compliance for TV broadcast
  • 167.13.10 Dogfood: Phase 42 engine demos + Phase 27 franchise