The runtime renders two inputs now: the Rosella .personalized_headphone model and an already compiled .jochrtf field. SOFA import, the full-HRIR direct renderer and the SOFA -> .jochrtf fitting compiler leave this checkout; they continue as an offline tool that only produces caches this repository loads. The .jochrtf renderer goes back to the implementation that predates the direct SOFA work: 64-QMF analysis, 77 hybrid bands, per-object hybrid path delays and the project room (six first-order images plus the shared FDN tail) computed in code. It is restored verbatim under the .jochrtf vocabulary (SofaBinauralBackend -> JochrtfBackend) and gains one switch: --jochrtf-room on|off, off by default. With the room off the renderer outputs only the field's direct binaural sound, and in either mode it reads no audio assets. Because the room is computed in code again, the generated sofa-room*.npz assets and the modules only the SOFA path used are removed (sofa_canonical, sofa_hrir, sofa_direct_backend, sofa_room, hybrid_paths, partitioned_convolution, point_source, compile_hrtf, generate_sofa_room). data/ keeps the decode tables and the Rosella filterbanks. The CLI drops --sofa-hrtf, --hrtf-radius-m, --sofa-interpolation, --hrtf-cache-policy, --hrtf-cache-dir, --sofa-room, --sofa-room-preset and --source-reference-distance-m. A .jochrtf is still explicit through --compiled-hrtf-cache, and the default binaural input is the personalized model. Rosella parsing, filterbank, room and timing are untouched and its output stays bit-identical. The .jochrtf path reproduces the pre-SOFA renderer sample for sample, with the room on and with it off.
4.2 KiB
Binaural rendering
JOC renders binaural audio from two kinds of input:
| Input | Renderer | Distance and room |
|---|---|---|
.personalized_headphone (default) |
Rosella DSP, filterbank and model parameters | the model's own Near/Mid/Far and room handling, unchanged |
.jochrtf (reserved) |
77-band directional field, 64-QMF/hybrid analysis and synthesis | direct sound only by default; --jochrtf-room on adds the project room |
A .jochrtf is fitted offline from SOFA measurements by a separate compiler;
this repository loads and renders the result through --compiled-hrtf-cache.
python main.py input.m4a --binaural
python main.py input.m4a --binaural --personalized-headphone --binaural-mode far --rosella-filterbank 2
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf --jochrtf-room on
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf --jochrtf-room on
Without an explicit input the renderer uses HRTF/binaural.personalized_headphone
from the project directory. A .jochrtf is never generated or guessed: it has to
be named. Binaural DSP runs in float64/complex128 and updates parameters every 128
samples.
Point-source scale
The .jochrtf route keeps the Near/Mid/Far point-source scales of about 1 m,
2.193 m and 6.402 m, defaulting to Mid. For an ADM right/front/up position
p = (x, y, z):
q_SOFA = (y, -x, z) / ||p||
d_nominal = reference_distance_m * ||p||
The reference distance only gives object coordinates a nominal metric scale: it does not change the field response and adds no 1/r attenuation or propagation delay. A coincident source keeps its last valid direction, or front when there is no history.
The .jochrtf room
Off by default. --jochrtf-room on enables the project's own room, the same algorithm
the earlier public route used, computed in code with no asset files:
- six first-order image reflections (
public_room.first_order_image_sources, the original 18x18x14 m geometry); - a shared FDN tail (four orthogonal Hadamard feedback lines, two all-pass diffusers, low-pass damping, RT60 0.85 s);
- early reflections scaled by measurement radius over path distance, late send scaled by mode and normalised radius.
It is not a measured BRIR and not an external standard room. With the switch off the renderer skips room processing and outputs only the field's direct binaural sound; the room parameters are fixed at construction, with no preset and no external file.
Object input
Each reconstructed frame is [1536,16] PCM: LFE at slot 0 and fifteen
reconstructed object/bed slots at 1–15. The ID11 timeline feeds these directly,
without another decode or an intermediate loudspeaker render. The existing
1473-sample object compensation and 32-sample metadata alignment are retained.
Parameters update every 128 samples.
LFE keeps its separate low-pass treatment and no room send. Multi-position blocks,
ISF, explicit infinity and anchors requiring unavailable screen calibration are
rejected. finish() drains once. --binaural-tail-seconds bounds filterbank and
room draining.
Compact representation
.jochrtf v1 is a pickle-free NumPy ZIP holding JSON metadata, 77 band centres,
complex128[36,2,77] directional coefficients, float64[36,2] delay coefficients
and float64[2,2] bounds. Loading checks the format version, shapes and scalar
ranges, rehashes every member, and recomputes the cache key to confirm that the
coefficients match their configuration; a mismatch rejects the file.
This repository owns the format, the cache key and the hash validation; the fitting compiler lives in the separate checkout and shares the same format module instead of duplicating it. The compact representation keeps its angular and band-wise approximation error and is not equivalent to per-measurement precision.
Filterbank provenance is documented in data notes. See the MCA paper for the correction model. Algorithms are independently implemented; external measurements retain their own licensing terms.