Keep only the Rosella and .jochrtf binaural paths
The runtime renders two inputs now: the Rosella .personalized_headphone model and an already compiled .jochrtf field. SOFA import, the full-HRIR direct renderer and the SOFA -> .jochrtf fitting compiler leave this checkout; they continue as an offline tool that only produces caches this repository loads. The .jochrtf renderer goes back to the implementation that predates the direct SOFA work: 64-QMF analysis, 77 hybrid bands, per-object hybrid path delays and the project room (six first-order images plus the shared FDN tail) computed in code. It is restored verbatim under the .jochrtf vocabulary (SofaBinauralBackend -> JochrtfBackend) and gains one switch: --jochrtf-room on|off, off by default. With the room off the renderer outputs only the field's direct binaural sound, and in either mode it reads no audio assets. Because the room is computed in code again, the generated sofa-room*.npz assets and the modules only the SOFA path used are removed (sofa_canonical, sofa_hrir, sofa_direct_backend, sofa_room, hybrid_paths, partitioned_convolution, point_source, compile_hrtf, generate_sofa_room). data/ keeps the decode tables and the Rosella filterbanks. The CLI drops --sofa-hrtf, --hrtf-radius-m, --sofa-interpolation, --hrtf-cache-policy, --hrtf-cache-dir, --sofa-room, --sofa-room-preset and --source-reference-distance-m. A .jochrtf is still explicit through --compiled-hrtf-cache, and the default binaural input is the personalized model. Rosella parsing, filterbank, room and timing are untouched and its output stays bit-identical. The .jochrtf path reproduces the pre-SOFA renderer sample for sample, with the room on and with it off.
This commit is contained in:
1 parent
3ea285e407
commit
07a26b41fe
21 files changed
+692
-2309
No files matched your search
+56
-59
@@ -2,91 +2,88 @@
|
||||
|
||||
[中文](binaural.md) · [README](../README.en.md)
|
||||
|
||||
## Independent input routes
|
||||
JOC renders binaural audio from two kinds of input:
|
||||
|
||||
| Input | Rendering | Distance and environment |
|
||||
| Input | Renderer | Distance and room |
|
||||
|---|---|---|
|
||||
| SOFA | Full complex directional HRIR interpolation, adaptive FIR length, 128-sample partitioned convolution | Direct by default; optional project room; no synthetic radial head filtering |
|
||||
| `.jochrtf` | Existing 77-band, fifth-order field and delay representation | Direct by default; same optional room |
|
||||
| `.personalized_headphone` | Existing DSP, filterbank and model parameters | Existing Near/Mid/Far and room processing unchanged |
|
||||
| `.personalized_headphone` (default) | Rosella DSP, filterbank and model parameters | the model's own Near/Mid/Far and room handling, unchanged |
|
||||
| `.jochrtf` (reserved) | 77-band directional field, 64-QMF/hybrid analysis and synthesis | direct sound only by default; `--jochrtf-room on` adds the project room |
|
||||
|
||||
SOFA never invokes the compact compiler, writes a compact cache or falls back to it. The compact format, validation and offline compiler remain available. SOFA and compact input use `DirectSofaBackend` with the object timeline.
|
||||
A `.jochrtf` is fitted offline from SOFA measurements by a separate compiler;
|
||||
this repository loads and renders the result through `--compiled-hrtf-cache`.
|
||||
|
||||
```powershell
|
||||
python main.py input.m4a --binaural
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa --sofa-interpolation lf_mca_zero
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa --source-reference-distance-m 2.193
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa --sofa-room
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa --sofa-room --sofa-room-preset legacy
|
||||
python src\compile_hrtf.py C:\HRTF\subject.sofa C:\HRTF\subject.jochrtf
|
||||
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf
|
||||
python main.py input.m4a --binaural --personalized-headphone --binaural-mode far --rosella-filterbank 2
|
||||
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf
|
||||
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf --jochrtf-room on
|
||||
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf --jochrtf-room on
|
||||
```
|
||||
|
||||
The default SOFA is `HRTF/binaural.sofa` under the project directory, independent of the working directory. Use `--sofa-hrtf PATH` for other locations. A single measurement shell is selected automatically; multiple shells require `--hrtf-radius-m`. Radial interpolation is not implemented. The personalized default remains `HRTF/binaural.personalized_headphone`.
|
||||
|
||||
SOFA and compact inputs retain the Near/Mid/Far point-source scales, default Mid. Personalized presets and ADM DBMD hints retain their existing behavior.
|
||||
Without an explicit input the renderer uses `HRTF/binaural.personalized_headphone`
|
||||
from the project directory. A `.jochrtf` is never generated or guessed: it has to
|
||||
be named. Binaural DSP runs in float64/complex128 and updates parameters every 128
|
||||
samples.
|
||||
|
||||
## Point-source scale
|
||||
|
||||
Near/Mid/Far reference distances are 1.00000465, 2.19327927 and 6.40177584 m. `--source-reference-distance-m` overrides the selected scale. For ADM right/front/up coordinates `p=(x,y,z)`:
|
||||
The `.jochrtf` route keeps the Near/Mid/Far point-source scales of about 1 m,
|
||||
2.193 m and 6.402 m, defaulting to Mid. For an ADM right/front/up position
|
||||
`p = (x, y, z)`:
|
||||
|
||||
```text
|
||||
q_SOFA = (y, -x, z) / ||p||
|
||||
q_SOFA = (y, -x, z) / ||p||
|
||||
d_nominal = reference_distance_m * ||p||
|
||||
H_render(ear, f) = H_selected_shell(ear, f, q_SOFA)
|
||||
```
|
||||
|
||||
This defines nominal metric object coordinates, without turning a 1.2 m measurement into measured 2.193 m data or changing SOFA metadata. Direct-only rendering adds no inverse-distance attenuation, radial sphere ratio, synthetic centre response, room send, dry/wet coupling or distance-dependent flight time. Programme gain and the SOFA response scale are retained. The optional room uses the original project coupling; explicit output gain is applied once.
|
||||
The reference distance only gives object coordinates a nominal metric scale: it
|
||||
does not change the field response and adds no 1/r attenuation or propagation
|
||||
delay. A coincident source keeps its last valid direction, or front when there is
|
||||
no history.
|
||||
|
||||
A coincident source has no defined direction. Retain that object's last valid direction, or use front when no history exists. No zero-ITD response is synthesized. Finite outside coordinates retain the metadata distance factor rather than being clamped into the unit box.
|
||||
## The `.jochrtf` room
|
||||
|
||||
SOFA requires no personalized model or machine-local configuration. Direct-only rendering does not read a room asset. Reports record input identity, measured radius, interpolation and the room switch.
|
||||
Off by default. `--jochrtf-room on` enables the project's own room, the same algorithm
|
||||
the earlier public route used, computed in code with no asset files:
|
||||
|
||||
## Optional project room
|
||||
- six first-order image reflections (`public_room.first_order_image_sources`, the
|
||||
original 18x18x14 m geometry);
|
||||
- a shared FDN tail (four orthogonal Hadamard feedback lines, two all-pass diffusers,
|
||||
low-pass damping, RT60 0.85 s);
|
||||
- early reflections scaled by measurement radius over path distance, late send scaled
|
||||
by mode and normalised radius.
|
||||
|
||||
`--sofa-room` is off by default. It reuses the original `public_room.py` and `reference_distance.py` algorithms with original and compact parameter sets: six first-order image reflections plus a shared four-line orthogonal Hadamard FDN with two all-pass diffusers and low-pass damping. The project listening preset aims to approximate an ideal listening environment dominated by direct sound. It is not a measured BRIR or a mandated standard room. No Rosella room table is required.
|
||||
|
||||
Near/Mid default to `compact`; Far defaults to `legacy` to retain its unit-coordinate
|
||||
source range. Select either with `--sofa-room-preset compact|legacy`. Compact dimensions
|
||||
come from [model 9 in Zahorik 2009, Table 1](https://pmc.ncbi.nlm.nih.gov/articles/PMC2730711/).
|
||||
The same project algorithm scales late delays, diffusion times and the RT60 parameter
|
||||
by V/S. Only the geometry is borrowed; this does not reproduce the paper's BRIR model.
|
||||
|
||||
Full-HRIR rendering evaluates the selected SOFA at each reflected direction. Fractional delays use phase ramps across the full FFT grid, with extra delay `(L_path-L_direct)/c`; native `Data.Delay` is retained once. Direct, early and late gains follow the original project policy. Sources must lie inside the optional room geometry; outside positions are not silently clipped.
|
||||
|
||||
Both FDNs are excited by a unit impulse at 48 kHz and stored as stereo float64 FIRs.
|
||||
`data/sofa-room-compact.npz` has 37,383 taps and an RT60 parameter of about 0.3894 s;
|
||||
`data/sofa-room.npz` retains the original 81,600 taps and 0.85 s parameter. Omitted probe
|
||||
tail energy is about `2.2e-13` in both. PCM FFT convolution realizes each time-invariant
|
||||
system. Early reflections use the selected SOFA; late output retains the original
|
||||
stereo FDN definition.
|
||||
|
||||
Late FIR alignment includes the convolution implementation shift and the selected SOFA's common recording-delay estimate. Enabled room processing uses 1536-sample batches while retaining 128-sample parameter updates; extra flush padding is discarded. Early reflections in `.jochrtf` retain their 77-band approximation. Regenerate both assets with `python src\generate_sofa_room.py`, or select one using `--preset compact|legacy`; the archives record parameters, provenance, coefficient hash and tail budget.
|
||||
|
||||
## Full HRIR and time reference
|
||||
|
||||
The importer validates `SimpleFreeFieldHRIR` versions 0.4/1.0/1.1, FIR data, two consistently identifiable left/right receivers, zero emitter offset, free-field metadata, units and finite numbers. Processing uses 48 kHz; resampling scales sample-valued `Data.Delay` accordingly. Receivers must remain fixed across measurements; angular interpolation no longer fits a symmetric spherical head.
|
||||
|
||||
BRIR and SOFA conventions other than `SimpleFreeFieldHRIR` are not implemented. Unsupported files are rejected. The backend has a response-type guard to announce BRIR and ignore `--sofa-room` once BRIR loading is implemented; current tests cover that policy interface, not a BRIR loader.
|
||||
|
||||
A 3-D convex hull of measured unit directions defines local triangles. Ray/triangle barycentric weights are nonnegative and sum to one. There is no longitude/latitude planar interpolation or extrapolation beyond directional coverage. Measured nodes retain their complex response.
|
||||
|
||||
Low-frequency alignment fits delay over 200–1500 Hz. Default `lf_logmag_phase` interpolates log magnitude and reconstructs phase from aligned complex residuals and interpolated delay. Optional `lf_mca_zero` applies auditory-band magnitude correction. Neither replaces the selected full FIR with a minimum-phase response.
|
||||
|
||||
`Data.Delay` is included once. A common half-FFT shift stores interpolation pre-ringing; output compensates only convolution/filterbank implementation latency. The file's common recording delay, relative ear delays and frequency-dependent phase remain intact. The fitted recording origin is no longer subtracted, and target distance adds no flight time. DC and Nyquist use real endpoints for a real output sequence.
|
||||
|
||||
Each object retains its own convolution history. Updates crossfade old/new outputs over 128 samples using complete input history for both filters. Filter updates are delayed by the common artificial FIR shift so removing that shift does not advance metadata changes. Full HRIR uses PCM convolution; QMF/hybrid is confined to explicit compact input. Arithmetic is float64/complex128, without implicit limiting.
|
||||
It is not a measured BRIR and not an external standard room. With the switch off the
|
||||
renderer skips room processing and outputs only the field's direct binaural sound; the
|
||||
room parameters are fixed at construction, with no preset and no external file.
|
||||
|
||||
## Object input
|
||||
|
||||
Each reconstructed frame is `[1536,16]` PCM: LFE at slot 0 and fifteen reconstructed object/bed slots at 1–15. The ID11 timeline feeds these directly, without another decode or an intermediate loudspeaker render. The existing 1473-sample object compensation and 32-sample metadata alignment are retained. Parameters update every 128 samples.
|
||||
Each reconstructed frame is `[1536,16]` PCM: LFE at slot 0 and fifteen
|
||||
reconstructed object/bed slots at 1–15. The ID11 timeline feeds these directly,
|
||||
without another decode or an intermediate loudspeaker render. The existing
|
||||
1473-sample object compensation and 32-sample metadata alignment are retained.
|
||||
Parameters update every 128 samples.
|
||||
|
||||
LFE retains separate low-pass treatment and no room send. SOFA metadata preserves negative elevation, finite outside factors and anchoring flags; personalized parsing and timing are unchanged. Multi-position blocks, ISF, explicit infinity and anchors requiring unavailable screen calibration are rejected. `finish()` drains once. The tail option bounds FIR/filterbank and optional room draining.
|
||||
LFE keeps its separate low-pass treatment and no room send. Multi-position blocks,
|
||||
ISF, explicit infinity and anchors requiring unavailable screen calibration are
|
||||
rejected. `finish()` drains once. `--binaural-tail-seconds` bounds filterbank and
|
||||
room draining.
|
||||
|
||||
## Compact representation
|
||||
|
||||
`.jochrtf` v1 remains a pickle-free NumPy ZIP containing JSON metadata, 77 band centres, `complex128[36,2,77]` directional coefficients, `float64[36,2]` delay coefficients and `float64[2,2]` bounds. Its format, cache key, hashes, atomic writing and source-data licensing remain unchanged. Its angular/frequency approximation is not equivalent to full-HRIR precision.
|
||||
`.jochrtf` v1 is a pickle-free NumPy ZIP holding JSON metadata, 77 band centres,
|
||||
`complex128[36,2,77]` directional coefficients, `float64[36,2]` delay coefficients
|
||||
and `float64[2,2]` bounds. Loading checks the format version, shapes and scalar
|
||||
ranges, rehashes every member, and recomputes the cache key to confirm that the
|
||||
coefficients match their configuration; a mismatch rejects the file.
|
||||
|
||||
Filterbank provenance is documented in [data notes](../data/README.en.md). See the [MCA paper](https://doi.org/10.1109/TASLP.2023.3313908) for the correction model. Algorithms are independently implemented; external measurements retain their own licensing terms.
|
||||
This repository owns the format, the cache key and the hash validation; the
|
||||
fitting compiler lives in the separate checkout and shares the same format module
|
||||
instead of duplicating it. The compact representation keeps its angular and
|
||||
band-wise approximation error and is not equivalent to per-measurement precision.
|
||||
|
||||
Filterbank provenance is documented in [data notes](../data/README.en.md). See the
|
||||
[MCA paper](https://doi.org/10.1109/TASLP.2023.3313908) for the correction model.
|
||||
Algorithms are independently implemented; external measurements retain their own
|
||||
licensing terms.
|
||||
+39
-51
@@ -2,84 +2,72 @@
|
||||
|
||||
[English](binaural.en.md) · [返回 README](../README.md)
|
||||
|
||||
## 三条独立路线
|
||||
JOC 的双耳输出有两条输入路线:
|
||||
|
||||
| 输入 | 渲染 | 距离与环境 |
|
||||
|---|---|---|
|
||||
| SOFA | 完整复数HRIR方向插值、自适应长度FIR、128样本分区卷积 | 默认纯直达声;`--sofa-room`可选项目房间;不做径向人头合成 |
|
||||
| `.jochrtf` | 原77带/五阶方向场及延迟表示 | 同样默认纯直达声,可选相同房间 |
|
||||
| `.personalized_headphone` | 原DSP、滤波器组及模型参数 | 原Near/Mid/Far及房间处理保持不变 |
|
||||
| `.personalized_headphone`(默认) | Rosella DSP、滤波器组与模型参数 | 模型自身的 Near/Mid/Far 与房间处理,行为不变 |
|
||||
| `.jochrtf`(保留项) | 77 带方向场、64-QMF/hybrid 分析与合成 | 默认只输出直达声;`--jochrtf-room on` 开启项目房间 |
|
||||
|
||||
SOFA不会调用编译器、生成压缩缓存或自动回退。`.jochrtf`格式、校验器和离线编译能力保留。SOFA与压缩输入通过`DirectSofaBackend`接入对象时间线。
|
||||
`.jochrtf` 由独立的离线编译器从 SOFA 测量数据拟合得到;本仓库负责加载和渲染
|
||||
编译结果,编译器产出的缓存用 `--compiled-hrtf-cache` 加载。
|
||||
|
||||
```powershell
|
||||
python main.py input.m4a --binaural
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa --sofa-interpolation lf_mca_zero
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa --source-reference-distance-m 2.193
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa --sofa-room
|
||||
python main.py input.m4a --binaural --sofa-hrtf C:\HRTF\subject.sofa --sofa-room --sofa-room-preset legacy
|
||||
python src\compile_hrtf.py C:\HRTF\subject.sofa C:\HRTF\subject.jochrtf
|
||||
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf
|
||||
python main.py input.m4a --binaural --personalized-headphone --binaural-mode far --rosella-filterbank 2
|
||||
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf
|
||||
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf --jochrtf-room on
|
||||
python main.py input.m4a --binaural --compiled-hrtf-cache C:\HRTF\subject.jochrtf --jochrtf-room on
|
||||
```
|
||||
|
||||
默认SOFA为项目目录下的`HRTF/binaural.sofa`,不依赖当前工作目录;其他位置用`--sofa-hrtf PATH`指定。单球壳自动选择,多球壳须用`--hrtf-radius-m`选择一个测量球壳,当前不做径向插值。默认个性化路径仍为`HRTF/binaural.personalized_headphone`。
|
||||
|
||||
SOFA与压缩输入沿用Near/Mid/Far的点声源参考尺度,默认Mid。个性化的Near/Mid/Far和ADM输出的DBMD提示保持原行为。
|
||||
不指定输入时使用项目目录下的 `HRTF/binaural.personalized_headphone`;`.jochrtf` 只能
|
||||
显式选择,不自动生成,也不回退。双耳 DSP 全程 float64/complex128,参数每 128 样本更新。
|
||||
|
||||
## 点声源参考尺度
|
||||
|
||||
Near/Mid/Far的参考距离分别为1.00000465/2.19327927/6.40177584 m,可用`--source-reference-distance-m`覆盖所选档位。对于ADM右/前/上坐标`p=(x,y,z)`:
|
||||
`.jochrtf` 路线沿用 Near 约 1 m、Mid 约 2.193 m、Far 约 6.402 m 的点声源参考尺度,默认
|
||||
Mid。对于 ADM 右/前/上坐标 `p=(x,y,z)`:
|
||||
|
||||
```text
|
||||
q_SOFA = (y, -x, z) / ||p||
|
||||
q_SOFA = (y, -x, z) / ||p||
|
||||
d_nominal = reference_distance_m * ||p||
|
||||
H_render(ear, f) = H_selected_shell(ear, f, q_SOFA)
|
||||
```
|
||||
|
||||
参考距离给对象坐标规定标称米制尺度,不会把测量半径为1.2 m的HRIR合成为2.193 m真值,也不会更改SOFA测量元数据。默认直达声模式不额外应用1/r衰减、球头距离比值、人工中心响应、房间发送、direct/room能量耦合或目标距离传播延迟;节目增益和SOFA响应刻度保持不变。开启房间后采用原项目距离耦合,用户指定输出增益仍只应用一次。
|
||||
参考距离只给对象坐标规定标称米制尺度,不改变方向场的响应,也不额外增加 1/r 衰减或
|
||||
传播延迟。声源与听者重合时沿用该对象最后一个有效方向,没有历史时取正前方。
|
||||
|
||||
声源与听者重合时方向没有定义,沿用该对象最后一个有效方向;没有历史时取正前方。该规则不合成零ITD响应。有限盒外坐标保留元数据距离因子,不裁回单位盒。
|
||||
## `.jochrtf` 房间
|
||||
|
||||
SOFA输入不需要个性化模型或本机配置;关闭房间时也不读取房间资产。报告记录输入路径、SHA-256、测量半径、插值方法与房间开关。
|
||||
默认关闭。`--jochrtf-room on` 启用项目自有房间,算法与 Rosella 之前的公开路线一致,
|
||||
直接在代码里计算,不读取任何资产:
|
||||
|
||||
## 可选项目房间
|
||||
- 六个一阶镜像反射(`public_room.first_order_image_sources`,18×18×14 m 原房间几何);
|
||||
- 四路正交 Hadamard 反馈、两级全通扩散、低通阻尼的共享 FDN 晚期(RT60 0.85 s);
|
||||
- 早反射按测量半径/路径距离给增益,晚期发送按档位与归一化半径给增益。
|
||||
|
||||
`--sofa-room`默认关闭,复用原`.jochrtf`路线的`public_room.py`和`reference_distance.py`算法,提供原始与紧凑两套参数:六个一阶镜像反射,以及四路正交Hadamard反馈、两级全通扩散、低通阻尼的共享FDN。它是项目自有听感预设,目标是提供接近理想听音环境、以直达声为主的房间感,不是测量BRIR或强制标准房间。它不依赖Rosella房间表。
|
||||
|
||||
启用后Near/Mid默认使用`compact`紧凑房间,Far默认使用`legacy`原大房间,以保留Far单位坐标盒的空间范围。`--sofa-room-preset compact|legacy`可显式选择;`legacy`指原项目大房间。紧凑房间尺寸引用[Zahorik 2009表1模型9](https://pmc.ncbi.nlm.nih.gov/articles/PMC2730711/),保留原镜像/FDN算法,将晚期延迟、扩散时间与RT60参数按`V/S`比例缩短。参数及来源记录在资产元数据中。这仅借用文献几何,不是该论文BRIR算法的复现。
|
||||
|
||||
完整HRIR路线对六个到达方向分别查询HRIR,以完整频率网格上的相位斜坡实现分数采样延迟。反射路径相对直达路径的额外时间为`(L_path-L_direct)/c`,保留原HRIR的`Data.Delay`,不再量化到77带。直接声、反射与晚期发送采用原项目的增益公式。房间几何只覆盖其内部声源;开启房间时不静默裁剪盒外位置。
|
||||
|
||||
晚期FDN在48 kHz下用单位脉冲生成双声道float64 FIR:紧凑版为`data/sofa-room-compact.npz`,37,383点、RT60参数约0.3894秒;原版为`data/sofa-room.npz`,81,600点、RT60参数0.85秒。两者截断后的探测尾能量比均约`2.2e-13`。运行时通过PCM域FFT卷积实现各自同一线性时不变系统。早反射继续使用所选SOFA;晚期输出保持原项目的双声道FDN定义。
|
||||
|
||||
晚期分支补齐卷积实现移位和所选SOFA的共同录音延迟估计后,与直接声及早反射相加。房间关闭时不创建这些状态;开启时按1536样本计算批次处理,参数仍每128样本更新,排空时裁去额外批处理填充。`.jochrtf`的早反射保持其77带表示误差。
|
||||
|
||||
可用`python src\generate_sofa_room.py`重生成两套资产,或以`--preset compact|legacy`只生成一套。原算法来源、参数、系数哈希及尾部精度预算写入NPZ元数据。
|
||||
|
||||
## 完整HRIR数学与时间基准
|
||||
|
||||
导入器校验`SimpleFreeFieldHRIR` 0.4/1.0/1.1、FIR、两个可由位置识别左右的耳、零Emitter偏移、自由场、单位和有限数值。采样率统一为48 kHz;重采样时`Data.Delay`的采样点数同比例变化。耳位须在测量之间固定;方向插值不再要求用对称耳位拟合球头。
|
||||
|
||||
当前没有实现`SimpleFreeFieldHRIR`以外的BRIR或其他SOFA Convention。不支持的文件明确拒绝。后端已按响应类型预留BRIR提示及忽略`--sofa-room`的规则;当前验证的是该策略接口,不代表已实现BRIR读取。
|
||||
|
||||
测量单位方向的三维凸包构成局部三角网格,查询使用射线与面三角形的非负、和为1的重心权重。不使用经纬平面插值,不外推未覆盖半球。精确节点返回测量复数响应。
|
||||
|
||||
低频对齐延迟在200–1500 Hz拟合。默认`lf_logmag_phase`对对数幅度插值,原相位通过时间对齐的复数残差及插值延迟恢复;备选`lf_mca_zero`使用听觉带幅度校正。两种方法都保留所选FFT长度的完整FIR,不替换为最小相位。
|
||||
|
||||
`Data.Delay`在频域只叠加一次。公共移位为FFT长度的一半,用于保存插值前振铃;输出只补偿卷积/滤波器组的实现延迟。文件提供的共同录音延迟、左右耳相对延迟和频率相关相位关系均保留,不再减去拟合录音原点,也不根据目标距离增加飞行时间。真实序列的DC/Nyquist频点按实数端点处理。
|
||||
|
||||
每对象拥有独立卷积历史。更新时旧/新输出在128样本内线性交叉淡化,两个滤波器均使用完整输入历史。滤波器更新同样延后公共FIR实现移位,避免移除实现延迟后将元数据更新提前。完整HRIR路线直接在PCM域卷积;QMF/hybrid仅用于显式压缩输入。内部精度为float64/complex128,不做隐式限幅。
|
||||
它不是测量 BRIR,也不是外部标准房间。关闭时跳过房间处理,只输出方向场的双耳直达声;
|
||||
房间参数在构造时确定,没有预设、没有外部文件。
|
||||
|
||||
## 对象接入
|
||||
|
||||
输入为每帧`[1536,16]` PCM:0是LFE,1–15是已经重建的对象/bed槽。直接使用ID11时间线,不重新解码,也不先渲染到扬声器布局。保留1473样本对象时间补偿和32样本元数据对齐,参数每128样本更新。
|
||||
输入为每帧 `[1536,16]` PCM:0 是 LFE,1–15 是已经重建的对象/bed 槽。直接使用 ID11
|
||||
时间线,不重新解码,也不先渲染到扬声器布局。保留 1473 样本对象时间补偿和 32 样本元数据
|
||||
对齐,参数每 128 样本更新。
|
||||
|
||||
LFE继续使用独立低通处理,不发送至可选房间。SOFA专用解析保留负高度、边界外因子及锚定字段;个性化解析与时间线不变。当前多位置块、ISF、显式无穷远以及需要屏幕校准的锚定明确报错。`finish()`仅排空一次,`--binaural-tail-seconds`规定FIR/滤波器组及可选房间尾声的排空预算。
|
||||
LFE 继续使用独立低通处理,不发送至房间。多位置块、ISF、显式无穷远以及需要屏幕校准的
|
||||
锚定明确报错。`finish()` 仅排空一次,`--binaural-tail-seconds` 规定滤波器组与房间尾声的
|
||||
排空预算。
|
||||
|
||||
## 轻量格式
|
||||
|
||||
`.jochrtf` v1仍为无pickle的NumPy ZIP,保存JSON元数据、77个频带中心、`complex128[36,2,77]`方向系数、`float64[36,2]`延迟系数及`float64[2,2]`边界。原格式、cache key、哈希校验、原子写入及源数据许可关系不变。压缩输入保留自身的方向与频率表示误差,不等同于完整HRIR精度。
|
||||
`.jochrtf` v1 是无 pickle 的 NumPy ZIP,保存 JSON 元数据、77 个频带中心、
|
||||
`complex128[36,2,77]` 方向系数、`float64[36,2]` 延迟系数及 `float64[2,2]` 边界。加载时
|
||||
校验格式版本、形状、标量范围,按成员重算载荷哈希,并重新计算 cache key 以确认系数与
|
||||
配置一致;不匹配的文件直接拒绝。
|
||||
|
||||
滤波器组来源见[data说明](../data/README.md)。方向插值和MCA的参考文献见[研究实现依据](https://doi.org/10.1109/TASLP.2023.3313908);算法独立实现,外部测量数据仍适用其自身许可。
|
||||
格式、cache key 与哈希校验由本仓库维护;拟合编译器在独立目录里,两者共用同一个格式
|
||||
模块,不复制定义。压缩表示保留自身的角向与频带近似误差,不等同于逐点测量的精度。
|
||||
|
||||
滤波器组来源见[data说明](../data/README.md)。方向插值与 MCA 的参考文献见
|
||||
[研究实现依据](https://doi.org/10.1109/TASLP.2023.3313908);算法独立实现,外部测量数据
|
||||
仍适用其自身许可。
|
||||
Reference in new issue
Block a user