Implement OAMD metadata rendering and runtime table generation
- Add oamd_params/oamd_math for OAMD metadata state, ISF matrix assembly, runtime size-table generation and bed routing. - Apply per-block gain/inactive, zone/elevation, size, snap, divergence, position refinement, priority budget, ISF and bed distribution in the speaker renderer. - Compute gain, size, priority, position, refinement and delta values from formulas; generate the size spread kernel from speaker-layout geometry. - Derive bed labels, routing, reference positions and automatic attenuation from speaker layouts. - Correct the surround positions of 5.1, 5.1.2 and 5.1.4 and add the 6.0 speaker layout. - Update README, data README and math notes for the metadata path and runtime table generation.
This commit is contained in:
1 parent
17e52a531c
commit
8dc6e13b16
13 files changed
+2036
-229
No files matched your search
+44
-1
@@ -392,7 +392,7 @@ q_N(k)=
|
||||
\right).
|
||||
$$
|
||||
|
||||
OAR coordinates are
|
||||
The normalized room coordinates are
|
||||
|
||||
$$
|
||||
u=\frac{q_1}{32768},
|
||||
@@ -835,3 +835,46 @@ $$
|
||||
- A limiter is separate post-processing and is not included in the mixing equations above.
|
||||
- Trim and front-back balance apply to speaker rendering only;
|
||||
binaural rendering reads neither of them.
|
||||
|
||||
## 16. OAMD metadata application (speaker path)
|
||||
|
||||
When mapping object PCM to the target layout, speaker rendering applies the OAMD
|
||||
object attributes in addition to the geometric panning:
|
||||
|
||||
- per-block integer gain `Qg` (unity 4096) and `inactive`; the gain is applied to
|
||||
the target coefficients once, and the LFE uses its owning metadata object's
|
||||
gain/active state;
|
||||
- full basic/render status 0/1/2/3 block expansion, same-object previous-block
|
||||
inheritance, and local mask updates;
|
||||
- `zone_constraints_idx` region selection mapped through `[0,1,2,3,4,5,6,0]`;
|
||||
`enable_elevation=0` forces z=0 before position compensation and size spread;
|
||||
- `object_size_idx` 5-bit sizes, the `size_curve` piecewise mapping, and the size
|
||||
kernel; the kernel is generated at runtime from region geometry with
|
||||
equal-power grouped panning, the S448 weight and a power sum (20/20/8
|
||||
virtual points, 20 size nodes, 35/4 position nodes; boundary rows
|
||||
X(0), X(1), Y(0), Y(1), Z(1));
|
||||
- `snap` first-argmax speaker snapping, `divergence` left/right point-source
|
||||
combination, and element 5 high-precision position refinement;
|
||||
- `default_priority`/`priority_bits` choose which size objects keep their size
|
||||
when the size budget is limited;
|
||||
- `isf_idx` basis matrices (signed coefficients, no per-column normalization)
|
||||
with the per-basis compensation;
|
||||
- `b_bed_chan_distribute` label candidates, weight normalization, missing-channel
|
||||
fallback, and the direct/distribute compensation.
|
||||
|
||||
The ISF path orders the N ISF object audio essences into the column vector t
|
||||
according to the M.U.L.Z order of `isf_config`, selects the input configuration
|
||||
by `isf_idx` and the matrix M for the target output layout, and evaluates
|
||||
y = M·t: each ISF channel is distributed over the speakers by the corresponding
|
||||
matrix row, LFE bypasses the matrix, and each basis carries its own
|
||||
compensation. The matrix coefficients and layout descriptors are in
|
||||
`data/oamd/metadata_params.json`.
|
||||
|
||||
Gain, size, priority, position, divergence, delta and refinement values are
|
||||
computed in code from formulas or fixed constants; the size kernel is generated
|
||||
at runtime from region geometry with grouped equal-power panning, the S448
|
||||
weight and a power sum, without storing lookup tables. Bed labels, routing and
|
||||
reference positions are derived from `speaker_layouts` in `src/bed_layout.py`.
|
||||
ADM export and the SOFA binaural path still use object positions only and do not
|
||||
apply these speaker target coefficients.
|
||||
|
||||
+34
-1
@@ -384,7 +384,7 @@ q_N(k)=
|
||||
\right).
|
||||
$$
|
||||
|
||||
OAR 坐标为
|
||||
归一化房间坐标为
|
||||
|
||||
$$
|
||||
u=\frac{q_1}{32768},
|
||||
@@ -803,3 +803,36 @@ $$
|
||||
- 多个 OAMD position block 必须按其时间顺序调度。
|
||||
- limiter 属于独立后处理,不包含在上述混音公式中。
|
||||
- trim 与前后平衡只作用于扬声器渲染;双耳渲染不读取它们。
|
||||
|
||||
## 16. OAMD 元数据应用(扬声器路径)
|
||||
|
||||
扬声器渲染把对象 PCM 映射到目标布局时,除几何声像外还应用 OAMD 的对象属性:
|
||||
|
||||
- 每块整数增益 `Qg`(单位增益 4096)与 `inactive`;增益在生成目标系数时乘一次,
|
||||
LFE 使用所属元数据对象的增益/活动状态;
|
||||
- basic/render 状态 0/1/2/3 的完整块展开、同对象前一块继承与局部 mask 更新;
|
||||
- `zone_constraints_idx` 选择区域,映射为 `[0,1,2,3,4,5,6,0]`;`enable_elevation=0`
|
||||
在位置补偿和尺寸扩散前令 z=0;
|
||||
- `object_size_idx` 的 5 bit 尺寸、`size_curve` 分段线性映射与尺寸扩散核;
|
||||
尺寸核按分组等功率声像、S448 权重和幂和,在运行时用区域几何生成:
|
||||
20/20/8 个虚拟点、20 个尺寸节点、35/4 个位置节点,边界表为
|
||||
X(0)、X(1)、Y(0)、Y(1)、Z(1);
|
||||
- `snap` 的首个最大系数扬声器吸附、`divergence` 的左右两点合成、
|
||||
element 5 的高精度位置补充;
|
||||
- `default_priority`/`priority_bits` 在 size 数量预算不足时决定保留尺寸的对象;
|
||||
- `isf_idx` 的 ISF 基矩阵(可含负系数,不做逐列归一化)与逐 basis 补偿;
|
||||
- `b_bed_chan_distribute` 的 bed 标签候选筛选、权重归一化、缺失声道 fallback 和
|
||||
直达/distribute 的补偿。
|
||||
|
||||
ISF 路径把 N 路 ISF object audio essences 按 `isf_config` 的 M.U.L.Z 顺序组成
|
||||
列向量 t,按 `isf_idx` 选输入配置、按目标输出布局选矩阵 M,再计算 y = M·t:
|
||||
每个 ISF 声道按矩阵对应的一行分配到目标扬声器,LFE 不参与矩阵、直接旁路,
|
||||
每个 basis 另有补偿。矩阵系数与布局描述见 `data/oamd/metadata_params.json`。
|
||||
|
||||
gain、size、priority、位置、divergence 与差分/细化表由 `src/oamd_bits.py` 按
|
||||
公式或固定常量计算,size 扩散核由 `src/oamd_math.py` 从区域几何生成(分组
|
||||
等功率声像 + S448 权重 + 幂和;与查表结果在 float32 精度内一致)。bed 标签、
|
||||
路由和参考位置由 `src/bed_layout.py` 从 `speaker_layouts` 推导,不再单独保存
|
||||
bed 表。
|
||||
ADM 导出与 SOFA 双耳路径仍只使用对象位置,不应用这些扬声器目标系数。
|
||||
|
||||
Reference in new issue
Block a user