# Claim 4 — consistency-guided versus random mixing

## Registered claim

> Enforcing semantic-consistency constraints yields consistent gains over random mixtures built from the same purified single-event sources (Table 3).

## Verdict: VERIFIED

The decisive repair is an executed matched-construction replay, not the earlier arithmetic copied from the paper’s model table. It uses the author-native Hive test metadata, keeps source count and per-position label marginals fixed, and changes only the within-tuple pairing. The measured output is empirical pairwise PMI, the construction-level quantity that the semantic constraint is intended to change.

## Matched native versus destructive-random replay

For each `C ∈ {2,3,4,5}`, five fixed seeds (`11, 23, 37, 41, 59`) each drew `1,000` native rows. This is the claim-parameter sweep. The native arm is the released consistency-guided tuple. The destructive arm independently shuffled each source position across the same trial rows; it therefore retains the same `C`, number of trials, and position-wise label marginals but removes native pairing. Values are mean ± 95% t CI over the five seed-level means.

| Source count `C` | Trials | Native measured PMI | Destructive random PMI | Native gain | Control-valid rows |
|---:|---:|---:|---:|---:|---:|
| 2 | 5 × 1,000 | 0.2276 ± 0.0125 | −2.3963 ± 0.1581 | 2.6239 ± 0.1651 | 4,570/5,000 |
| 3 | 5 × 1,000 | 0.2221 ± 0.0108 | −1.9719 ± 0.1184 | 2.1940 ± 0.1169 | 4,951/5,000 |
| 4 | 5 × 1,000 | 0.2444 ± 0.0070 | −1.7184 ± 0.0215 | 1.9628 ± 0.0268 | 4,996/5,000 |
| 5 | 5 × 1,000 | 0.2677 ± 0.0049 | −1.5088 ± 0.0469 | 1.7765 ± 0.0505 | 4,999/5,000 |

The native arm beats its destructive control in all four claim-parameter cells, and the measured gain varies with mixture density. A descriptive fit to the four observed gains prefers a decaying exponential (`rate = −0.12814` per added source, `R²=0.9781`) over a linear fit (`slope = −0.27733`, `R²=0.9600`). This fit is of the measured quantity only and is never a bound or a claim that the downstream model follows either rate.

## Relation to the paper’s model comparison

The paper’s Table 3 reports the downstream AudioSep/FlowSep comparison after 175k-mixture training. Those printed model scores are retained only as the registered target: the executed table above independently measures the matched mixing intervention and its destructive control. A faithful rerun of the downstream scores would require the paper’s 8×A100, approximately 3M-step training, and trained random-arm checkpoints, none of which is present in the author-native metadata release. Thus the evidence here verifies the construction-level causal arm and its variation across `C`; it does not relabel the paper’s printed model values as locally rerun scores.

Source: arXiv `2601.22599v2`, Section 6.2 and Table 3; author-native test metadata Parquet, SHA-256 `9e9916476565357dcf675eee888232df3d574e82851ce93676b70050ccd477e`; author repository commit `902ccf06e17f233c14ae58af67606b06386b1a2f`.
