On paired tau2-bench airline runs, a compiled tool-dispatch gate raised Qwen3-235B pass^1 from 0.39 to 0.54 and eliminated executed rule violations, but changed little for Qwen3.6-35B because that model rarely attempted state-decidable violations; state shown and overridable notices lay between on pass^1 but leaked violations. · CiteArk

On paired tau2-bench airline runs, a compiled tool-dispatch gate raised Qwen3-235B pass^1 from 0.39 to 0.54 and eliminated executed rule violations, but changed little for Qwen3.6-35B because that model rarely attempted state-decidable violations; state shown and overridable notices lay between on pass^1 but leaked violations. · CiteArk

Measurement results

0/87 assessed

0 supported0 disputed or conflicting87 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
arm: ungated · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	0.39 proportion	—	Not assessed
arm: ungated · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	0.54 proportion	—	Not assessed
arm: ungated · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	9 episodes	—	Not assessed
arm: ungated · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	35 episodes	—	Not assessed
arm: ungated · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	10 episodes	—	Not assessed
arm: ungated · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	26 writes	—	Not assessed
arm: ledger (state shown) · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	0.52 proportion	—	Not assessed
arm: ledger (state shown) · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	0.38 proportion	—	Not assessed
arm: ledger (state shown) · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	14 episodes	—	Not assessed
arm: ledger (state shown) · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	14 episodes	—	Not assessed
arm: ledger (state shown) · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	10 episodes	—	Not assessed
arm: ledger (state shown) · model: Qwen3-235B · domain: tau2-bench airline · episodes: 100	4 writes	—	Not assessed