Source: paper:PDF p. 7, Table 2 and Sections 5.1-5.2
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/24 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
arm: raw transcript · model: Qwen3-235B · steps: 10 · reasoning: no-think · wilson95Ci: [0.3,0.47] | 0.38 proportion | — | Not assessed |
arm: text checklist · model: Qwen3-235B · steps: 10 · reasoning: no-think · wilson95Ci: [0.47,0.64] | 0.55 proportion | — | Not assessed |
arm: directive gate · model: Qwen3-235B · steps: 10 · reasoning: no-think · wilson95Ci: [0.76,0.89] | 0.84 proportion | — | Not assessed |
arm: enforcement gate · model: Qwen3-235B · steps: 10 · reasoning: no-think · wilson95Ci: [0.94,1] | 0.98 proportion | — | Not assessed |
arm: raw transcript · model: Qwen3-235B · steps: 15 · density: 0.3 · reasoning: no-think · wilson95Ci: [0.41,0.58] | 0.5 proportion | — | Not assessed |
arm: text checklist · model: Qwen3-235B · steps: 15 · density: 0.3 · reasoning: no-think · wilson95Ci: [0.51,0.68] | 0.59 proportion | — | Not assessed |
arm: directive gate · model: Qwen3-235B · steps: 15 · density: 0.3 · reasoning: no-think · wilson95Ci: [0.8,0.92] | 0.87 proportion | — | Not assessed |
arm: enforcement gate · model: Qwen3-235B · steps: 15 · density: 0.3 · reasoning: no-think · wilson95Ci: [0.94,1] | 0.98 proportion | — | Not assessed |
arm: raw transcript · model: Qwen3-235B · steps: 10 · reasoning: thinking · wilson95Ci: [0.72,0.86] | 0.8 proportion | — | Not assessed |
arm: text checklist · model: Qwen3-235B · steps: 10 · reasoning: thinking · wilson95Ci: [0.73,0.86] | 0.8 proportion | — | Not assessed |
arm: directive gate · model: Qwen3-235B · steps: 10 · reasoning: thinking · wilson95Ci: [0.81,0.92] | 0.88 proportion | — | Not assessed |
arm: enforcement gate · model: Qwen3-235B · steps: 10 · reasoning: thinking · wilson95Ci: [0.9,0.98] | 0.95 proportion | — | Not assessed |