Source: paper:PDF pp. 26 and 29, Appendix D.3 and Table 11
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/56 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
model: Qwen3-235B · steps: 15 · issued: 175 · obeyed: 158 · density: 0.3 · directive: CANCELLED · reasoning: no-think · wilson95Ci: [0.85,0.938] | 0.903 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · issued: 276 · obeyed: 275 · density: 0.3 · directive: already DONE · reasoning: no-think · wilson95Ci: [0.98,0.999] | 0.996 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · issued: 259 · obeyed: 240 · density: 0.3 · directive: BLOCKED · reasoning: no-think · wilson95Ci: [0.888,0.953] | 0.927 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · issued: 710 · obeyed: 673 · density: 0.3 · directive: all traps · reasoning: no-think · wilson95Ci: [0.929,0.962] | 0.948 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · density: 0.3 · numerator: 106 · reasoning: no-think · denominator: 128 | 0.828 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · density: 0.3 · numerator: 2688 · reasoning: no-think · denominator: 2688 | 1 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · density: 0.3 · reasoning: no-think | 1 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · density: 0.3 · reasoning: no-think | 1 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · issued: 175 · obeyed: 171 · density: 0.3 · directive: CANCELLED · reasoning: thinking · wilson95Ci: [0.943,0.991] | 0.977 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · issued: 261 · obeyed: 253 · density: 0.3 · directive: already DONE · reasoning: thinking · wilson95Ci: [0.941,0.984] | 0.969 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · issued: 272 · obeyed: 263 · density: 0.3 · directive: BLOCKED · reasoning: thinking · wilson95Ci: [0.938,0.982] | 0.967 proportion | — | Not assessed |
model: Qwen3-235B · steps: 15 · issued: 708 · obeyed: 687 · density: 0.3 · directive: all traps · reasoning: thinking · wilson95Ci: [0.955,0.981] | 0.97 proportion | — | Not assessed |