Source: paper:PDF pp. 26-27, Figures 5-6 and Table 9
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/203 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
arm: raw transcript · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0.26 proportion | — | Not assessed |
arm: raw transcript · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0.49 proportion of labeled turns | — | Not assessed |
arm: raw transcript · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0.28 proportion of labeled turns | — | Not assessed |
arm: raw transcript · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0.06 proportion of labeled turns | — | Not assessed |
arm: raw transcript · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0.04 proportion of labeled turns | — | Not assessed |
arm: raw transcript · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0 proportion of labeled turns | — | Not assessed |
arm: raw transcript · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 4 executions per 128 episodes | — | Not assessed |
arm: text checklist · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0.39 proportion | — | Not assessed |
arm: text checklist · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0.15 proportion of labeled turns | — | Not assessed |
arm: text checklist · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0.35 proportion of labeled turns | — | Not assessed |
arm: text checklist · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0.02 proportion of labeled turns | — | Not assessed |
arm: text checklist · brief: original · model: Qwen3-235B · reasoning: no-think · configuration: S=5 | 0 proportion of labeled turns | — | Not assessed |