Source: paper:PDF pp. 41-42, Appendix I and Table 21
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/104 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
rung: raw transcript · runs: 1 · model: Qwen3-235B | 0.67 F1 | — | Not assessed |
sd: 0.03 · rung: raw transcript · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 0.67 F1 | — | Not assessed |
sd: 2 · rung: raw transcript · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 56% | — | Not assessed |
sd: 2 · rung: raw transcript · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 42% | — | Not assessed |
sd: 3 · rung: raw transcript · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 8 events per run | — | Not assessed |
sd: 2 · rung: raw transcript · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 4 events per run | — | Not assessed |
sd: 2 · rung: raw transcript · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 28 queries per run | — | Not assessed |
rung: self-written ledger · runs: 1 · model: Qwen3-235B | 0.73 F1 | — | Not assessed |
sd: 0.04 · rung: self-written ledger · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 0.71 F1 | — | Not assessed |
sd: 5 · rung: self-written ledger · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 60% | — | Not assessed |
sd: 4 · rung: self-written ledger · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 37% | — | Not assessed |
sd: 1 · rung: self-written ledger · runs: 4 · week: v9 · model: Qwen3-235B · temperature: 0.7 | 4 events per run | — | Not assessed |