Source: paper:PDF p.17, §B.3 and Table 3
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/26 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
model: Qwen3-1.7B · dataset: AIME25 | 42 requests | — | Not assessed |
model: Qwen3-1.7B · dataset: AIME25 | 2.59 × AutoRegressive | — | Not assessed |
model: Qwen3-1.7B · dataset: AIME25 | 2.06 × AutoRegressive | — | Not assessed |
model: Qwen3-1.7B · dataset: AIME25 | 20.2% | — | Not assessed |
model: Qwen3-1.7B · dataset: LB-v2[30k-40k] | 18 requests | — | Not assessed |
model: Qwen3-1.7B · dataset: LB-v2[30k-40k] | 4.46 × AutoRegressive | — | Not assessed |
model: Qwen3-1.7B · dataset: LB-v2[30k-40k] | 4.17 × AutoRegressive | — | Not assessed |
model: Qwen3-1.7B · dataset: LB-v2[30k-40k] | 6.5% | — | Not assessed |
model: Qwen3-8B · dataset: AIME25 | 30 requests | — | Not assessed |
model: Qwen3-8B · dataset: AIME25 | 1.95 × AutoRegressive | — | Not assessed |
model: Qwen3-8B · dataset: AIME25 | 1.86 × AutoRegressive | — | Not assessed |
model: Qwen3-8B · dataset: AIME25 | 4.7% | — | Not assessed |