Source: paper:PDF p.20, Table 7
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/81 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
model: Qwen3-1.7B · method: ASPIRE · dataset: CodeElo | 42 requests | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: CodeElo | 4.82 tokens/verification | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: CodeElo | 76.5% | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: CodeElo | 14,060 tokens/request | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: CodeElo | 5.23 ms/forward step | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: CodeElo | 42 requests | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: CodeElo | 4.88 tokens/verification | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: CodeElo | 77.6% | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: CodeElo | 13,385 tokens/request | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: CodeElo | 5.21 ms/forward step | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: CodeElo | 19.8 ms/forward step | — | Not assessed |
model: Qwen3-1.7B · method: Vegas · dataset: CodeElo | 42 requests | — | Not assessed |