Source: paper:PDF p.22, Table 10
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/81 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
model: Qwen3-1.7B · method: ASPIRE · dataset: LB-v2[80k-100k] | 7 requests | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: LB-v2[80k-100k] | 13.89 tokens/verification | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: LB-v2[80k-100k] | 97.3% | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: LB-v2[80k-100k] | 2,056 tokens/request | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: LB-v2[80k-100k] | 5.22 ms/forward step | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB-v2[80k-100k] | 7 requests | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB-v2[80k-100k] | 5.86 tokens/verification | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB-v2[80k-100k] | 97.2% | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB-v2[80k-100k] | 2,050 tokens/request | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB-v2[80k-100k] | 5.95 ms/forward step | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB-v2[80k-100k] | 27.46 ms/forward step | — | Not assessed |
model: Qwen3-1.7B · method: Vegas · dataset: LB-v2[80k-100k] | 7 requests | — | Not assessed |