Source: paper:PDF p.21, Table 8
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/81 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
model: Qwen3-1.7B · method: ASPIRE · dataset: LB[16k-18k] | 35 requests | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: LB[16k-18k] | 14.78 tokens/verification | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: LB[16k-18k] | 97.2% | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: LB[16k-18k] | 202 tokens/request | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE · dataset: LB[16k-18k] | 5.93 ms/forward step | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB[16k-18k] | 35 requests | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB[16k-18k] | 5.78 tokens/verification | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB[16k-18k] | 93.4% | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB[16k-18k] | 71 tokens/request | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB[16k-18k] | 6.16 ms/forward step | — | Not assessed |
model: Qwen3-1.7B · method: ASPIRE-Fixed · dataset: LB[16k-18k] | 29.21 ms/forward step | — | Not assessed |
model: Qwen3-1.7B · method: Vegas · dataset: LB[16k-18k] | 35 requests | — | Not assessed |