On Qwen3-8B, ASPIRE reported 1.86×, 1.70×, 1.81×, 2.30×, and 2.75× AutoRegressive throughput across the five workloads and the best overall mean at 2.08×.

Reported and observed measurements

Assessments (0)

No immutable Assessment has been published for this Claim yet.

Runs (0)

No execution has been linked to this Claim yet.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
model: Qwen3-8B · method: AutoRegressive · dataset: AIME25	1,377.5 output token/s	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: AIME25	1 × AutoRegressive	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: CodeElo	1,336.7 output token/s	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: CodeElo	1 × AutoRegressive	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: LB[16k-18k]	813.1 output token/s	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: LB[16k-18k]	1 × AutoRegressive	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: LB-v2[30k-40k]	357 output token/s	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: LB-v2[30k-40k]	1 × AutoRegressive	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: LB-v2[80k-100k]	135.7 output token/s	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: LB-v2[80k-100k]	1 × AutoRegressive	—	Not assessed
model: Qwen3-8B · method: AutoRegressive · dataset: all five workloads	1 × AutoRegressive	—	Not assessed
model: Qwen3-8B · method: MagicDec · dataset: AIME25	1,830.7 output token/s	—	Not assessed

Metric and conditions

Reported

Latest observation

Evidence judgment

model: Qwen3-8B · method: AutoRegressive · dataset: AIME25

1,377.5 output token/s

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: AIME25

1 × AutoRegressive

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: CodeElo

1,336.7 output token/s

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: CodeElo

1 × AutoRegressive

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: LB[16k-18k]

813.1 output token/s

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: LB[16k-18k]

1 × AutoRegressive

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: LB-v2[30k-40k]

357 output token/s

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: LB-v2[30k-40k]

1 × AutoRegressive

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: LB-v2[80k-100k]

135.7 output token/s

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: LB-v2[80k-100k]

1 × AutoRegressive

—

Not assessed

model: Qwen3-8B · method: AutoRegressive · dataset: all five workloads

1 × AutoRegressive

—

Not assessed

model: Qwen3-8B · method: MagicDec · dataset: AIME25

1,830.7 output token/s

—

Not assessed

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results