On Countdown, adding IM improves or preserves every ESPO, GDPO, and SPG accuracy cell. SPG+IM reports 81.6%, 81.6%, and 80.9% accuracy at lengths 128, 256, and 512, corresponding to relative gains of 18.60%, 15.42%, and 15.08% over SPG.

On Countdown, adding IM improves or preserves every ESPO, GDPO, and SPG accuracy cell. SPG+IM reports 81.6%, 81.6%, and 80.9% accuracy at lengths 128, 256, and 512, corresponding to relative gains of 18.60%, 15.42%, and 15.08% over SPG. · CiteArk

Measurement results

0/36 assessed

0 supported0 disputed or conflicting36 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
model: LLaDA-8B-Instruct · dataset: Countdown · generationLengthTokens: 128	20.7%	—	Not assessed
model: LLaDA-8B-Instruct · dataset: Countdown · generationLengthTokens: 256	19.5%	—	Not assessed
model: LLaDA-8B-Instruct · dataset: Countdown · generationLengthTokens: 512	16%	—	Not assessed
model: D1 · dataset: Countdown · generationLengthTokens: 128	30.9%	—	Not assessed
model: D1 · dataset: Countdown · generationLengthTokens: 256	30.9%	—	Not assessed
model: D1 · dataset: Countdown · generationLengthTokens: 512	34.4%	—	Not assessed
model: WD1 · dataset: Countdown · generationLengthTokens: 128	48.8%	—	Not assessed
model: WD1 · dataset: Countdown · generationLengthTokens: 256	51.2%	—	Not assessed
model: WD1 · dataset: Countdown · generationLengthTokens: 512	50.8%	—	Not assessed
model: ESPO · dataset: Countdown · generationLengthTokens: 128	74.2%	—	Not assessed
model: ESPO · dataset: Countdown · generationLengthTokens: 256	72.6%	—	Not assessed
model: ESPO · dataset: Countdown · generationLengthTokens: 512	75.3%	—	Not assessed

On Countdown, adding IM improves or preserves every ESPO, GDPO, and SPG accuracy cell. SPG+IM reports 81.6%, 81.6%, and 80.9% accuracy at lengths 128, 256, and 512, corresponding to relative gains of 18.60%, 15.42%, and 15.08% over SPG.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results