When SPG perturbations are drawn over the full completion rather than its active decoding block, adding IM improves accuracy on both GSM8K and MATH-500 at all three reported generation lengths.

When SPG perturbations are drawn over the full completion rather than its active decoding block, adding IM improves accuracy on both GSM8K and MATH-500 at all three reported generation lengths. · CiteArk

Measurement results

0/12 assessed

0 supported0 disputed or conflicting12 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
model: SPG (full) · dataset: MATH-500 · generationLengthTokens: 128	34%	—	Not assessed
model: SPG (full) · dataset: MATH-500 · generationLengthTokens: 256	38%	—	Not assessed
model: SPG (full) · dataset: MATH-500 · generationLengthTokens: 512	41.4%	—	Not assessed
model: SPG (full)+IM · dataset: MATH-500 · generationLengthTokens: 128	34.2%	—	Not assessed
model: SPG (full)+IM · dataset: MATH-500 · generationLengthTokens: 256	41%	—	Not assessed
model: SPG (full)+IM · dataset: MATH-500 · generationLengthTokens: 512	42%	—	Not assessed
model: SPG (full) · dataset: GSM8K · generationLengthTokens: 128	75.1%	—	Not assessed
model: SPG (full) · dataset: GSM8K · generationLengthTokens: 256	81.9%	—	Not assessed
model: SPG (full) · dataset: GSM8K · generationLengthTokens: 512	83.6%	—	Not assessed
model: SPG (full)+IM · dataset: GSM8K · generationLengthTokens: 128	77.4%	—	Not assessed
model: SPG (full)+IM · dataset: GSM8K · generationLengthTokens: 256	82%	—	Not assessed
model: SPG (full)+IM · dataset: GSM8K · generationLengthTokens: 512	83.9%	—	Not assessed

When SPG perturbations are drawn over the full completion rather than its active decoding block, adding IM improves accuracy on both GSM8K and MATH-500 at all three reported generation lengths.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results