Generalization correlations across datasets are usually modest, so the same checkpoint need not generalize consistently across tasks. Larger OLMo3 has higher mean correlations in every reported evaluation; larger Apertus increases flipped/truthy correlations but decreases repetitive/successive correlations. The source describes the overall trend as greater universality in larger models.

Generalization correlations across datasets are usually modest, so the same checkpoint need not generalize consistently across tasks. Larger OLMo3 has higher mean correlations in every reported evaluation; larger Apertus increases flipped/truthy correlations but decreases repetitive/successive correlations. The source describes the overall trend as greater universality in larger models. · CiteArk

Measurement results

0/16 assessed

0 supported0 disputed or conflicting16 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
model: olmo3-7b · evaluation: flipped-answer	0.25 dimensionless	—	Not assessed
model: olmo3-7b · evaluation: repetitive-answer	0.15 dimensionless	—	Not assessed
model: olmo3-7b · evaluation: successive-answer	0.21 dimensionless	—	Not assessed
model: olmo3-7b · evaluation: truthy-answer	0.25 dimensionless	—	Not assessed
model: olmo3-32b · evaluation: flipped-answer	0.37 dimensionless	—	Not assessed
model: olmo3-32b · evaluation: repetitive-answer	0.58 dimensionless	—	Not assessed
model: olmo3-32b · evaluation: successive-answer	0.29 dimensionless	—	Not assessed
model: olmo3-32b · evaluation: truthy-answer	0.5 dimensionless	—	Not assessed
model: apertus-8b · evaluation: flipped-answer	0.26 dimensionless	—	Not assessed
model: apertus-8b · evaluation: repetitive-answer	0.47 dimensionless	—	Not assessed
model: apertus-8b · evaluation: successive-answer	0.25 dimensionless	—	Not assessed
model: apertus-8b · evaluation: truthy-answer	0.15 dimensionless	—	Not assessed

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results