At the same final checkpoints used for the matched-compute comparison, 67B SST scores higher than both classic baselines on all seven reported downstream tasks and has the lowest held-out ARXIV token NLL: 1.4421 versus 1.4424 for 63B classic and 1.4521 for 47B classic.

At the same final checkpoints used for the matched-compute comparison, 67B SST scores higher than both classic baselines on all seven reported downstream tasks and has the lowest held-out ARXIV token NLL: 1.4421 versus 1.4424 for 63B classic and 1.4521 for 47B classic. · CiteArk

Measurement results

0/24 assessed

0 supported0 disputed or conflicting24 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
model: 47B classic · split: validation + test	68.5%	—	Not assessed
model: 63B classic · split: validation + test	71%	—	Not assessed
model: 67B SST · split: validation + test	75%	—	Not assessed
model: 47B classic · split: test	58.44%	—	Not assessed
model: 63B classic · split: test	59.39%	—	Not assessed
model: 67B SST · split: test	60.54%	—	Not assessed
model: 47B classic	56.56%	—	Not assessed
model: 63B classic	55.04%	—	Not assessed
model: 67B SST	58.38%	—	Not assessed
model: 47B classic · split: full test	33.06%	—	Not assessed
model: 63B classic · split: full test	33.14%	—	Not assessed
model: 67B SST · split: full test	34.36%	—	Not assessed

At the same final checkpoints used for the matched-compute comparison, 67B SST scores higher than both classic baselines on all seven reported downstream tasks and has the lowest held-out ARXIV token NLL: 1.4421 versus 1.4424 for 63B classic and 1.4521 for 47B classic.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results