The main experiments train matched GPT-2-style decoder-only transformers from scratch on FineWeb-Edu at four non-embedding parameter tiers, sharing architecture, data order, optimizer, schedule, and paired seeds within each tier; three seeds are reported for most arms through 124M and one seed per arm at 350M.

The main experiments train matched GPT-2-style decoder-only transformers from scratch on FineWeb-Edu at four non-embedding parameter tiers, sharing architecture, data order, optimizer, schedule, and paired seeds within each tier; three seeds are reported for most arms through 124M and one seed per arm at 350M. · CiteArk

Measurement results

0/36 assessed

0 supported0 disputed or conflicting36 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
tier: 10M	6 count	—	Not assessed
tier: 10M	6 count	—	Not assessed
tier: 10M	384 dimensions	—	Not assessed
tier: 10M	512 tokens	—	Not assessed
tier: 10M	64 sequences	—	Not assessed
tier: 10M	1 steps	—	Not assessed
tier: 10M	6,000 steps	—	Not assessed
tier: 10M	200 steps	—	Not assessed
tier: 10M	0.2 billions of tokens	—	Not assessed
tier: 50M	10 count	—	Not assessed
tier: 50M	10 count	—	Not assessed
tier: 50M	640 dimensions	—	Not assessed

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results