Source: paper:p. 8, §4.3, Table 3; p. 18, B.2
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/12 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
contextSubset: 64K · trainingStage: Untrained | 56.58% | — | Not assessed |
contextSubset: 128K · trainingStage: Untrained | 55.43% | — | Not assessed |
contextSubset: 256K · trainingStage: Untrained | 49.23% | — | Not assessed |
contextSubset: Overall · trainingStage: Untrained | 54.08% | — | Not assessed |
contextSubset: 64K · trainingStage: SFT only | 68.42% | — | Not assessed |
contextSubset: 128K · trainingStage: SFT only | 64.13% | — | Not assessed |
contextSubset: 256K · trainingStage: SFT only | 64.62% | — | Not assessed |
contextSubset: Overall · trainingStage: SFT only | 65.67% | — | Not assessed |
contextSubset: 64K · trainingStage: SFT+RL | 76.32% | — | Not assessed |
contextSubset: 128K · trainingStage: SFT+RL | 76.09% | — | Not assessed |
contextSubset: 256K · trainingStage: SFT+RL | 73.85% | — | Not assessed |
contextSubset: Overall · trainingStage: SFT+RL | 75.54% | — | Not assessed |