Loading page…
Source: paper:Appendix F, Figure 17, pp.15–16
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/10 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
evaluation: flipped-answer · checkpointPretrainingTokensTrillions: 4.5 | 0.19 probability difference | — | Not assessed |
evaluation: flipped-answer · checkpointPretrainingTokensTrillions: 4.9 | 0.1 probability difference | — | Not assessed |
evaluation: repetitive-answer · checkpointPretrainingTokensTrillions: 4.5 | 0.29 probability difference | — | Not assessed |
evaluation: repetitive-answer · checkpointPretrainingTokensTrillions: 4.9 | 0.26 probability difference | — | Not assessed |
evaluation: successive-answer · checkpointPretrainingTokensTrillions: 4.5 | 0.72 probability difference | — | Not assessed |
evaluation: successive-answer · checkpointPretrainingTokensTrillions: 4.9 | -0.29 probability difference | — | Not assessed |
evaluation: truthy-answer · checkpointPretrainingTokensTrillions: 4.5 | 0.3 probability difference | — | Not assessed |
evaluation: truthy-answer · checkpointPretrainingTokensTrillions: 4.9 | 0.14 probability difference | — | Not assessed |
evaluation: intuitive-answer · checkpointPretrainingTokensTrillions: 4.5 | 0.39 probability difference | — | Not assessed |
evaluation: intuitive-answer · checkpointPretrainingTokensTrillions: 4.9 | 0.15 probability difference | — | Not assessed |