Source: paper-fixed:PDF p. 8, Table 1
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/36 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
model: LLaDA-8B-Instruct · dataset: Sudoku · generationLengthTokens: 128 | 11.7% | — | Not assessed |
model: LLaDA-8B-Instruct · dataset: Sudoku · generationLengthTokens: 256 | 6.7% | — | Not assessed |
model: LLaDA-8B-Instruct · dataset: Sudoku · generationLengthTokens: 512 | 5.5% | — | Not assessed |
model: D1 · dataset: Sudoku · generationLengthTokens: 128 | 7.2% | — | Not assessed |
model: D1 · dataset: Sudoku · generationLengthTokens: 256 | 32.5% | — | Not assessed |
model: D1 · dataset: Sudoku · generationLengthTokens: 512 | 29.3% | — | Not assessed |
model: WD1 · dataset: Sudoku · generationLengthTokens: 128 | 33.1% | — | Not assessed |
model: WD1 · dataset: Sudoku · generationLengthTokens: 256 | 33.1% | — | Not assessed |
model: WD1 · dataset: Sudoku · generationLengthTokens: 512 | 24.5% | — | Not assessed |
model: ESPO · dataset: Sudoku · generationLengthTokens: 128 | 91.2% | — | Not assessed |
model: ESPO · dataset: Sudoku · generationLengthTokens: 256 | 84.8% | — | Not assessed |
model: ESPO · dataset: Sudoku · generationLengthTokens: 512 | 80.1% | — | Not assessed |