Source: paper:PDF p. 24, Table A4
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/96 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
bpd: 0.5 · side: K-only · model: LLaMA-3.1-8B · objective: MSE · datasetOrTask: Wikitext-2 | 16.29 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: LLaMA-3.1-8B · objective: KL · datasetOrTask: Wikitext-2 | 17.6 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: Mistral-7B-v0.3 · objective: MSE · datasetOrTask: Wikitext-2 | 9.05 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: Mistral-7B-v0.3 · objective: KL · datasetOrTask: Wikitext-2 | 8.08 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: Qwen2.5-7B-Instruct · objective: MSE · datasetOrTask: Wikitext-2 | 10.06 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: Qwen2.5-7B-Instruct · objective: KL · datasetOrTask: Wikitext-2 | 10.37 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: LLaMA-3.1-8B · objective: MSE · datasetOrTask: PTB | 30.75 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: LLaMA-3.1-8B · objective: KL · datasetOrTask: PTB | 34.74 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: Mistral-7B-v0.3 · objective: MSE · datasetOrTask: PTB | 81.88 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: Mistral-7B-v0.3 · objective: KL · datasetOrTask: PTB | 86.2 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: Qwen2.5-7B-Instruct · objective: MSE · datasetOrTask: PTB | 19.5 perplexity | — | Not assessed |
bpd: 0.5 · side: K-only · model: Qwen2.5-7B-Instruct · objective: KL · datasetOrTask: PTB | 20.37 perplexity | — | Not assessed |