Source: paper:PDF pp. 25–26; Appendix I, Table A9 and scale paragraph
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/68 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
bpd: 16 · side: K-only · model: LLaMA-3.1-70B · method: FP16 | 5.38 perplexity | — | Not assessed |
bpd: 16 · side: K-only · model: LLaMA-3.1-70B · method: FP16 | 60.4% | — | Not assessed |
bpd: 16 · side: K-only · model: LLaMA-3.1-70B · method: FP16 | 14.3 F1 | — | Not assessed |
bpd: 1 · side: K-only · model: LLaMA-3.1-70B · method: KV-COBRA_KL | 6.97 perplexity | — | Not assessed |
bpd: 1 · side: K-only · model: LLaMA-3.1-70B · method: KV-COBRA_KL | 58.4% | — | Not assessed |
bpd: 1 · side: K-only · model: LLaMA-3.1-70B · method: KV-COBRA_KL | 13.5 F1 | — | Not assessed |
bpd: 1 · side: K-only · model: LLaMA-3.1-70B · method: KV-COBRA_MSE | 9.5 perplexity | — | Not assessed |
bpd: 1 · side: K-only · model: LLaMA-3.1-70B · method: KV-COBRA_MSE | 58.5% | — | Not assessed |
bpd: 1 · side: K-only · model: LLaMA-3.1-70B · method: KV-COBRA_MSE | 10.5 F1 | — | Not assessed |
bpd: 1 · side: K-only · model: LLaMA-3.1-70B · method: KQ-SVD | 9.79 perplexity | — | Not assessed |
bpd: 1 · side: K-only · model: LLaMA-3.1-70B · method: KQ-SVD | 57% | — | Not assessed |
bpd: 1 · side: K-only · model: LLaMA-3.1-70B · method: KQ-SVD | 11.2 F1 | — | Not assessed |