At 1 bpd in K-only mode, the paper reports per-dataset perplexity, per-task zero-shot accuracy, and per-task LongBench F1 for both KV-COBRA objectives on all three 7–8B models.

Reported and observed measurements

Assessments (0)

No immutable Assessment has been published for this Claim yet.

Runs (0)

No execution has been linked to this Claim yet.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
bpd: 1 · side: K-only · model: LLaMA-3.1-8B · objective: MSE · datasetOrTask: Wikitext-2	16.45 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: LLaMA-3.1-8B · objective: KL · datasetOrTask: Wikitext-2	13.27 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: Mistral-7B-v0.3 · objective: MSE · datasetOrTask: Wikitext-2	7.47 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: Mistral-7B-v0.3 · objective: KL · datasetOrTask: Wikitext-2	5.65 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: Qwen2.5-7B-Instruct · objective: MSE · datasetOrTask: Wikitext-2	8.14 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: Qwen2.5-7B-Instruct · objective: KL · datasetOrTask: Wikitext-2	8.17 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: LLaMA-3.1-8B · objective: MSE · datasetOrTask: PTB	25.01 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: LLaMA-3.1-8B · objective: KL · datasetOrTask: PTB	21.12 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: Mistral-7B-v0.3 · objective: MSE · datasetOrTask: PTB	59.38 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: Mistral-7B-v0.3 · objective: KL · datasetOrTask: PTB	32.86 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: Qwen2.5-7B-Instruct · objective: MSE · datasetOrTask: PTB	14.79 perplexity	—	Not assessed
bpd: 1 · side: K-only · model: Qwen2.5-7B-Instruct · objective: KL · datasetOrTask: PTB	15.07 perplexity	—	Not assessed

Metric and conditions

Reported

Latest observation

Evidence judgment

bpd: 1 · side: K-only · model: LLaMA-3.1-8B · objective: MSE · datasetOrTask: Wikitext-2

16.45 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: LLaMA-3.1-8B · objective: KL · datasetOrTask: Wikitext-2

13.27 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: Mistral-7B-v0.3 · objective: MSE · datasetOrTask: Wikitext-2

7.47 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: Mistral-7B-v0.3 · objective: KL · datasetOrTask: Wikitext-2

5.65 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: Qwen2.5-7B-Instruct · objective: MSE · datasetOrTask: Wikitext-2

8.14 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: Qwen2.5-7B-Instruct · objective: KL · datasetOrTask: Wikitext-2

8.17 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: LLaMA-3.1-8B · objective: MSE · datasetOrTask: PTB

25.01 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: LLaMA-3.1-8B · objective: KL · datasetOrTask: PTB

21.12 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: Mistral-7B-v0.3 · objective: MSE · datasetOrTask: PTB

59.38 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: Mistral-7B-v0.3 · objective: KL · datasetOrTask: PTB

32.86 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: Qwen2.5-7B-Instruct · objective: MSE · datasetOrTask: PTB

14.79 perplexity

—

Not assessed

bpd: 1 · side: K-only · model: Qwen2.5-7B-Instruct · objective: KL · datasetOrTask: PTB

15.07 perplexity

—

Not assessed

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results