In the joint K+V Wikitext-2 sweep, V-heavy splits generally produced lower perplexity; KV-COBRA_KL supplied the best cell in seven of nine model-by-total-budget blocks, while V_bpd=2 caused severe LLaMA and Mistral degradation and KQ-SVD diverged on Qwen cells with K_bpd=1.
LLaMA-3.1-8B: joint K+V Wikitext-2 perplexity sweep
实验方案已经存在,但当前处理任务没有对应的执行目标。
Qwen2.5-7B-Instruct: joint K+V Wikitext-2 perplexity sweep
实验方案已经存在,但当前处理任务没有对应的执行目标。
Mistral-7B-v0.3: joint K+V Wikitext-2 perplexity sweep
实验方案已经存在,但当前处理任务没有对应的执行目标。