Loading page…
The effective-bpd accounting assigns method-specific per-token metadata overheads: +1.0 bpd to KIVI and GEAR, +0.16 to KVQuant, and zero to the rotation/SVD methods; fixed bases are excluded as amortized at T=32,768. · CiteArk