Loading page…
At the tested reduced FIXED-K budgets, prefill and decode throughput improve on both vLLM and HF Transformers, with all per-model ratios reported in Table 2. · CiteArk