Loading page…
The fitted timing-model form transferred across tensor-parallel degrees, but its coefficients did not: one calibration pass was required per deployment configuration. Stale coefficients could reduce throughput substantially, although the paper states they do not affect correctness because full verification is unchanged. · CiteArk