正在加载页面…
On MNIST with a three-layer ReLU MLP and AdamW, every EGD variant reaches 85% validation accuracy in fewer steps than Grokfast. RSVD variants also substantially reduce wall-clock time; rank 4 is fastest in time, ranks 8 and 4 tie for the fewest steps, and exact-SVD EGD has the highest printed final validation accuracy. · CiteArk