Loading page…
In CIFAR-10 label-shuffling experiments, adding exact-SVD EGD increases the area under the training-accuracy curve for Adam, RAdam, and RMSprop at every reported shuffle schedule. Without EGD, RMSprop is strongest in each schedule; the largest printed multiplicative gain is Adam with shuffling at 3 epochs. · CiteArk