Generalization fluctuations remain when the same task results are plotted against pretraining FLOPs instead of token counts, including the full persona evaluations for both model families. · CiteArk
Generalization fluctuations remain when the same task results are plotted against pretraining FLOPs instead of token counts, including the full persona evaluations for both model families.