For the displayed incorrect response, local A_t^(0) penalizes tokens only weakly related to the actual reasoning error, whereas A_t^(0.99) concentrates stronger negative credit on the erroneous formula derivation without excessively penalizing the final end-of-sequence token. · CiteArk
For the displayed incorrect response, local A_t^(0) penalizes tokens only weakly related to the actual reasoning error, whereas A_t^(0.99) concentrates stronger negative credit on the erroneous formula derivation without excessively penalizing the final end-of-sequence token.
来源:paper:PDF pp. 8–9, Section 4.4 and Figure 5(b); PDF pp. 17 and 20, Appendix F.2 and Figure 7