For the displayed correct response, local A_t^(0) gives sparse supervision and noticeable negative credit to only a few tokens, whereas normalized A_t^(0.99) propagates later information, smooths the signal, assigns stronger positive credit to the key mathematical derivation, and mildly penalizes redundant text. · CiteArk
For the displayed correct response, local A_t^(0) gives sparse supervision and noticeable negative credit to only a few tokens, whereas normalized A_t^(0.99) propagates later information, smooths the signal, assigns stronger positive credit to the key mathematical derivation, and mildly penalizes redundant text.
来源:paper:PDF pp. 8–9, Section 4.4 and Figure 5(a); PDF pp. 17–20, Appendix F.2 and Figure 6