For variable-length batches, the paper reports that SSMs and Mamba can treat the batch as one long sequence and prevent information transfer between examples by setting A_t=0 at the boundary token, avoiding padding tokens. · CiteArk
For variable-length batches, the paper reports that SSMs and Mamba can treat the batch as one long sequence and prevent information transfer between examples by setting A_t=0 at the boundary token, avoiding padding tokens.
来源:paper_markdown:Section 8.3 and Introduction, PDF pages 28 and 3