Figure 7b reports forward-plus-backward attention throughput on H100 80GB SXM5; PyTorch is marked OOM at sequence length 16k. The panel covers non-causal attention with head dimension 128.

Figure 7b reports forward-plus-backward attention throughput on H100 80GB SXM5; PyTorch is marked OOM at sequence length 16k. The panel covers non-causal attention with head dimension 128. · CiteArk

Measurement results

0/17 assessed

0 supported0 disputed or conflicting17 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
method: PyTorch · sequenceLength: 512	93 TFLOPs/s	—	Not assessed
method: FlashAttention · sequenceLength: 512	127 TFLOPs/s	—	Not assessed
method: FlashAttention-2 · sequenceLength: 512	248 TFLOPs/s	—	Not assessed
method: PyTorch · sequenceLength: 1k	120 TFLOPs/s	—	Not assessed
method: FlashAttention · sequenceLength: 1k	127 TFLOPs/s	—	Not assessed
method: FlashAttention-2 · sequenceLength: 1k	294 TFLOPs/s	—	Not assessed
method: PyTorch · sequenceLength: 2k	145 TFLOPs/s	—	Not assessed
method: FlashAttention · sequenceLength: 2k	128 TFLOPs/s	—	Not assessed
method: FlashAttention-2 · sequenceLength: 2k	320 TFLOPs/s	—	Not assessed
method: PyTorch · sequenceLength: 4k	160 TFLOPs/s	—	Not assessed
method: FlashAttention · sequenceLength: 4k	131 TFLOPs/s	—	Not assessed
method: FlashAttention-2 · sequenceLength: 4k	326 TFLOPs/s	—	Not assessed

Figure 7b reports forward-plus-backward attention throughput on H100 80GB SXM5; PyTorch is marked OOM at sequence length 16k. The panel covers non-causal attention with head dimension 128.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results