Source: paper:p. 8, §4.3, Table 2
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/28 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
variant: w/o SFT · category: overall · benchmark: locomo | 48.59 F1 points (0–100) | — | Not assessed |
variant: w/o SFT · category: overall · benchmark: longmemeval | 48.8% | — | Not assessed |
variant: w/o SFT · category: overall · benchmark: narrativeqa | 34.98 F1 points (0–100) | — | Not assessed |
variant: w/o SFT · category: overall · benchmark: hotpotqa | 45.44 F1 points (0–100) | — | Not assessed |
variant: MemAgent data · category: overall · benchmark: locomo | 48.6 F1 points (0–100) | — | Not assessed |
variant: MemAgent data · category: overall · benchmark: longmemeval | 55.2% | — | Not assessed |
variant: MemAgent data · category: overall · benchmark: narrativeqa | 31.98 F1 points (0–100) | — | Not assessed |
variant: MemAgent data · category: overall · benchmark: hotpotqa | 54.53 F1 points (0–100) | — | Not assessed |
variant: Memory-R1 data · category: overall · benchmark: locomo | 48.9 F1 points (0–100) | — | Not assessed |
variant: Memory-R1 data · category: overall · benchmark: longmemeval | 57.2% | — | Not assessed |
variant: Memory-R1 data · category: overall · benchmark: narrativeqa | 32.42 F1 points (0–100) | — | Not assessed |
variant: Memory-R1 data · category: overall · benchmark: hotpotqa | 49.81 F1 points (0–100) | — | Not assessed |