Loading page…
Source: paper:pp. 8–9, §4.4, Table 4
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/16 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
variant: w/o Training · category: overall · benchmark: locomo | 48.59 F1 points (0–100) | — | Not assessed |
variant: w/o Training · category: overall · benchmark: longmemeval | 48.8% | — | Not assessed |
variant: w/o Training · category: overall · benchmark: narrativeqa | 34.98 F1 points (0–100) | — | Not assessed |
variant: w/o Training · category: overall · benchmark: hotpotqa | 45.44 F1 points (0–100) | — | Not assessed |
variant: SFT Only · category: overall · benchmark: locomo | 50.7 F1 points (0–100) | — | Not assessed |
variant: SFT Only · category: overall · benchmark: longmemeval | 60.2% | — | Not assessed |
variant: SFT Only · category: overall · benchmark: narrativeqa | 41.59 F1 points (0–100) | — | Not assessed |
variant: SFT Only · category: overall · benchmark: hotpotqa | 52.08 F1 points (0–100) | — | Not assessed |
variant: GRPO w/o Hint · category: overall · benchmark: locomo | 51.42 F1 points (0–100) | — | Not assessed |
variant: GRPO w/o Hint · category: overall · benchmark: longmemeval | 62.4% | — | Not assessed |
variant: GRPO w/o Hint · category: overall · benchmark: narrativeqa | 43.62 F1 points (0–100) | — | Not assessed |
variant: GRPO w/o Hint · category: overall · benchmark: hotpotqa | 55.64 F1 points (0–100) | — | Not assessed |