Source: paper:pp. 8–9, §4.4, Table 4
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/8 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
variant: w/o BM25 · category: overall · benchmark: locomo | 45.9 F1 points (0–100) | — | Not assessed |
variant: w/o BM25 · category: overall · benchmark: longmemeval | 62.4% | — | Not assessed |
variant: w/o BM25 · category: overall · benchmark: narrativeqa | 38.88 F1 points (0–100) | — | Not assessed |
variant: w/o BM25 · category: overall · benchmark: hotpotqa | 52.14 F1 points (0–100) | — | Not assessed |
variant: w/o Embedding · category: overall · benchmark: locomo | 50.86 F1 points (0–100) | — | Not assessed |
variant: w/o Embedding · category: overall · benchmark: longmemeval | 61.8% | — | Not assessed |
variant: w/o Embedding · category: overall · benchmark: narrativeqa | 39.45 F1 points (0–100) | — | Not assessed |
variant: w/o Embedding · category: overall · benchmark: hotpotqa | 58.13 F1 points (0–100) | — | Not assessed |