Source: paper:p. 9, §4.5; p. 19, B.4, Table 9
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/20 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
benchmark: LoCoMo · maximumActionRounds: 20 | 95.58% | — | Not assessed |
benchmark: LoCoMo · maximumActionRounds: 20 | 3.16 rounds/query | — | Not assessed |
benchmark: LoCoMo · maximumActionRounds: 20 | 3 rounds/query | — | Not assessed |
benchmark: LoCoMo · maximumActionRounds: 20 | 4 rounds/query | — | Not assessed |
benchmark: LoCoMo · maximumActionRounds: 20 | 0% | — | Not assessed |
benchmark: LongMemEval · maximumActionRounds: 20 | 82.8% | — | Not assessed |
benchmark: LongMemEval · maximumActionRounds: 20 | 3.82 rounds/query | — | Not assessed |
benchmark: LongMemEval · maximumActionRounds: 20 | 3 rounds/query | — | Not assessed |
benchmark: LongMemEval · maximumActionRounds: 20 | 6 rounds/query | — | Not assessed |
benchmark: LongMemEval · maximumActionRounds: 20 | 0.4% | — | Not assessed |
benchmark: NarrativeQA · maximumActionRounds: 20 | 84% | — | Not assessed |
benchmark: NarrativeQA · maximumActionRounds: 20 | 3.92 rounds/query | — | Not assessed |