JAM has the highest LLM-judge accuracy among systems evaluated with the same GPT-4o-mini protocol on LoCoMo, NarrativeQA and HotpotQA. Its gains over the strongest baseline in each benchmark are 12.54, 20.00 and 11.20 percentage points. Memory-R1 scores are quoted separately and are not directly comparable under this judging pipeline.

JAM has the highest LLM-judge accuracy among systems evaluated with the same GPT-4o-mini protocol on LoCoMo, NarrativeQA and HotpotQA. Its gains over the strongest baseline in each benchmark are 12.54, 20.00 and 11.20 percentage points. Memory-R1 scores are quoted separately and are not directly comparable under this judging pipeline. · CiteArk

Measurement results

0/29 assessed

0 supported0 disputed or conflicting29 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
method: RAG · benchmark: LoCoMo · sourceBlock: Evaluated with our judge	58.25%	—	Not assessed
method: RAG · benchmark: NarrativeQA · sourceBlock: Evaluated with our judge	48%	—	Not assessed
method: RAG · benchmark: HotpotQA · sourceBlock: Evaluated with our judge	53.13%	—	Not assessed
method: A-MEM · benchmark: LoCoMo · sourceBlock: Evaluated with our judge	54.74%	—	Not assessed
method: A-MEM · benchmark: NarrativeQA · sourceBlock: Evaluated with our judge	45%	—	Not assessed
method: A-MEM · benchmark: HotpotQA · sourceBlock: Evaluated with our judge	35.68%	—	Not assessed
method: Mem0 · benchmark: LoCoMo · sourceBlock: Evaluated with our judge	46.23%	—	Not assessed
method: Mem0 · benchmark: NarrativeQA · sourceBlock: Evaluated with our judge	43%	—	Not assessed
method: Mem0 · benchmark: HotpotQA · sourceBlock: Evaluated with our judge	38.02%	—	Not assessed
method: MemoryOS · benchmark: LoCoMo · sourceBlock: Evaluated with our judge	47.66%	—	Not assessed
method: MemoryOS · benchmark: NarrativeQA · sourceBlock: Evaluated with our judge	40%	—	Not assessed
method: MemoryOS · benchmark: HotpotQA · sourceBlock: Evaluated with our judge	30.21%	—	Not assessed

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results