Performance comparison of Procedural Graph against 7 baselines (Vanilla ReAct, MemoryBank, RAP, ExpeL, AutoGuide, AWM, KnowAgent) on HotpotQA (multi-hop open-domain QA (1000 test items, LLM judged binary accuracy)) using Gemini 3.5 Flash. Procedural Graph achieves 84.5% compared to the best baseline score of 83.4% (margin of +1.1%).

Performance comparison of Procedural Graph against 7 baselines (Vanilla ReAct, MemoryBank, RAP, ExpeL, AutoGuide, AWM, KnowAgent) on HotpotQA (multi-hop open-domain QA (1000 test items, LLM judged binary accuracy)) using Gemini 3.5 Flash. Procedural Graph achieves 84.5% compared to the best baseline score of 83.4% (margin of +1.1%). · CiteArk

Measurement results

0/8 assessed

0 supported0 disputed or conflicting8 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
model: Gemini 3.5 Flash · method: Vanilla ReAct (Yao et al., 2023b) · benchmark: HotpotQA	83.1%	—	Not assessed
model: Gemini 3.5 Flash · method: MemoryBank (Zhong et al., 2024) · benchmark: HotpotQA	82.5%	—	Not assessed
model: Gemini 3.5 Flash · method: RAP (Kagaya et al., 2024) · benchmark: HotpotQA	82.3%	—	Not assessed
model: Gemini 3.5 Flash · method: ExpeL (Zhao et al., 2024) · benchmark: HotpotQA	83.4%	—	Not assessed
model: Gemini 3.5 Flash · method: AutoGuide (Fu et al., 2024) · benchmark: HotpotQA	83.1%	—	Not assessed
model: Gemini 3.5 Flash · method: AWM (Wang et al., 2025b) · benchmark: HotpotQA	82.5%	—	Not assessed
model: Gemini 3.5 Flash · method: KnowAgent (Zhu et al., 2025) · benchmark: HotpotQA	82.7%	—	Not assessed
model: Gemini 3.5 Flash · method: Procedural Graph (Ours) · benchmark: HotpotQA	84.5%	—	Not assessed

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results