ProFA achieves the strongest reported agent-level and step-level failure-attribution accuracies among the listed methods on the held-in HotPotQA, ChartQAPro, and Mind2Web datasets and on the held-out Algorithm-Generated and Hand-Crafted subsets.

ProFA achieves the strongest reported agent-level and step-level failure-attribution accuracies among the listed methods on the held-in HotPotQA, ChartQAPro, and Mind2Web datasets and on the held-out Algorithm-Generated and Hand-Crafted subsets. · CiteArk

Measurement results

0/3 assessed

0 supported0 disputed or conflicting3 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
split: held-in · method: ProFA · dataset: HotPotQA · value_scope: test set of constructed Who & When Pro dataset · accuracy_level: agent	0.85 fraction	—	Not assessed
split: held-out Algorithm-Generated · method: ProFA · dataset: Who & When · failure_logs: 184 · accuracy_level: step	0.53 fraction	—	Not assessed
split: held-out Hand-Crafted · method: ProFA · dataset: Who & When · failure_logs: 184 · accuracy_level: step	0.2 fraction	—	Not assessed

ProFA achieves the strongest reported agent-level and step-level failure-attribution accuracies among the listed methods on the held-in HotPotQA, ChartQAPro, and Mind2Web datasets and on the held-out Algorithm-Generated and Hand-Crafted subsets.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results