On HotpotQA with BM25 augmentation and the MuSiQue-trained predictor, targeted intervention improves accuracy by 5.1 points while intervening on 30.7% of hops; always-intervene gains 9.0 points.

On HotpotQA with BM25 augmentation and the MuSiQue-trained predictor, targeted intervention improves accuracy by 5.1 points while intervening on 30.7% of hops; always-intervene gains 9.0 points. · CiteArk

Measurement results

0/14 assessed

0 supported0 disputed or conflicting14 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
condition: Baseline	48.1%	—	Not assessed
condition: Baseline	0%	—	Not assessed
condition: Baseline	0 calls/question	—	Not assessed
condition: Always	57.1%	—	Not assessed
condition: Always	100%	—	Not assessed
condition: Always	2 calls/question	—	Not assessed
condition: DeBERTa targeted	53.2%	—	Not assessed
condition: DeBERTa targeted	30.7%	—	Not assessed
condition: DeBERTa targeted	0.61 calls/question	—	Not assessed
condition: Oracle	55.5%	—	Not assessed
condition: Oracle	46.9%	—	Not assessed
condition: Oracle	0.94 calls/question	—	Not assessed

On HotpotQA with BM25 augmentation and the MuSiQue-trained predictor, targeted intervention improves accuracy by 5.1 points while intervening on 30.7% of hops; always-intervene gains 9.0 points.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results