On MuSiQue with Contriever augmentation, targeted and oracle intervention have nearly identical accuracy, improving the 51.2% baseline to 54.7% and 54.8%, respectively.

On MuSiQue with Contriever augmentation, targeted and oracle intervention have nearly identical accuracy, improving the 51.2% baseline to 54.7% and 54.8%, respectively. · CiteArk

Measurement results

0/10 assessed

0 supported0 disputed or conflicting10 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
condition: Baseline	51.2%	—	Not assessed
condition: Baseline	0%	—	Not assessed
condition: Baseline	0 calls/question	—	Not assessed
condition: DeBERTa targeted	54.7%	—	Not assessed
condition: DeBERTa targeted	45.2%	—	Not assessed
condition: DeBERTa targeted	1.2 calls/question	—	Not assessed
condition: Oracle	54.8%	—	Not assessed
condition: Oracle	50.9%	—	Not assessed
condition: Oracle	1.35 calls/question	—	Not assessed
	3.5 percentage points	—	Not assessed

On MuSiQue with Contriever augmentation, targeted and oracle intervention have nearly identical accuracy, improving the 51.2% baseline to 54.7% and 54.8%, respectively.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results