Replacing GPT-4o with Qwen2.5-7B-Instruct as the fixed latent-intent-aware simulator leaves PACIFIC performance close to the main setting and slightly raises selectivity, whereas Qwen2.5-3B-Instruct substantially lowers post-clarification F1 and ambiguous-query recall.

Replacing GPT-4o with Qwen2.5-7B-Instruct as the fixed latent-intent-aware simulator leaves PACIFIC performance close to the main setting and slightly raises selectivity, whereas Qwen2.5-3B-Instruct substantially lowers post-clarification F1 and ambiguous-query recall. · CiteArk

Measurement results

0/12 assessed

0 supported0 disputed or conflicting12 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
simulator: GPT-4o	0.795 score (0-1)	—	Not assessed
simulator: GPT-4o	0.768 score (0-1)	—	Not assessed
simulator: GPT-4o	0.873 proportion	—	Not assessed
simulator: GPT-4o	0.613 proportion-point difference	—	Not assessed
simulator: Qwen2.5-7B-Instruct	0.783 score (0-1)	—	Not assessed
simulator: Qwen2.5-7B-Instruct	0.752 score (0-1)	—	Not assessed
simulator: Qwen2.5-7B-Instruct	0.856 proportion	—	Not assessed
simulator: Qwen2.5-7B-Instruct	0.636 proportion-point difference	—	Not assessed
simulator: Qwen2.5-3B-Instruct	0.677 score (0-1)	—	Not assessed
simulator: Qwen2.5-3B-Instruct	0.536 score (0-1)	—	Not assessed
simulator: Qwen2.5-3B-Instruct	0.462 proportion	—	Not assessed
simulator: Qwen2.5-3B-Instruct	0.332 proportion-point difference	—	Not assessed

Replacing GPT-4o with Qwen2.5-7B-Instruct as the fixed latent-intent-aware simulator leaves PACIFIC performance close to the main setting and slightly raises selectivity, whereas Qwen2.5-3B-Instruct substantially lowers post-clarification F1 and ambiguous-query recall.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results