Source: paper:PDF p. 6, Table 2 and Section 4.2
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/9 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
method: Direct · dataset: AmbigNQ · backbone: Qwen2.5-7B | 0.058 score (0-1) | — | Not assessed |
method: FATA · dataset: AmbigNQ · backbone: Qwen2.5-7B | 0.076 score (0-1) | — | Not assessed |
method: ReAct · dataset: AmbigNQ · backbone: Qwen2.5-7B | 0.076 score (0-1) | — | Not assessed |
method: SFT · dataset: AmbigNQ · backbone: Qwen2.5-3B | 0.056 score (0-1) | — | Not assessed |
method: SFT · dataset: AmbigNQ · backbone: Qwen2.5-7B | 0.109 score (0-1) | — | Not assessed |
method: SGP · status: externally reported anchor · dataset: AmbigQA · backbone: Gemma-2-9B · protocol: 50/50 balanced dev | 0.306 score (0-1) | — | Not assessed |
method: SGP-Oracle · status: externally reported anchor · dataset: AmbigQA · backbone: Gemma-2-9B · protocol: 50/50 balanced dev · usesGoldAmbiguityLabels: true | 0.359 score (0-1) | — | Not assessed |
method: CIGAsk · dataset: AmbigNQ · backbone: Qwen2.5-3B | 0.271 score (0-1) | — | Not assessed |
method: CIGAsk · dataset: AmbigNQ · backbone: Qwen2.5-7B | 0.511 score (0-1) | — | Not assessed |