Source: paper:PDF pp. 5-6, Section 4.2 and Table 2
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/33 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
method: Direct · backbone: Qwen2.5-7B | 0.312 score (0-1) | — | Not assessed |
method: Direct · backbone: Qwen2.5-7B | 0 proportion | — | Not assessed |
method: Direct · backbone: Qwen2.5-7B | 0 proportion | — | Not assessed |
method: FATA · backbone: Qwen2.5-7B | 0.177 score (0-1) | — | Not assessed |
method: FATA · backbone: Qwen2.5-7B | 0.177 score (0-1) | — | Not assessed |
method: FATA · backbone: Qwen2.5-7B | 1 proportion | — | Not assessed |
method: FATA · backbone: Qwen2.5-7B | 1 proportion | — | Not assessed |
method: ReAct · backbone: Qwen2.5-7B | 0.481 score (0-1) | — | Not assessed |
method: ReAct · backbone: Qwen2.5-7B | 0.418 score (0-1) | — | Not assessed |
method: ReAct · backbone: Qwen2.5-7B | 0.329 proportion | — | Not assessed |
method: ReAct · backbone: Qwen2.5-7B | 0.41 proportion | — | Not assessed |
method: SFT · backbone: Qwen2.5-3B | 0.543 score (0-1) | — | Not assessed |