Source: paper:PDF pp. 16-17, Appendix A.4 and Table 3
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/44 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
model: Qwen3-235B · variant: fresh work order for finished step · protocol: text | 0.21 proportion | — | Not assessed |
model: Qwen3-235B · variant: fresh work order for finished step · protocol: tools | 0.09 proportion | — | Not assessed |
model: Qwen3.6-35B · variant: fresh work order for finished step · protocol: text | 0.47 proportion | — | Not assessed |
model: Qwen3.6-35B · variant: fresh work order for finished step · protocol: tools | 0.02 proportion | — | Not assessed |
model: Qwen3-235B · variant: confirmation wording, same work order · protocol: text | 0.35 proportion | — | Not assessed |
model: Qwen3-235B · variant: confirmation wording, same work order · protocol: tools | 0.08 proportion | — | Not assessed |
model: Qwen3.6-35B · variant: confirmation wording, same work order · protocol: text | 0.44 proportion | — | Not assessed |
model: Qwen3.6-35B · variant: confirmation wording, same work order · protocol: tools | 0 proportion | — | Not assessed |
model: Qwen3-235B · variant: status-question wording, same work order · protocol: text | 0.16 proportion | — | Not assessed |
model: Qwen3-235B · variant: status-question wording, same work order · protocol: tools | 0 proportion | — | Not assessed |
model: Qwen3.6-35B · variant: status-question wording, same work order · protocol: text | 0.38 proportion | — | Not assessed |
model: Qwen3.6-35B · variant: status-question wording, same work order · protocol: tools | 0 proportion | — | Not assessed |