来源:paper:PDF p. 30, Table 13
这条 Claim 暂无已发布的不可变 Assessment。
这条 Claim 暂无关联执行。
已评估 0/24 项
保留同一结论下的完整结果组。已有评估排在前面;单项判断不替代整组结论。展开行查看条件、来源与历次证据。
| 指标与条件 | 论文报告 | 最近可用实测 | 证据判断 |
|---|---|---|---|
arm: raw transcript · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.2,0.35] | 0.27 proportion | — | 尚未评估 |
arm: raw transcript · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.27,0.43] | 0.34 proportion | — | 尚未评估 |
arm: raw transcript · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.22,0.37] | 0.29 proportion | — | 尚未评估 |
arm: raw transcript · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.21,0.37] | 0.28 proportion | — | 尚未评估 |
arm: raw transcript · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: no-think · wilson95Ci: [0.51,0.82] | 0.69 proportion | — | 尚未评估 |
arm: raw transcript · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: thinking · wilson95Ci: [0.23,0.55] | 0.38 proportion | — | 尚未评估 |
arm: text checklist · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.48,0.65] | 0.56 proportion | — | 尚未评估 |
arm: text checklist · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.45,0.62] | 0.54 proportion | — | 尚未评估 |
arm: text checklist · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.55,0.71] | 0.63 proportion | — | 尚未评估 |
arm: text checklist · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.61,0.77] | 0.7 proportion | — | 尚未评估 |
arm: text checklist · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: no-think · wilson95Ci: [0.68,0.93] | 0.84 proportion | — | 尚未评估 |
arm: text checklist · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: thinking · wilson95Ci: [0.8,0.98] | 0.94 proportion | — | 尚未评估 |