The focused original-brief ladder reports Wilson confidence intervals for the two dense/small Qwen3-235B cells and DeepSeek V4 Pro; all adjacent no-think Qwen3-235B contrasts separated, while thinking converged at the top.

Reported and observed measurements

Assessments (0)

No immutable Assessment has been published for this Claim yet.

Runs (0)

No execution has been linked to this Claim yet.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
arm: raw transcript · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.2,0.35]	0.27 proportion	—	Not assessed
arm: raw transcript · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.27,0.43]	0.34 proportion	—	Not assessed
arm: raw transcript · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.22,0.37]	0.29 proportion	—	Not assessed
arm: raw transcript · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.21,0.37]	0.28 proportion	—	Not assessed
arm: raw transcript · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: no-think · wilson95Ci: [0.51,0.82]	0.69 proportion	—	Not assessed
arm: raw transcript · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: thinking · wilson95Ci: [0.23,0.55]	0.38 proportion	—	Not assessed
arm: text checklist · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.48,0.65]	0.56 proportion	—	Not assessed
arm: text checklist · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.45,0.62]	0.54 proportion	—	Not assessed
arm: text checklist · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.55,0.71]	0.63 proportion	—	Not assessed
arm: text checklist · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.61,0.77]	0.7 proportion	—	Not assessed
arm: text checklist · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: no-think · wilson95Ci: [0.68,0.93]	0.84 proportion	—	Not assessed
arm: text checklist · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: thinking · wilson95Ci: [0.8,0.98]	0.94 proportion	—	Not assessed

Metric and conditions

Reported

Latest observation

Evidence judgment

arm: raw transcript · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.2,0.35]

0.27 proportion

—

Not assessed

arm: raw transcript · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.27,0.43]

0.34 proportion

—

Not assessed

arm: raw transcript · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.22,0.37]

0.29 proportion

—

Not assessed

arm: raw transcript · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.21,0.37]

0.28 proportion

—

Not assessed

arm: raw transcript · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: no-think · wilson95Ci: [0.51,0.82]

0.69 proportion

—

Not assessed

arm: raw transcript · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: thinking · wilson95Ci: [0.23,0.55]

0.38 proportion

—

Not assessed

arm: text checklist · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.48,0.65]

0.56 proportion

—

Not assessed

arm: text checklist · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: no-think · wilson95Ci: [0.45,0.62]

0.54 proportion

—

Not assessed

arm: text checklist · brief: original · model: Qwen3-235B · steps: 10 · density: 0.15 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.55,0.71]

0.63 proportion

—

Not assessed

arm: text checklist · brief: original · model: Qwen3-235B · steps: 15 · density: 0.3 · episodes: 128 · reasoning: thinking · wilson95Ci: [0.61,0.77]

0.7 proportion

—

Not assessed

arm: text checklist · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: no-think · wilson95Ci: [0.68,0.93]

0.84 proportion

—

Not assessed

arm: text checklist · brief: original · model: DeepSeek V4 Pro · steps: 15 · density: 0.3 · episodes: 32 · reasoning: thinking · wilson95Ci: [0.8,0.98]

0.94 proportion

—

Not assessed

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results