来源:paper-fixed:PDF p. 16, Appendix C.2 and Table 9
这条 Claim 暂无已发布的不可变 Assessment。
这条 Claim 暂无关联执行。
已评估 0/37 项
保留同一结论下的完整结果组。已有评估排在前面;单项判断不替代整组结论。展开行查看条件、来源与历次证据。
| 指标与条件 | 论文报告 | 最近可用实测 | 证据判断 |
|---|---|---|---|
model: SPG · dataset: MATH-500 · generationLengthTokens: 128 | 34.6% | — | 尚未评估 |
model: SPG · dataset: MATH-500 · generationLengthTokens: 256 | 39.6% | — | 尚未评估 |
model: SPG · dataset: MATH-500 · generationLengthTokens: 512 | 42.6% | — | 尚未评估 |
model: SPG · dataset: Countdown · generationLengthTokens: 128 | 68.8% | — | 尚未评估 |
model: SPG · dataset: Countdown · generationLengthTokens: 256 | 70.7% | — | 尚未评估 |
model: SPG · dataset: Countdown · generationLengthTokens: 512 | 70.3% | — | 尚未评估 |
model: SPG+IM · dataset: MATH-500 · generationLengthTokens: 128 | 34.6% | — | 尚未评估 |
model: SPG+IM · dataset: MATH-500 · generationLengthTokens: 256 | 40.4% | — | 尚未评估 |
model: SPG+IM · dataset: MATH-500 · generationLengthTokens: 512 | 45.2% | — | 尚未评估 |
model: SPG+IM · dataset: Countdown · generationLengthTokens: 128 | 81.6% | — | 尚未评估 |
model: SPG+IM · dataset: Countdown · generationLengthTokens: 256 | 81.6% | — | 尚未评估 |
model: SPG+IM · dataset: Countdown · generationLengthTokens: 512 | 80.9% | — | 尚未评估 |