来源:paper-fixed:PDF p. 14, Appendix C and Table 5
这条 Claim 暂无已发布的不可变 Assessment。
这条 Claim 暂无关联执行。
已评估 0/12 项
保留同一结论下的完整结果组。已有评估排在前面;单项判断不替代整组结论。展开行查看条件、来源与历次证据。
| 指标与条件 | 论文报告 | 最近可用实测 | 证据判断 |
|---|---|---|---|
model: SPG (full) · dataset: MATH-500 · generationLengthTokens: 128 | 34% | — | 尚未评估 |
model: SPG (full) · dataset: MATH-500 · generationLengthTokens: 256 | 38% | — | 尚未评估 |
model: SPG (full) · dataset: MATH-500 · generationLengthTokens: 512 | 41.4% | — | 尚未评估 |
model: SPG (full)+IM · dataset: MATH-500 · generationLengthTokens: 128 | 34.2% | — | 尚未评估 |
model: SPG (full)+IM · dataset: MATH-500 · generationLengthTokens: 256 | 41% | — | 尚未评估 |
model: SPG (full)+IM · dataset: MATH-500 · generationLengthTokens: 512 | 42% | — | 尚未评估 |
model: SPG (full) · dataset: GSM8K · generationLengthTokens: 128 | 75.1% | — | 尚未评估 |
model: SPG (full) · dataset: GSM8K · generationLengthTokens: 256 | 81.9% | — | 尚未评估 |
model: SPG (full) · dataset: GSM8K · generationLengthTokens: 512 | 83.6% | — | 尚未评估 |
model: SPG (full)+IM · dataset: GSM8K · generationLengthTokens: 128 | 77.4% | — | 尚未评估 |
model: SPG (full)+IM · dataset: GSM8K · generationLengthTokens: 256 | 82% | — | 尚未评估 |
model: SPG (full)+IM · dataset: GSM8K · generationLengthTokens: 512 | 83.9% | — | 尚未评估 |