Source: paper:p29-b306
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/30 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
constructionMode: Unguided Baseline (w/o PG) | 87.5% | — | Not assessed |
constructionMode: Unguided Baseline (w/o PG) | 7,403.98 tokens | — | Not assessed |
constructionMode: Unguided Baseline (w/o PG) | 7.05 steps | — | Not assessed |
constructionMode: Unguided Baseline (w/o PG) | 1.05 failures_per_sample | — | Not assessed |
constructionMode: Unguided Baseline (w/o PG) | 127.59 seconds | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 58.93% | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 11,039.82 tokens | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 6.6 steps | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 0.88 failures_per_sample | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 117.7 seconds | — | Not assessed |
constructionMode: Mode 2: Expert + Static Update | 53.57% | — | Not assessed |
constructionMode: Mode 2: Expert + Static Update | 5,990.79 tokens | — | Not assessed |