Source: paper:p29-b305
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/30 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
constructionMode: Unguided Baseline (w/o PG) | 71.21% | — | Not assessed |
constructionMode: Unguided Baseline (w/o PG) | 4,003.24 tokens | — | Not assessed |
constructionMode: Unguided Baseline (w/o PG) | 4.88 steps | — | Not assessed |
constructionMode: Unguided Baseline (w/o PG) | 0.016 failures_per_sample | — | Not assessed |
constructionMode: Unguided Baseline (w/o PG) | 18.06 seconds | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 76.61% | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 9,045.69 tokens | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 4.12 steps | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 0.007 failures_per_sample | — | Not assessed |
constructionMode: Mode 1: Hand-crafted Expert | 39.34 seconds | — | Not assessed |
constructionMode: Mode 2: Expert + Static Update | 77.16% | — | Not assessed |
constructionMode: Mode 2: Expert + Static Update | 8,942.79 tokens | — | Not assessed |