The authors' reproduced no-memory baselines are at or below the SkillOS-reported values. For Qwen3-8B, thinking mode is closer on ALFWorld, non-thinking is closer on WebShop, and WebShop additionally uses calibrated search guidance because the reported no-memory result could not otherwise be fully reproduced.

The authors' reproduced no-memory baselines are at or below the SkillOS-reported values. For Qwen3-8B, thinking mode is closer on ALFWorld, non-thinking is closer on WebShop, and WebShop additionally uses calibrated search guidance because the reported no-memory result could not otherwise be fully reproduced. · CiteArk

Measurement results

0/15 assessed

0 supported0 disputed or conflicting15 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Reported	Latest observation	Evidence judgment
47.9 percentage points	—	Not assessed
33.3 points	—	Not assessed
9.8 percentage points	—	Not assessed
34.5 percentage points	—	Not assessed
36.4 points	—	Not assessed
8.6 percentage points	—	Not assessed
42.1 percentage points	—	Not assessed
29 points	—	Not assessed
4.4 percentage points	—	Not assessed
66.4 percentage points	—	Not assessed
48.6 points	—	Not assessed
38.4 percentage points	—	Not assessed

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results