With Qwen3-8B as executor, RL-trained JITMEM reports 77.4 ALFWorld success rate, 61.1 WebShop score, and 32.8 WebShop success rate, exceeding the strongest listed write-time baseline by 16.2, 20.5, and 16.3 points respectively; the untrained JITMEM-base is competitive on ALFWorld but has lower WebShop score and success than SkillOS-base.

With Qwen3-8B as executor, RL-trained JITMEM reports 77.4 ALFWorld success rate, 61.1 WebShop score, and 32.8 WebShop success rate, exceeding the strongest listed write-time baseline by 16.2, 20.5, and 16.3 points respectively; the untrained JITMEM-base is competitive on ALFWorld but has lower WebShop score and success than SkillOS-base. · CiteArk

Measurement results

0/24 assessed

0 supported0 disputed or conflicting24 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Reported	Latest observation	Evidence judgment
47.9 percentage points	—	Not assessed
33.3 points	—	Not assessed
9.8 percentage points	—	Not assessed
55.7 percentage points	—	Not assessed
35.4 points	—	Not assessed
11.4 percentage points	—	Not assessed
49.7 percentage points	—	Not assessed
35.7 points	—	Not assessed
12 percentage points	—	Not assessed
53.1 percentage points	—	Not assessed
38.6 points	—	Not assessed
13.6 percentage points	—	Not assessed

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results