Thinking and Instruct have similar normalized retention from eight to five experts, but Thinking leads on the four hardest generative datasets by 2.7 points at k=4 and 5.1 points at k=3; the reported task breakdown shows little Knowledge QA difference.

Thinking and Instruct have similar normalized retention from eight to five experts, but Thinking leads on the four hardest generative datasets by 2.7 points at k=4 and 5.1 points at k=3; the reported task breakdown shows little Knowledge QA difference. · CiteArk

Measurement results

0/4 assessed

0 supported0 disputed or conflicting4 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
printedValue: 2.7	2.7 percentage points	—	Not assessed
printedValue: 5.1	5.1 percentage points	—	Not assessed
printedValue: 8.9k	8.9 thousand tokens	—	Not assessed
printedValue: 3.7k	3.7 thousand tokens	—	Not assessed

Thinking and Instruct have similar normalized retention from eight to five experts, but Thinking leads on the four hardest generative datasets by 2.7 points at k=4 and 5.1 points at k=3; the reported task breakdown shows little Knowledge QA difference.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results