Loading page…
Source: paper-supplement:pages 20 and 26-27, Tables 8 and 13-15
No immutable Assessment has been published for this Claim yet.
No execution has been linked to this Claim yet.
0/3 assessed
The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.
| Metric and conditions | Reported | Latest observation | Evidence judgment |
|---|---|---|---|
hardware: NVIDIA A800 server · aggregation: average · model_variant: Qwen2.5-3B | 10.15 seconds | — | Not assessed |
hardware: NVIDIA A800 server · aggregation: average · model_variant: Qwen2.5-3B | 11.86 seconds | — | Not assessed |
judge: Qwen2.5-72B · dataset: MedQA test · model_variant: Qwen2.5-7B-Instruct | 87 percentage_points | — | Not assessed |