All three tested encoder classifiers learn the fact-presence task on MuSiQue dev, with DeBERTa-v3-large attaining the highest reported F1 of 0.785.

All three tested encoder classifiers learn the fact-presence task on MuSiQue dev, with DeBERTa-v3-large attaining the highest reported F1 of 0.785. · CiteArk

Measurement results

0/12 assessed

0 supported0 disputed or conflicting12 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
model: BERT-base	110 millions	—	Not assessed
model: BERT-base	0.753 score	—	Not assessed
model: BERT-base	0.737 score	—	Not assessed
model: BERT-base	0.745 score	—	Not assessed
model: RoBERTa-large	355 millions	—	Not assessed
model: RoBERTa-large	0.84 score	—	Not assessed
model: RoBERTa-large	0.683 score	—	Not assessed
model: RoBERTa-large	0.754 score	—	Not assessed
model: DeBERTa-v3-large	435 millions	—	Not assessed
model: DeBERTa-v3-large	0.805 score	—	Not assessed
model: DeBERTa-v3-large	0.765 score	—	Not assessed
model: DeBERTa-v3-large	0.785 score	—	Not assessed

All three tested encoder classifiers learn the fact-presence task on MuSiQue dev, with DeBERTa-v3-large attaining the highest reported F1 of 0.785.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results