On the pre-filter audit sample, all three validation judges exceed 90% agreement and Cohen’s kappa of 0.80 with adjudicated human decisions. Their acceptance rates are below the human reference.

On the pre-filter audit sample, all three validation judges exceed 90% agreement and Cohen’s kappa of 0.80 with adjudicated human decisions. Their acceptance rates are below the human reference. · CiteArk

Measurement results

0/21 assessed

0 supported0 disputed or conflicting21 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
comparison: two primary annotators before adjudication	96%	—	Not assessed
comparison: two primary annotators before adjudication	0.916 dimensionless	—	Not assessed
evaluator: Human reference	62%	—	Not assessed
evaluator: MiniMax-2.5 · reference: adjudicated human labels	58.5%	—	Not assessed
evaluator: MiniMax-2.5 · reference: adjudicated human labels	91.5%	—	Not assessed
evaluator: MiniMax-2.5 · reference: adjudicated human labels	0.823 dimensionless	—	Not assessed
evaluator: MiniMax-2.5 · reference: adjudicated human labels	95.7%	—	Not assessed
evaluator: MiniMax-2.5 · reference: adjudicated human labels	90.3%	—	Not assessed
evaluator: MiniMax-2.5 · reference: adjudicated human labels	92.9%	—	Not assessed
evaluator: GPT-5.5 · reference: adjudicated human labels	60%	—	Not assessed
evaluator: GPT-5.5 · reference: adjudicated human labels	92%	—	Not assessed
evaluator: GPT-5.5 · reference: adjudicated human labels	0.832 dimensionless	—	Not assessed

On the pre-filter audit sample, all three validation judges exceed 90% agreement and Cohen’s kappa of 0.80 with adjudicated human decisions. Their acceptance rates are below the human reference.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results