With the task-only system message and objective A, defenses had little effect on naive and lookalike injections; nameless tokenization reduced forged-turn success from 99.9% to 92.8% and forged-tool success from 33.1% to 7.4%, but increased forged-system success from 46.9% to 68.0%.

With the task-only system message and objective A, defenses had little effect on naive and lookalike injections; nameless tokenization reduced forged-turn success from 99.9% to 92.8% and forged-tool success from 33.1% to 7.4%, but increased forged-system success from 46.9% to 68.0%. · CiteArk

Measurement results

0/29 assessed

0 supported0 disputed or conflicting29 not assessed

The complete result group stays with its claim. Assessed rows come first; their judgments do not replace the whole-claim conclusion. Expand a row for conditions, sources, and evidence history.

Each row is a measurement with its reported value, latest available observation, and cumulative evidence state.
Metric and conditions	Reported	Latest observation	Evidence judgment
attack: Naive · defense: None	62.5%	—	Not assessed
attack: Naive · defense: Strip	62.2%	—	Not assessed
attack: Naive · defense: Mask	62.2%	—	Not assessed
attack: Naive · defense: Escape	62.3%	—	Not assessed
attack: Naive · defense: Nameless	62.4%	—	Not assessed
attack: Lookalike · defense: None	93%	—	Not assessed
attack: Lookalike · defense: Strip	93%	—	Not assessed
attack: Lookalike · defense: Mask	93%	—	Not assessed
attack: Lookalike · defense: Escape	93%	—	Not assessed
attack: Lookalike · defense: Nameless	93%	—	Not assessed
attack: Forged turn · defense: None	99.9%	—	Not assessed
attack: Forged turn · defense: None	99.8%	—	Not assessed

With the task-only system message and objective A, defenses had little effect on naive and lookalike injections; nameless tokenization reduced forged-turn success from 99.9% to 92.8% and forged-tool success from 33.1% to 7.4%, but increased forged-system success from 46.9% to 68.0%.

Reported and observed measurements

Assessments (0)

Runs (0)

Measurement results