On Claude Haiku 4.5 and GPT-5.4, SkillSonar generalizes zero-shot across model architectures, reducing ID/OOD ASR to 0.096/0.254 on Claude Haiku 4.5 and 0.019/0.034 on GPT-5.4, while preserving higher utility than default AcceptEdits.

On Claude Haiku 4.5 and GPT-5.4, SkillSonar generalizes zero-shot across model architectures, reducing ID/OOD ASR to 0.096/0.254 on Claude Haiku 4.5 and 0.019/0.034 on GPT-5.4, while preserving higher utility than default AcceptEdits. · CiteArk

测量结果

已评估 0/50 项

获得支持 0有争议或冲突 0尚未评估 50

保留同一结论下的完整结果组。已有评估排在前面；单项判断不替代整组结论。展开行查看条件、来源与历次证据。

每行是一项测量，分别显示论文报告、最近可用实测和累计证据状态。
指标与条件	论文报告	最近可用实测	证据判断
model: Claude Haiku 4.5 · split: id_test · defense: No-guard	0.481 fraction	—	尚未评估
model: Claude Haiku 4.5 · split: ood_test · defense: No-guard	0.707 fraction	—	尚未评估
model: Claude Haiku 4.5 · split: id_test · defense: No-guard	0.764 score	—	尚未评估
model: Claude Haiku 4.5 · split: ood_test · defense: No-guard	0.737 score	—	尚未评估
model: Claude Haiku 4.5 · defense: No-guard	179,918 tokens	—	尚未评估
model: Claude Haiku 4.5 · split: id_test · defense: System prompt	0.451 fraction	—	尚未评估
model: Claude Haiku 4.5 · split: ood_test · defense: System prompt	0.508 fraction	—	尚未评估
model: Claude Haiku 4.5 · split: id_test · defense: System prompt	0.661 score	—	尚未评估
model: Claude Haiku 4.5 · split: ood_test · defense: System prompt	0.662 score	—	尚未评估
model: Claude Haiku 4.5 · defense: System prompt	160,672 tokens	—	尚未评估
model: Claude Haiku 4.5 · split: id_test · defense: AcceptEdits	0.118 fraction	—	尚未评估
model: Claude Haiku 4.5 · split: ood_test · defense: AcceptEdits	0.051 fraction	—	尚未评估

On Claude Haiku 4.5 and GPT-5.4, SkillSonar generalizes zero-shot across model architectures, reducing ID/OOD ASR to 0.096/0.254 on Claude Haiku 4.5 and 0.019/0.034 on GPT-5.4, while preserving higher utility than default AcceptEdits.

报告指标与观测值

Assessment（0）

关联运行（0）

测量结果