On repeated runtime evaluation over N=10 runs with GLM-5 on Claude Code, SkillSonar reduces ID ASR from 0.482 to 0.104 and OOD ASR from 0.606 to 0.115 while maintaining 0.779 ID and 0.715 OOD task utility, significantly outperforming system-prompt and permission-based baselines.

On repeated runtime evaluation over N=10 runs with GLM-5 on Claude Code, SkillSonar reduces ID ASR from 0.482 to 0.104 and OOD ASR from 0.606 to 0.115 while maintaining 0.779 ID and 0.715 OOD task utility, significantly outperforming system-prompt and permission-based baselines. · CiteArk

测量结果

已评估 0/25 项

获得支持 0有争议或冲突 0尚未评估 25

保留同一结论下的完整结果组。已有评估排在前面；单项判断不替代整组结论。展开行查看条件、来源与历次证据。

每行是一项测量，分别显示论文报告、最近可用实测和累计证据状态。
指标与条件	论文报告	最近可用实测	证据判断
split: id_test · defense: No-guard	0.482 fraction	—	尚未评估
split: ood_test · defense: No-guard	0.606 fraction	—	尚未评估
split: id_test · defense: No-guard	0.811 score	—	尚未评估
split: ood_test · defense: No-guard	0.839 score	—	尚未评估
defense: No-guard	179.3 thousands_of_tokens	—	尚未评估
split: id_test · defense: System prompt	0.414 fraction	—	尚未评估
split: ood_test · defense: System prompt	0.489 fraction	—	尚未评估
split: id_test · defense: System prompt	0.783 score	—	尚未评估
split: ood_test · defense: System prompt	0.807 score	—	尚未评估
defense: System prompt	175.6 thousands_of_tokens	—	尚未评估
split: id_test · defense: AcceptEdits	0.122 fraction	—	尚未评估
split: ood_test · defense: AcceptEdits	0.073 fraction	—	尚未评估

On repeated runtime evaluation over N=10 runs with GLM-5 on Claude Code, SkillSonar reduces ID ASR from 0.482 to 0.104 and OOD ASR from 0.606 to 0.115 while maintaining 0.779 ID and 0.715 OOD task utility, significantly outperforming system-prompt and permission-based baselines.

报告指标与观测值

Assessment（0）

关联运行（0）

测量结果