Larger or alternative Memorizer backbones do not consistently improve LoCoMo F1: Qwen3.5-122B-A10B lowers it from 52.09 to 51.30, while GPT-5.5 raises it modestly to 52.62. Both increase workspace construction time; online latency and action rounds change only slightly.

Larger or alternative Memorizer backbones do not consistently improve LoCoMo F1: Qwen3.5-122B-A10B lowers it from 52.09 to 51.30, while GPT-5.5 raises it modestly to 52.62. Both increase workspace construction time; online latency and action rounds change only slightly. · CiteArk

测量结果

已评估 0/12 项

获得支持 0有争议或冲突 0尚未评估 12

保留同一结论下的完整结果组。已有评估排在前面；单项判断不替代整组结论。展开行查看条件、来源与历次证据。

每行是一项测量，分别显示论文报告、最近可用实测和累计证据状态。
指标与条件	论文报告	最近可用实测	证据判断
researcher: trained Qwen3.5-4B · memorizerBackbone: Qwen3.5-4B (default)	79.53 s/workspace	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: Qwen3.5-4B (default)	13.81 s/query	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: Qwen3.5-4B (default)	3.16 rounds/query	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: Qwen3.5-4B (default)	52.09 F1 points (0–100)	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: Qwen3.5-122B-A10B	132.43 s/workspace	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: Qwen3.5-122B-A10B	14.36 s/query	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: Qwen3.5-122B-A10B	3.25 rounds/query	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: Qwen3.5-122B-A10B	51.3 F1 points (0–100)	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: GPT-5.5	117.65 s/workspace	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: GPT-5.5	13.19 s/query	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: GPT-5.5	3.03 rounds/query	—	尚未评估
researcher: trained Qwen3.5-4B · memorizerBackbone: GPT-5.5	52.62 F1 points (0–100)	—	尚未评估

Larger or alternative Memorizer backbones do not consistently improve LoCoMo F1: Qwen3.5-122B-A10B lowers it from 52.09 to 51.30, while GPT-5.5 raises it modestly to 52.62. Both increase workspace construction time; online latency and action rounds change only slightly.

报告指标与观测值

Assessment（0）

关联运行（0）

测量结果