微软提出免训练方法 FOCUS,在测试时压缩 AI 智能体上下文:它判断智能体下一步决策真正依赖哪些历史交互,保留这些单元、丢弃其余部分,无需训练数据或微调,可作为独立层接在闭源 API 模型前。在工具调用、QA、网页与多轮对话基准上,峰值上下文最多减少 48%,任务成功率最多提升 8.9 个百分点。
New paper from Microsoft on compressing agent context at test time.
If your agent gets worse as its interaction history grows, this method is worth a look.
FOCUS asks which past interactions the agent's next decisions actually depend on. It keeps those units of the history and drops the others. It needs no training data or fine-tuning, so it works as a separate layer in front of closed-API models.
On tool-calling, QA, web and multi-turn dialogue benchmarks, it cuts peak context by up to 48% and raises task success by up to 8.9 points compared with running on the full history.
Paper: https://academy.dair.ai/papers/focus-training-free-decision-preserving-context-compression-for-llm-agents-2609.37590
来源:DAIR.AI · x.com