Rohan Paul· @rohanpaul_ai · X·· 3 小时前AI 评分45
AI 导读
从生产使用中整理测试数据集变得更方便，听起来相当实用。 人们会提出各种事先没人想到要写下来的需求。能把更多这类需求纳入测试就好了 今天，@JudgmentLabs 开放通用访问。 我们相信，长时程运行的智能体系统产生的 exhaust data 将超出世界目前能处理的范围。 智能体轨迹中隐藏着丰富的记录，说明如何让这些系统变得更好：用户提出了什么需求、智能体在何时出错，以及智能体如何与外部世界交互。 Judgment 是面向长时程智能体性能最强的监控与改进层。 我们很期待看到你构建的东西！
正文 · 原文
Making it easier to curate test datasets from production usage sounds pretty handy.
People ask for all sorts of things nobody thought to write down in advance. Would be nice to get more of those into the tests
Today, @JudgmentLabs opens for general access. We believe long running agent systems will generate more exhaust data than the world can currently process. Hidden within agent traces are rich records of how to make these systems better: what users ask for, when agents stumble, and how agents interact with the external world. Judgment is the most performant monitoring and improvement layer for long-horizon agents. We’re excited to see what you build!在 X 查看被引用的帖子
来源：Rohan Paul · x.com