Jerry Liu 认为,如今多数任务可通过定义 eval 并对其爬山迭代来解决,而非直接编写确定性或智能体工作流。数据提供商的核心工作就是为所有经济活动定义 eval,使前沿模型具备通用能力;人的职责变成指明方向,即定义要解决什么、如何衡量好结果。智能体应用界面将随之演化,最复杂流程仍需显式工作流构建器,但多数任务可压缩为目标加 eval 指令。
These days, you can pretty much solve any task by defining an eval and hillclimbing over it, instead of directly defining the deterministic/agentic workflow to solve it.
The data provider companies' entire job is to define evals for all economic activity to make the frontier models capable of doing anything.
Your job then becomes pointing frontier intelligence in the right direction - defining what to solve, and how to measure what good looks like.
Agent application interfaces will evolve to capture this. The most complex processes will still need some sort of explicit workflow builder interface, but most tasks can be compressed into goals and eval instructions.
来源:Jerry Liu · x.com