跳到正文
Rohan Paul· @rohanpaul_ai · X·· 1 天前AI 评分40
AI 导读

智能体集群把大部分新增token消耗导向更便宜的模型,使agent的token量增长快于前沿模型的收入。a16z 数据显示智能体消耗的token接近人类的5倍,六个月内增长14倍。作者认为这波token爆发会让AI软件的包月与按席位定价让位于按量计费,因为按席位收费依赖人类提示速度来限制用量,而这在24x7运转的智能体集群下不再成立。

正文

Agent swarms send most new token volume to cheaper models, so agent token counts will outrun frontier-model revenue.

In a swarm, a parent agent plans while child agents handle narrow jobs like searching files or running tests. Narrow jobs are usually easy to check, so developers can route them to the cheapest model that passes.

And this massive token-explosion is also the major reason, flat-rate and per-seat pricing for AI software will give way to metering, because it relied on human prompting speed to cap usage.
A person sends only so many prompts a day, so vendors could charge per user and still predict inference bills.
But that equation will not hold with agent swarms working 24x7.

引用a16z@a16z
Your next users are machines Agents burn nearly 5x the tokens people do, up 14x in six months
在 X 查看被引用的帖子

来源:Rohan Paul · x.com