AI 邮件成本几何?前沿模型每月 22-130 美元,优化后可降 100 倍
What Would AI Email Cost?
用前沿模型运行 AI 邮件每月成本为 22 至 130 美元,按中间值 26 美元计算,软件公司若保持 75% 毛利率,年费约 350 美元,加上托管与推理成本后定价可达 500 美元/年。改用更小模型可降本 10 至 20 倍,若将部分组件改为确定性规则执行、并把模型与工作负载匹配,整体成本最多可降 100 倍;本地推理时成本趋近于零,由用户 GPU 承担算力。
In short : AI email using frontier models costs $22-130/month, but cost optimization through smaller models and local inference can reduce this by 100x.
In yesterday’s post (which an agent pushed in raw outline form via email!), I wrote about the future of AI email. What does that future cost?
If you are using state-of-the-art model ranging, it costs between $22 to $130 per month. Would you pay for that? At work, I imagine, many would. Let’s take the middle case of $26/month raw cost.
A software company seeking 75% gross margin would charge about $350 per year for that product excluding hosting & serving costs. So let’s call it a $500 per year list with a 15% discount at scale.
A Google Enterprise plan is $11-18/month. A fully agentic solution would then cost about twice as much.
Smaller models help. They cut cost by 10 to 20x, but we can do better.
By running the models locally, when the cost plummets to zero : users’ GPU does the work.
It’s this type of cost optimization that I have done crudely here that I think will define the next 12 to 24 months of AI software : determining which components can be executed deterministically, like the email filters, which are just rules. And the next is matching the model to the workload.
With some basic heuristics and techniques we can drop the overall cost by 100x. Given the tremendous shortage of GPUs, this segmentation of inference is inevitable.
Get the next one in your inbox
The 1-minute read that turns tech data into strategic advantage.
Read by 150k+ founders & operators.
GP at Theory Ventures. Former Google PM. Sharing data-driven insights on AI, web3, & venture capital.
来源:Tomer Tunguz 博客(VC 分析) · tomtunguz.com