Nathan Lambert· @natolambert · X·· 7 小时前AI 评分63
AI 导读
Nathan Lambert 转评 DeepSeek 宣布开源自研推理框架 DeepInfer,该框架支撑 DeepSeek-V4.1-Flash 的大规模推理,主打高吞吐低延迟,代码见 http://github.com/deepseek-ai/DeepInfer。作者称这是很妙的模型推广方式,对社区有利,并调侃其时机恰逢美国政府刚在联邦机构禁用 DeepSeek。
正文 · 原文
This is really a wild way to get adoption on your models.
Really great for the community, and the timing is hilarious given the govt just banned deepseek in federal agencies.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4在 X 查看被引用的帖子
来源:Nathan Lambert · x.com