跳到正文
Nathan Lambert· @natolambert · X·· 3 小时前AI 评分60
AI 导读

Nathan Lambert 引用 DeepSeek 官方部署问答文档称,DeepSeek 在单个集群上每天服务 150T token,超过 OpenRouter、Fireworks、Together 和 BaseTen 上开源模型推理量的总和。他还根据这些公司公开报告的 token 量重建了一张开源模型推理增长对比图,并指出这只是单个集群,DeepSeek 实际拥有多少集群尚不清楚。

正文 · 原文

DeepSeek is serving 150T tokens a day on one cluster, more than the open model inference on OpenRouter, Fireworks, Together, and BaseTen combined.

Below is my reconstruction of various inference volume reports across said companies.

引用Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞)@teortaxesTex
@natolambert right from the horse's mouth ah, right. That's "a single cluster", who knows how many they have https://github.com/deepseek-ai/DeepInfer/blob/main/doc/inference_deployment_qa.md
在 X 查看被引用的帖子

来源:Nathan Lambert · x.com