LMSYS:Blog(Chatbot Arena 团队)·· 13 小时前AI 评分54
AMD 与 SGLang 团队详解 MI355X 上 DeepSeek-R1 分离式推理如何做到 TCO 对标 B200
Blog Win on TCO: How AMD Instinct™ MI355X Achieves Cost-Competitive Distributed Inference Through SGLang with MoRI The SGLang and AMD team has worked closely to unlock competitive Total Cost of Ownership (TCO) for large-scale DeepSeek-R1 disaggregated inference on AMD Instinct™ MI355X GPUs. Building on SGLang's se... AMD & SGLang Team May 28, 2026
AI 导读
AMD 与 SGLang 团队联合发布博客,展示基于 SGLang 和 MoRI 通信库的 DeepSeek-R1 分离式推理在 AMD Instinct MI355X 上实现有竞争力的 TCO,结果由 SemiAnalysis 的 InferenceX 基准平台验证。
来源:LMSYS:Blog(Chatbot Arena 团队) · lmsys.org