Dongxi 东锡 NLP· @dongxi_nlp · X·· 9 小时前AI 评分64
AI 导读
DeepSeek 以 Apache-2.0 许可开源高性能大规模推理框架 DeepInfer，仓库地址 https://github.com/deepseek-ai/DeepInfer。支持特性包括优化 kernel 与模型和采样运行时、Attention DP / 均衡 CP、MoE EP + EPLB、DSpark 与置信度调度验证、SWA bounded replay、零开销批调度器的异步调度、批不变推理、确定性采样和结构化输出。
正文 · 原文
DeepSeek 开源 DeepInfer
Respect!
DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license. https://github.com/deepseek-ai/DeepInfer Supported features: - Optimized kernels, model and sampler runtime - Parallelism: Attention DP / balanced CP, MoE EP + EPLB - DSpark and confidence-scheduled verification - SWA bounded replay - Asynchronous scheduling (zero-overhead batch scheduler) - Batch-invariant inference - Deterministic sampling - Structured output在 X 查看被引用的帖子
来源：Dongxi 东锡 NLP · x.com