Qwen· @Alibaba_Qwen · X·· 3 小时前AI 评分50
AI 导读
恭喜 @lightseekorg 取得令人瞩目的 TokenSpeed 成果!🚀 很高兴看到 Qwen3.8-Flash-Next 在 Nvida GPU 上每用户达到 685 output tokens/s。期待社区进一步释放 Qwen 的推理潜力!
正文
Congrats to @lightseekorg on the impressive TokenSpeed results! 🚀 Great to see Qwen3.8-Flash-Next reaching 685 output tokens/s per user on Nvida GPUs. Excited to see the community unlock more of Qwen’s inference potential!
685 output tokens/s per user on @Alibaba_Qwen Qwen3.8-Flash-Next. Running TokenSpeed on 4× NVIDIA GB300 with NVFP4. A look at the kernel and serving optimizations behind the results: 👉 https://lightseek.org/blog/tokenspeed-qwen3-8-flash-next.html ⭐ https://github.com/lightseekorg/tokenspeed在 X 查看被引用的帖子
来源:Qwen · x.com