StepFun· @StepFun_ai · X·· 8 小时前AI 评分51
AI 导读
阶跃星辰官方发推感谢 RadixArk 为 Step 5 Preview 提供生产环境推理支持。被引用的 RadixArk 表示祝贺 Step 5 Preview 开放权重,并称其基于 SGLang 的缓存感知路由方案已在真实生产流量下为 StepFun 第一方 API 提供大规模推理服务,兼顾 token 成本与延迟要求。
正文
Thanks to @radixark for helping power Step 5 Preview in production!
Great to see SGLang enabling efficient, scalable inference for real-world workloads. Excited to keep pushing the boundaries together.
Congratulations to @StepFun_ai on Step 5 Preview going open weights! RadixArk is proud to help power StepFun's first-party production API with SGLang at scale. Production inference means great token economics under strict latency requirements. SGLang and its cache-aware routing stack now bring that to Step 5 Preview in proven production traffic. Building with Step 5 Preview? Deploy with SGLang today!在 X 查看被引用的帖子
来源:StepFun · x.com