LMSYS：Blog（Chatbot Arena 团队）·· 16 小时前AI 评分47
SGLang 如何用 Score API 与共享上下文加速 JEV 类决策模型
Blog Scaling JEV-like Decision Models with SGLang A customer asks whether an order has shipped. An agent already has the order ID and three possible next actions: query the order-status service, search general delivery-policy documentation, or ask th... Sundara Raman Ramachandran, Chuanrui Zhu, Qing Lan, Shri Rajamanikandan Vasudevan, Jian Sheng, I-Ting Chen, Fedor Borisyuk September 25, 2026
AI 导读
SGLang 团队介绍用 /v1/score 接口为 JEV 类决策模型做标签打分，调用方通过 label_token_ids 显式指定标签，无需依赖生成结果的 top-k logprobs。
来源：LMSYS：Blog（Chatbot Arena 团队） · lmsys.org