LMSYS：Blog（Chatbot Arena 团队）·· 14 天前AI 评分47
SGLang 如何用 Score API 与 MIS 扩展 JEV 类决策模型服务
Blog Scaling JEV-like Decision Models with SGLang A customer asks whether an order has shipped. An agent already has the order ID and three possible next actions: query the order-status service, search general delivery-policy documentation, or ask th... Sundara Raman Ramachandran, Chuanrui Zhu, Qing Lan, Shri Rajamanikandan Vasudevan, Jian Sheng, I-Ting Chen, Fedor Borisyuk
AI 导读
SGLang 团队介绍用 Score API 与多条目评分（MIS）服务 JEV 类决策模型：/v1/score 通过 label_token_ids 显式请求标签 token 分数，MIS 在单次请求内复用共享 query 计算并隔离各候选。
整理与数据来源：AIHOT
来源：LMSYS：Blog（Chatbot Arena 团队） · lmsys.org