arXiv:cs.AI(全量分类)· Jinzhi Bu, Haixin Tang, Huanan Zhang·· 5 小时前AI 评分39
OSCAR 框架如何用 LLM 路由实现优化建模
OR for AI That Does OR: Routing LLMs up the Escalator inside the OSCAR Framework
AI 导读
OSCAR 框架通过 Simulator、Coder、Reviewer 三组件,将 LLM 生成的优化模型与标注决策样例比对验证,在五个基准问题上用两个可单 GPU 本地部署的小型开源权重 LLM 达到 95% 至 100% 准确率,而这两个模型单次尝试准确率平均仅 29% 和 48%。
正文
Abstract:Large language models can translate business descriptions into optimization models, but executable code may misrepresent constraints or objectives. A solver can then return an optimal solution to the wrong problem. Even when the solution satisfies the intended operating rules, a better plan may exist. For organizations that repeatedly use optimization modeling, an LLM-based framework should produce accurate formulations at low cost and, ideally, run locally. We study how to verify improvements and allocate attempts across LLMs that differ in price and capability. We develop OSCAR (Optimization modeling by Simulator, Coder, And Reviewer), which uses an offline Simulator certified against labeled decision examples to compare candidates and continues searching beyond feasibility. We model the search for the next certified improvement as sequential decisions under unobserved difficulty: which LLMs to call and when to stop. In a simplified known-prior setting, we give conditions under which cost-ordered escalation is optimal. For general menus, we derive a prior-free competitive guarantee. On five benchmark problems, OSCAR achieves 95% to 100% accuracy at the reported settings using two small open-weight LLMs, each deployable locally on a single GPU. Their single-attempt accuracies average 29% and 48%. In five runs per problem, Codex and Claude Code incur average token costs 3.1 and 5.8 times OSCAR's, respectively. OSCAR supports open-weight models locally or in the cloud, depending on budget and confidentiality requirements. Firms should maintain labeled decision examples of feasible and infeasible decisions to clarify plain-language operating rules. OSCAR follows these labels when an LLM's interpretation conflicts with them. As LLM capabilities and prices change, OSCAR's simple operating rules and adjustable settings help firms adapt their model choices and benefit from these advances.
| Subjects: | Artificial Intelligence (cs.AI); Optimization and Control (math.OC) |
| Cite as: | arXiv:2610.00912 [cs.AI] |
| (or arXiv:2610.00912v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.00912 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Jinzhi Bu [view email]
[v1]
Thu, 1 Oct 2026 01:43:34 UTC (1,326 KB)
来源:arXiv:cs.AI(全量分类) · arxiv.org