arXiv:cs.AI· Hui Chen, Xuan Qi, James Xu Zhao, Zhaopeng Feng, Shilong Liu, Kuang Xu, Pang Wei Koh, Bryan Hooi·· 4 小时前AI 评分48
FrugalEvo:面向成本感知的 LLM 引导程序进化
FrugalEvo: Towards Cost-Aware LLM-Guided Program Evolution
AI 导读
FrugalEvo 是一个成本感知的 LLM 引导进化框架,由高成本强模型探索解题策略、低成本模型实现并迭代优化代码,同时通过最大化前缀共享提升缓存复用。团队提出 Budget-Aware Area Under the Curve(BA-AUC)指标衡量固定成本预算下的解质量,在 10 个数学与系统优化任务中 9 个取得更高 BA-AUC。
正文
Abstract:LLM-guided evolutionary methods, such as AlphaEvolve, have emerged as powerful approaches for challenging computational optimization problems, such as circle packing. However, prior work typically optimizes performance gain over a fixed number of iterations. We argue that practical optimization should maximize gain per unit cost. To this end, we propose FrugalEvo, a cost-aware evolutionary framework where a stronger, higher-cost LLM explores solution strategies, and a cheaper LLM implements them and iteratively refines the resulting code. We also design a cache-efficient evolution process, where our harness and prompts maximize the sharing of prefixes across different evolution steps, to improve cache reuse. To measure solution quality throughout a fixed cost budget, we introduce Budget-Aware Area Under the Curve (BA-AUC), defined as the area under the best-so-far evaluation score curve over cumulative LLM cost, up to the budget. Across 10 mathematical and systems optimization tasks, FrugalEvo matches or surpasses state-of-the-art baselines, including OpenEvolve, ShinkaEvolve, AdaEvolve, and EvoX, in final solution quality and achieves higher BA-AUC on 9 tasks. It also achieves higher average performance than these baselines on 10 algorithmic optimization tasks from ALE-Bench-Lite. Notably, on circle packing, FrugalEvo achieves new state-of-the-art performance with GPT-5.6 Terra and Luna for only 1.68 USD and with GLM-5.3 and its Flash variant for only 0.55 USD, matching or surpassing all baselines, including multi-agent methods such as CORAL and SwarmResearch, which cost approximately 50 USD on average.
| Comments: | 17 pages, 4 figures |
| Subjects: | Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.03675 [cs.NE] |
| (or arXiv:2610.03675v1 [cs.NE] for this version) | |
| https://doi.org/10.48550/arXiv.2610.03675 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Hui Chen [view email]
[v1]
Fri, 2 Oct 2026 17:44:05 UTC (718 KB)
来源:arXiv:cs.AI · arxiv.org