arXiv:cs.AI· Weida Liang, Yiyou Sun, Shuyuan Nan, Chuang Li, Dawn Song, Kenji Kawaguchi·· 22 小时前
人类与模型策略差异:Selective Strategy Retrieval 提升数学推理可执行性
Strategy Executability in Mathematical Reasoning: Leveraging Human-Model Differences for Effective Guidance
AI 导读
研究揭示数学推理中策略"可用性"与"可执行性"存在系统性脱节:人类和模型生成的策略在结构上依领域不同而差异显著,导致指导效果出现来源依赖的反转。为此提出 Selective Strategy Retrieval(SSR),一种在推理时显式建模可执行性、选择性检索并组合策略的框架。
正文
Abstract:Example-based guidance is widely used to improve mathematical reasoning at inference time, yet its effectiveness is highly unstable across problems and models-even when the guidance is correct and problem-relevant. We show that this instability arises from a previously underexplored gap between strategy usage-whether a reasoning strategy appears in successful solutions-and strategy executability-whether the strategy remains effective when instantiated as guidance for a target model. Through a controlled analysis of paired human-written and model-generated solutions, we identify a systematic dissociation between usage and executability: human- and model-derived strategies differ in structured, domain-dependent ways, leading to complementary strengths and consistent source-dependent reversals under guidance. Building on this diagnosis, we propose Selective Strategy Retrieval (SSR), a test-time framework that explicitly models executability by selectively retrieving and combining strategies using empirical, multi-route, source-aware signals. Across multiple mathematical reasoning benchmarks, SSR yields reliable and consistent improvements over direct solving, in-context learning, and single-source guidance, improving accuracy by up to $+13$ points on AIME25 and $+5$ points on Apex for compact reasoning models. Code and benchmark are publicly available at: this https URL.
| Comments: | Accepted at ICML 2026 |
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL) |
| Cite as: | arXiv:2602.22583 [cs.AI] |
| (or arXiv:2602.22583v2 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2602.22583 arXiv-issued DOI via DataCite |
Submission history
From: Weida Liang [view email]
[v1]
Thu, 26 Feb 2026 03:34:23 UTC (1,991 KB)
[v2]
Mon, 12 Oct 2026 11:41:16 UTC (1,998 KB)
来源:arXiv:cs.AI · arxiv.org