arXiv：cs.LG· Junyi Zou, Avrova Donz·· 6 小时前
MMLA-RSI：通过 RTT 与 RTMA 实现递归自我改进
MMLA-RSI: Recursive Self-Improvement through RTT and RTMA
AI 导读
MMLA-RSI 提出记忆中介学习架构下的递归自我改进方案，包含两条路线：RTT 改变策略状态 Φ，RTMA 改变权威记忆 M，且各自的适配方法本身也可被改进。在四候选程序选择中，保留 LARC 反馈更新使两种已训练初始化的期望误差分别降低 24.65 和 36.65 个百分点。两条递归路线及其联合实现已在技术报告中给出规格，但其有益递归链与发现效率仍待评估。
正文
Abstract:An agent can improve its behavior within an unresolved problem by changing how it acts and which experience it retains. We propose MMLA-RSI, a recursive self-improvement scheme with two implementations in Memory-Mediated Learning Architecture: Reasoning-Time Training (RTT) changes the policy state $\Phi$, while Reasoning-Time Memory Adaptation (RTMA) changes authoritative memory $M$. Each route also makes its adaptation method an object of improvement. A current numerical updater trains the policy proposing its successor; a current memory manager chooses the records available to the process proposing its successor. An independently admitted successor takes over the same role in the next generation. We give bounded executable rule languages, shared task/proposal interfaces, and one algorithm for either route or their composition. The RTT instance changes scalar schedules in a clipped-momentum update. The RTMA instance chooses NULL or a complete-row write with possible eviction. A fixed interpreter, trusted committer, and independent evaluator bound what can change. State versions, read closures, and conditional properties describe causal execution, accepted transitions, and finite work. Existing numerical-component studies motivate the construction. In four-candidate program selection, retaining LARC feedback updates reduces expected error by 24.65 and 36.65 percentage points for two trained initializations. In chronological continuous-integration replay, feedback binding is positive while retention increases loss. Completed SQL studies improve substantially over an unadapted substrate but do not establish the required additional online benefit. These results characterize their declared components. The two recursive routes and their joint realization are specified here; their beneficial recursive chains and discovery efficiency remain to be evaluated.
| Comments: | Technical report. 24 pages, 5 figures, 12 tables |
| Subjects: | Computation and Language (cs.CL); Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.20294 [cs.CL] |
| (or arXiv:2610.20294v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.20294 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Junyi Zou [view email]
[v1]
Wed, 14 Oct 2026 14:47:50 UTC (356 KB)
来源：arXiv：cs.LG · arxiv.org