arXiv:cs.LG· Chao He, Jianyu Xu, Xinyi Guo, Ruiqi Liu, Haobin Ding, Ruiqi He, Dongqing Song·· 4 小时前AI 评分34
FreshCast:让冻结的时序预测器持续刷新检索记忆
Retrieval Is Not Enough: Refreshing Memory for Frozen Time-Series Forecasters
AI 导读
FreshCast 是一个即插即用检索框架,保持预测器冻结,用新观测持续更新非参数记忆,并通过关系核回归生成记忆预测、在验证集上闭式校准其权重。在七个基准、十种预测架构上,输入长度 96 和 720 时平均 MSE 分别降低 14.6% 和 5.6%,优于所评估的检索增强与在线基线;消融显示训练结束即冻结记忆会失去大部分收益。
正文
Abstract:Retrieval-augmented time-series forecasting uses the continuations of historical segments similar to the current context as references for a forecaster. Most existing methods build the retrieval memory once from the training segment, leaving observations revealed after deployment unavailable as references, and generally do not calibrate how much the retrieved information should influence a frozen forecaster. We identify two key determinants of retrieval utility for a frozen forecaster: whether the history still reflects the current state, and whether the correction it induces aligns with the forecaster's residual errors, an alignment that can shift between validation and deployment when the memory becomes stale. We propose FreshCast, a plug-in retrieval framework that keeps the forecaster frozen, continuously updates a non-parametric memory with new observations, forms a memory forecast through relational kernel regression, and calibrates its weight in closed form on the validation segment. Under a simplified generative model, we characterize the optimal combination gain through the second-order relation between forecaster error and memory correction, and show that a sufficiently long look-back can make periodic memory information redundant. Across seven benchmarks and ten forecasting architectures, FreshCast reduces average MSE for every evaluated forecaster and input length, by 14.6% and 5.6% at input lengths 96 and 720, and achieves lower MSE than the evaluated retrieval-augmented and online baselines in their comparison settings. Ablations show that freezing the memory at the end of training removes most of the gain, identifying post-training observations as a primary source of improvement. For a frozen forecaster, useful historical references must remain timely and provide information that helps correct its remaining errors.
| Comments: | 13 pages, 6 figures, 6 tables |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.07834 [cs.LG] |
| (or arXiv:2610.07834v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.07834 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Jianyu Xu [view email]
[v1]
Tue, 6 Oct 2026 06:33:16 UTC (1,569 KB)
来源:arXiv:cs.LG · arxiv.org