arXiv:cs.LG· Yue Hou, Ruomei Liu, Yingke Su, Junran Wu, Ke Xu·· 3 小时前AI 评分36
EMC:面向非平稳分布漂移图学习的高效记忆结晶框架
Efficient Memory Crystallization for Graph Learning under Non-Stationary Distribution Shifts
AI 导读
研究者提出免训练测试时框架 Efficient Memory Crystallization(EMC),通过闭式解将每个到来的图域蒸馏为紧凑记忆,无需生成辅助模块即可应对持续协变量漂移。EMC 以状态演化记忆建模域间依赖,并给出比直接适配更紧的泛化误差界。实验显示其性能超越 SOTA 基线,平均运行时间降低 87.4%、GPU 显存占用降低 92.4%。
正文
Abstract:Deep graph learning models deployed in real-world systems often need to cope with non-stationary environments, where the underlying graph distribution drifts continually over time. Prevailing solutions rely on training auxiliary generative modules to synthesize memory graphs for cross-domain adaptation, which incurs substantial computational overhead and scales poorly under prolonged distribution shifts. We argue that a more economical path exists: rather than generating memory, one can crystallize it. To this end, we propose Efficient Memory Crystallization (EMC), a training-free test-time framework that distills each incoming graph domain into a compact, semantically faithful memory through a closed-form solution to a memory-oriented distribution-matching objective, thereby eliminating redundant domain information under continual covariate shifts. To preserve both generalizability and adaptability as the model traverses a long sequence of target domains, EMC further models inter-domain dependencies through state-evolving memories and admits a theoretically grounded, tighter generalization error bound than direct adaptation. Extensive experiments demonstrate the superior performance of EMC over state-of-the-art baselines on graphs under non-stationary distribution shifts, while reducing average runtime by 87.4% and GPU memory consumption by 92.4% relative to the recent competitor, making continual graph adaptation practical at scale.
| Comments: | Accepted by the 40th Conference on Neural Information Processing Systems (NeurIPS 2026) |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.02795 [cs.LG] |
| (or arXiv:2610.02795v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.02795 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yue Hou [view email]
[v1]
Fri, 2 Oct 2026 04:35:59 UTC (3,675 KB)
来源:arXiv:cs.LG · arxiv.org