arXiv:cs.LG· Fanchen Bu, Fan Li, Geon Lee, Sunwoo Kim, Xiaoyang Wang, Renaud Lambiotte, Kijung Shin·· 4 小时前AI 评分37
高阶模型赢在高阶原因吗?重新审视超图学习的性能增益
Do Higher-Order Models Win for Higher-Order Reasons? Rethinking Performance Gains in Hypergraph Learning
AI 导读
研究提出受控的性能归因框架,在保持低阶(成对)信息不变的前提下扰动高阶信息,覆盖三类任务的 25 个常用超图学习 benchmark。结果显示高阶模型原本优于低阶基线,但在扰动后仍保留大部分优势,说明这部分增益无需高阶信息即可获得;为低阶基线增加更丰富的成对权重、更多成对特征传播步数和归一化可缩小剩余差距。
正文
Abstract:Higher-order models (e.g., hypergraph neural networks) often outperform lower-order baselines on hypergraph learning benchmarks, and their advantages are commonly attributed to their ability to exploit higher-order information. However, better performance alone does not establish this explanation. We therefore ask: Do higher-order models win for higher-order reasons? To investigate this question, we introduce a controlled performance-attribution framework that perturbs higher-order information while preserving the lower-order, i.e., pairwise, information. Across 25 commonly used hypergraph learning benchmarks spanning three tasks, we frequently observe an intriguing pattern: higher-order models originally outperform lower-order baselines, yet retain most of their advantage after perturbation. This suggests that much of the observed advantage remains achievable without the higher-order information. We then investigate potential lower-order explanations for these remaining gaps. We find that simple additions to a lower-order baseline, e.g., richer pairwise weighting, more steps of pairwise feature propagation, and normalization, reduce the remaining performance gaps, supporting lower-order explanations for part of the observed advantage. Our analysis calls for the hypergraph learning community to rethink performance attribution by distinguishing performance gains from their explanations, adopt stronger lower-order baselines, and use suitable benchmarks that better test the value of higher-order information.
| Subjects: | Machine Learning (cs.LG); Social and Information Networks (cs.SI) |
| Cite as: | arXiv:2610.07981 [cs.LG] |
| (or arXiv:2610.07981v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.07981 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Fanchen Bu [view email]
[v1]
Tue, 6 Oct 2026 08:44:38 UTC (386 KB)
来源:arXiv:cs.LG · arxiv.org