跳到正文
arXiv:cs.LG· Fanchen Bu, Fan Li, Geon Lee, Sunwoo Kim, Xiaoyang Wang, Renaud Lambiotte, Kijung Shin·· 4 小时前AI 评分37

高阶模型赢在高阶原因吗?重新审视超图学习的性能增益

Do Higher-Order Models Win for Higher-Order Reasons? Rethinking Performance Gains in Hypergraph Learning

AI 导读

研究提出受控的性能归因框架,在保持低阶(成对)信息不变的前提下扰动高阶信息,覆盖三类任务的 25 个常用超图学习 benchmark。结果显示高阶模型原本优于低阶基线,但在扰动后仍保留大部分优势,说明这部分增益无需高阶信息即可获得;为低阶基线增加更丰富的成对权重、更多成对特征传播步数和归一化可缩小剩余差距。

正文

View PDF HTML (experimental)

Abstract:Higher-order models (e.g., hypergraph neural networks) often outperform lower-order baselines on hypergraph learning benchmarks, and their advantages are commonly attributed to their ability to exploit higher-order information. However, better performance alone does not establish this explanation. We therefore ask: Do higher-order models win for higher-order reasons? To investigate this question, we introduce a controlled performance-attribution framework that perturbs higher-order information while preserving the lower-order, i.e., pairwise, information. Across 25 commonly used hypergraph learning benchmarks spanning three tasks, we frequently observe an intriguing pattern: higher-order models originally outperform lower-order baselines, yet retain most of their advantage after perturbation. This suggests that much of the observed advantage remains achievable without the higher-order information. We then investigate potential lower-order explanations for these remaining gaps. We find that simple additions to a lower-order baseline, e.g., richer pairwise weighting, more steps of pairwise feature propagation, and normalization, reduce the remaining performance gaps, supporting lower-order explanations for part of the observed advantage. Our analysis calls for the hypergraph learning community to rethink performance attribution by distinguishing performance gains from their explanations, adopt stronger lower-order baselines, and use suitable benchmarks that better test the value of higher-order information.
Subjects: Machine Learning (cs.LG); Social and Information Networks (cs.SI)
Cite as: arXiv:2610.07981 [cs.LG]
  (or arXiv:2610.07981v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2610.07981

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Fanchen Bu [view email]
[v1] Tue, 6 Oct 2026 08:44:38 UTC (386 KB)

来源:arXiv:cs.LG · arxiv.org