arXiv:cs.LG· Viet The Nguyen, Vijay Prakash Dwivedi, Gunther Gust·· 4 小时前
重新审视关系深度学习的简单基线
Revisiting Simple Baselines for Relational Deep Learning
AI 导读
研究重新评估了关系深度学习(RDL)中简单传播方法的有效性:在 RelBench 的分类与回归任务上,用邻域过滤特征训练的 MLP 在多数任务上优于仅用目标实体特征的 MLP,并恢复了异构 GNN 相当一部分性能。
正文
Abstract:Relational deep learning has emerged as a powerful paradigm for learning end-to-end predictive models over relational databases by representing them as temporal heterogeneous graphs. Recent advances based on graph neural networks and Transformers have achieved strong performance across diverse domains. However, the effectiveness of simpler relational baselines remains underexplored, making it difficult to assess how much architectural complexity is needed to achieve strong predictive performance. Motivated by the observation that predictive signals arise from target attributes, relational attributes, and historical labels, we revisit how effectively these signals can be exploited using simple propagation methods. We adapt fixed low-pass feature propagation to relational entity graphs and train an MLP for prediction. The resulting predictions are further refined using Correct-and-Smooth, a graph-based label propagation algorithm that incorporates historical labels over task-specific meta-graphs connecting target entities. Across classification and regression tasks on RelBench, an MLP trained on neighborhood-filtered features outperforms one using only target-entity features on most tasks and recovers a substantial portion of the performance of heterogeneous GNNs. Correct-and-Smooth provides further gains from historical labels, although applying it requires a separately constructed meta-graph because connections among target entities are not directly specified by the relational entity graph. Together, our studies revisit the effectiveness of established propagation methods as simple RDL baselines while identifying canonical meta-graph construction as a key challenge for effective label propagation.
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.20534 [cs.LG] |
| (or arXiv:2610.20534v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.20534 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Viet Nguyen [view email]
[v1]
Wed, 14 Oct 2026 17:30:17 UTC (199 KB)
来源:arXiv:cs.LG · arxiv.org