arXiv:cs.LG· Yuqicheng Zhu·· 4 小时前AI 评分29
知识图谱表示学习中的不确定性研究
Uncertainty in Representation Learning on Knowledge Graphs
AI 导读
一篇博士论文系统研究了知识图谱嵌入(KGE)中的三类不确定性:来自不完整或有噪声输入的知识不确定性、训练随机性带来的算法不确定性,以及模型输出的预测不确定性。为此提出基于投票的聚合框架缓解训练不稳定性,并将 conformal prediction 适配到 KGE 以构建具有无分布覆盖保证的答案集,同时为带置信度评分的三元组开发统计有效的预测区间。
正文
Abstract:Knowledge graph embedding (KGE) methods represent entities and predicates in continuous vector spaces to infer missing knowledge. Despite strong benchmark performance, their predictions often lack principled reliability guarantees, limiting their use in high-stakes applications. Moreover, uncertainty arises throughout the KGE pipeline, from incomplete or probabilistic input knowledge to stochastic training and prediction. This thesis systematically investigates three sources of uncertainty in KGE: knowledge uncertainty, arising from incomplete, noisy, or probabilistic input knowledge; algorithmic uncertainty, induced by randomness in model training; and predictive uncertainty, concerning the reliability of model outputs. To address algorithmic uncertainty, the thesis demonstrates that models trained under identical settings can produce substantially different predictions and introduces a voting-based aggregation framework to mitigate this instability. To quantify predictive uncertainty, it adapts conformal prediction to KGE, constructing answer sets with distribution-free coverage guarantees and extending them to provide predicate-conditional reliability guarantees. To support reasoning under knowledge uncertainty, it develops statistically valid prediction intervals for confidence-scored triples and an embedding-based approach to approximate probabilistic reasoning over statistical ontologies with formal soundness guarantees. Together, these complementary, model-agnostic methods provide a practical and theoretically grounded approach to uncertainty in KGE, advancing beyond predictive accuracy toward reliable and uncertainty-aware knowledge graph reasoning.
| Comments: | Doctoral Dissertation, 255 pages |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.06974 [cs.LG] |
| (or arXiv:2610.06974v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.06974 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yuqicheng Zhu [view email]
[v1]
Sat, 3 Oct 2026 23:02:06 UTC (3,206 KB)
来源:arXiv:cs.LG · arxiv.org