arXiv:cs.AI· Dario Petri, Luca Mari·· 21 小时前
不确定性评估:连接机器学习与测量科学
Uncertainty Evaluation: Bridging Machine Learning and Measurement Science
AI 导读
该论文探讨机器学习不确定性评估与测量科学之间的概念类比,借鉴计量学从误差方法到 GUM 框架的演变,指出将 ML 不确定性分为偶然与认知两类本质上依赖模型,不足以构成统一评估框架。论文主张采用受计量学启发的方法,系统性识别、量化并传播不确定性贡献,从而为评估单个预测的可信度提供严谨且可迁移的框架。
正文
Title:Uncertainty Evaluation: Bridging Machine Learning and Measurement Science
Abstract:Reliable uncertainty evaluation is essential for assessing the trustworthiness of machine learning (ML) predictions, particularly in safety-critical applications. This paper explores conceptual analogies between uncertainty evaluation in ML and measurement science, drawing on the evolution of metrology from error-based approaches to the framework established by the Guide to the Expression of Uncertainty in Measurement (GUM). Particular attention is devoted to the distinction between process-level and result-level quality and to the limitations of the conventional classification of ML uncertainty into aleatoric and epistemic components. It is argued that this dichotomy, similarly to the traditional distinction between random and systematic measurement errors, is inherently model-dependent and provides an insufficient basis for a unified uncertainty evaluation framework. Further analogies between machine learning and measurement field of knowledge are identified concerning distribution shifts, anomalous operating conditions, and the validity of uncertainty evaluation. Building on the proposed considerations, the paper advocates a metrology-inspired approach based on the systematic identification, quantification, and propagation of uncertainty contributions. By extending the methodology already established in measurement science to ML, this approach could offer a potentially rigorous, consistent, and transferable framework for evaluating the trustworthiness of individual predictions.
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.18066 [cs.LG] |
| (or arXiv:2610.18066v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.18066 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Luca Mari [view email]
[v1]
Tue, 13 Oct 2026 09:51:49 UTC (230 KB)
来源:arXiv:cs.AI · arxiv.org