跳到正文
arXiv:cs.LG· Kornelius Raeth, Nicole Ludwig·· 5 小时前AI 评分30

面向基于样本的生成模型的决策感知训练

Decision-Aware Training for Sample-Based Generative Models

AI 导读

研究者提出决策感知训练方法,在 energy score 目标上增加可微决策损失,直接惩罚依据模型预测行动所产生的成本,且该决策损失本身是 proper scoring rule。方法通过可微优化层计算决策损失,梯度集中于成本敏感区域。在合成双峰分布、风电调度和防霜冻三个任务上验证,分别修正了模态权重、改善了稀有高成本尾部区域并提升了决策成本预判能力。

正文

View PDF HTML (experimental)

Abstract:Sample-based generative models are increasingly used for probabilistic forecasting in high-stakes decision settings, yet their training objectives are blind to the decision maker's cost structure. These models are commonly trained with strictly proper scoring rules, such as the energy score, which allocate their training signal in proportion to data density, with no awareness of where forecast errors are most costly for downstream decisions. We therefore propose decision-aware training for sample-based generative models, augmenting the energy score objective with a differentiable decision loss that directly penalises the cost incurred by acting on the model's forecast. This combined loss is theoretically grounded, as the decision loss is itself a proper scoring rule. We compute the decision loss via a differentiable optimisation layer. Its gradient concentrates in cost-sensitive regions of the output space, making the method's effects interpretable and predictable from the cost structure. We validate the method on one synthetic and two real-world tasks. In the synthetic task, the method corrects the mode weights of a learned bimodal distribution; in a wind power dispatch task, it concentrates improvements in the rare but costly tail region, and in a frost protection task, it improves how well the decision costs are anticipated. Our method yields generative models that retain full probabilistic forecasts while being better aligned with the decision maker's specific cost structure.
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Cite as: arXiv:2607.01171 [cs.LG]
  (or arXiv:2607.01171v2 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2607.01171

arXiv-issued DOI via DataCite

Submission history

From: Kornelius Raeth [view email]
[v1] Wed, 1 Jul 2026 17:02:23 UTC (5,581 KB)
[v2] Fri, 2 Oct 2026 09:57:22 UTC (10,121 KB)

来源:arXiv:cs.LG · arxiv.org