跳到正文
arXiv:cs.LG· Angel Wang, Dominique Perrault-Joncas, Alvaro Maggiar, Dean Foster, Carson Eisenach·· 3 小时前AI 评分40

从反事实模拟器推演中预测:一项 Sim2Real 评估

Forecasting from Counterfactual Simulator Rollouts: A Sim2Real Evaluation

AI 导读

研究用两个真实库存控制部署评估了模拟器训练预测模型的 Sim2Real 迁移,从模拟器保真度、零样本迁移和真实数据累积后的自适应三方面展开。模拟器训练的预测器 MAPE 低于用历史真实数据训练的相同架构,Study 1 降低 1.2-3.1 个百分点,Study 2 降低 12.5-18.7 个百分点。部署后用早期真实观测做轻量校准,误差最多再降 2.5 个百分点。

正文

View PDF HTML (experimental)

Abstract:Deploying a new decision policy creates a cold-start problem for prediction models whose targets depend on the policy's actions: historical observations reflect earlier policies, while real observations under the new policy are not yet available. Simulation offers a way to address this gap by rolling out the target policy across counterfactual scenarios and using the resulting trajectories to learn how the system responds to those controls. The simulation-to-reality (Sim2Real) transfer of this simulator-trained model can then be backtested by evaluating it against real observations from past deployments. Using two real-world inventory-control deployments, we evaluate this process from three angles: simulator fidelity, zero-shot transfer to real behavior, and adaptation as real target-policy observations accumulate. The simulator-trained forecaster achieves lower point-estimate mean absolute percentage error (MAPE) than the same architecture trained on historical real data, reducing MAPE by 1.2-3.1 percentage points in Study 1 and 12.5-18.7 points in Study 2. After deployment, lightweight calibration using early real observations further reduces error by up to 2.5 percentage points. These results provide empirical evidence that simulator-generated counterfactual data can support cold-start forecasting under a new policy, and the resulting model can be further refined as real deployment data become available.
Comments: 15 pages, 3 figures, 9 tables
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2610.03662 [cs.LG]
  (or arXiv:2610.03662v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2610.03662

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Angel Wang [view email]
[v1] Fri, 2 Oct 2026 17:37:14 UTC (1,206 KB)

来源:arXiv:cs.LG · arxiv.org