跳到正文
arXiv:cs.LG· Anthony Bardou, Patrick Thiran·· 5 小时前AI 评分32

时变贝叶斯优化(TVBO)的渐近性能分析

Asymptotic Performance of Time-Varying Bayesian Optimization

AI 导读

研究首次为时变贝叶斯优化(TVBO)算法的累积遗憾给出上界与算法无关的下界,并推导出TVBO算法具备无遗憾(no-regret)性质的充分条件,回答了瞬时遗憾能否渐近消失的问题。该分析首次覆盖实践中所有主要类别的平稳核函数。

正文

View PDF HTML (experimental)

Abstract:Time-Varying Bayesian Optimization (TVBO) is the go-to framework for optimizing a time-varying black-box objective function that may be noisy and expensive to evaluate, but its excellent empirical performance remains to be understood theoretically. Is it possible for the instantaneous regret of a TVBO algorithm to vanish asymptotically, and if so, when? We answer this question of great importance by providing upper bounds and algorithm-independent lower bounds for the cumulative regret of TVBO algorithms. In doing so, we provide important insights about the TVBO framework and derive sufficient conditions for a TVBO algorithm to have the no-regret property. To the best of our knowledge, our analysis is the first to cover all major classes of stationary kernel functions used in practice.
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:2505.13012 [stat.ML]
  (or arXiv:2505.13012v3 [stat.ML] for this version)
  https://doi.org/10.48550/arXiv.2505.13012

arXiv-issued DOI via DataCite

Submission history

From: Anthony Bardou [view email]
[v1] Mon, 19 May 2025 11:55:02 UTC (415 KB)
[v2] Mon, 20 Oct 2025 15:31:34 UTC (460 KB)
[v3] Fri, 2 Oct 2026 07:47:52 UTC (786 KB)

来源:arXiv:cs.LG · arxiv.org