arXiv:cs.LG· William Lavery, Jodie A. Cochrane, John T. Nardini, Sara Hamis·· 3 小时前AI 评分28
生物信息神经网络方程学习的超参数选择工作流
Hyperparameter selection for equation learning with biologically-informed neural networks
AI 导读
研究提出一套用于生物信息神经网络(BINNs)方程学习的超参数选择诊断工作流,可在未知真实方程时使用。该工作流围绕三个问题展开:更大网络容量的收益是否值得成本、更多训练轮次是否持续降低验证损失、学习到的项是否随容量和训练增加而停止变化。
正文
Abstract:Biologically-informed neural networks (BINNs) have emerged as a flexible subclass of physics-informed neural networks (PINNs) for learning terms in partial differential equations from data. BINNs are particularly suited for biological systems, where the governing equations are highly nonlinear and only partially known a priori, and where data observations are often sparse, noisy, and incomplete. However, applying BINNs effectively in practice depends critically on hyperparameter selection, which remains a central challenge in equation-learning frameworks. Hyperparameters are often chosen heuristically and only cursorily documented, which limits the reproducibility of results and the transferability of methods. We present a diagnostic workflow for hyperparameter selection that can be used when the ground-truth equations are not known. The workflow is guided by three main questions: (1) Are the benefits of greater network capacity worth the cost? (2) Do more training epochs keep reducing the validation loss? (3) Do the learned terms stop changing as network capacity and training increase? We apply our workflow to synthetic systems of varying complexity with known ground truth, spanning diffusion and growth right-hand side terms and data ranging from 1D+t to 2D+t. We demonstrate that the validation loss generally follows the true error in the learned terms and distil practical rules of thumb for selecting hyperparameters in the BINN architecture. By providing a structured workflow, practical guidelines, and suggested starting values for hyperparameter selection, this work lowers the barrier to BINN-based equation learning.
| Comments: | 18 pages, 11 figures, 2 tables (main text); 29 pages, 13 figures, 1 algorithm (appendices and supplementary material) |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.02954 [cs.LG] |
| (or arXiv:2610.02954v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.02954 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: William Lavery Mr [view email]
[v1]
Fri, 2 Oct 2026 07:46:40 UTC (12,242 KB)
来源:arXiv:cs.LG · arxiv.org