arXiv:cs.LG· Anthony Zhou, Amir Barati Farimani, Shirley Ho, Rudy Morel·· 4 小时前AI 评分33
跨域预训练提升稳态神经 CFD 代理模型泛化能力
Cross-Domain Pretraining for Steady-State Neural CFD Surrogates
AI 导读
研究发现,跨域预训练能显著提升神经 CFD 代理模型在未见过数据集上的零样本和少样本性能。相比从零训练,微调跨域预训练模型在相同样本量下误差可降低 2-3 倍,达到相同误差所需样本量减少 8 倍,且该增益与架构无关并随模型规模和预训练数据多样性提升。研究还表明,直接汇集稳态数据集即可有效实现跨域预训练。
正文
Abstract:Neural surrogates for computational fluid dynamics (CFD) have the potential to greatly enhance engineering innovation through accelerating simulation. However, the primary limitation for neural surrogates is the lack of generalization to geometries and applications beyond the training set, which is significant given the diversity of engineering scenarios. Currently, this is addressed by generating a new dataset for a specific application; however, this requires running costly numerical solvers. In this work, we take a step toward addressing this by studying neural surrogates trained across different geometries, boundary conditions, and fidelities. We find that cross-domain pretraining improves zero- and few-shot performance on held-out datasets relative to both training from scratch and transferring from domain-specific experts. In particular, finetuning a pretrained, cross-domain model can achieve 2-3x lower errors at the same sample size and use 8x fewer samples to achieve the same error, compared to training from scratch. This benefit is architecture agnostic and improves with model size and pretraining dataset diversity. Furthermore, we study how and why cross-domain pretraining works in CFD surrogates, and find that simply pooling steady-state datasets is both sufficient and effective. Given the high cost of generating CFD data, leveraging existing datasets through cross-domain pretraining will likely be a valuable strategy as future surrogates expand to tackle new problems and use cases.
| Comments: | 43 pages, 25 figures |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.10398 [cs.LG] |
| (or arXiv:2610.10398v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.10398 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Anthony Zhou [view email]
[v1]
Wed, 7 Oct 2026 16:49:50 UTC (38,066 KB)
来源:arXiv:cs.LG · arxiv.org