When and why PINNs fail to train: A neural tangent kernel perspective

28 July 2020

Papers citing "When and why PINNs fail to train: A neural tangent kernel perspective"

50 / 336 papers shown

Title
Geometry-aware framework for deep energy method: an application to structural mechanics with hyperelastic materials Thi Nguyen Khoa Nguyen T. Dairay Raphael Meunier Christophe Millet Mathilde Mougeot AI4CE PINN 33 0 0 06 May 2024
Loss Jump During Loss Switch in Solving PDEs with Neural Networks Zhiwei Wang Lulu Zhang Zhongwang Zhang Z. Xu 29 0 0 06 May 2024
Understanding the Difficulty of Solving Cauchy Problems with PINNs Tao Wang Bo-Lu Zhao Sicun Gao Rose Yu 41 1 0 04 May 2024
Towards General Neural Surrogate Solvers with Specialized Neural Accelerators Chenkai Mao Robert Lupoiu Tianxiang Dai Mingkun Chen Jonathan A. Fan AI4CE 32 4 0 02 May 2024
Physics-Informed Neural Networks: Minimizing Residual Loss with Wide Networks and Effective Activations Nima Hosseini Dashtbayaz G. Farhani Boyu Wang Charles X. Ling 26 0 0 02 May 2024
Accurate adaptive deep learning method for solving elliptic problems Jingyong Ying Yaqi Xie Jiao Li Hongqiao Wang 26 1 0 29 Apr 2024
Taper-based scattering formulation of the Helmholtz equation to improve the training process of Physics-Informed Neural Networks W. Dörfler Mehdi Elasmi Tim Laufer 25 0 0 15 Apr 2024
PINNACLE: PINN Adaptive ColLocation and Experimental points selection Gregory Kang Ruey Lau Apivich Hemachandra See-Kiong Ng K. H. Low 3DPC 29 18 0 11 Apr 2024
Label Propagation Training Schemes for Physics-Informed Neural Networks and Gaussian Processes Ming Zhong Dehao Liu Raymundo Arroyave U. Braga-Neto AI4CE SSL 16 1 0 08 Apr 2024
Grounding and Enhancing Grid-based Models for Neural Fields Zelin Zhao Fenglei Fan Wenlong Liao Junchi Yan 28 5 0 29 Mar 2024
Parametric Encoding with Attention and Convolution Mitigate Spectral Bias of Neural Partial Differential Equation Solvers Mehdi Shishehbor Shirin Hosseinmardi Ramin Bostanabad AI4CE 32 5 0 22 Mar 2024
Neural Parameter Regression for Explicit Representations of PDE Solution Operators Konrad Mundinger Max Zimmer S. Pokutta 42 0 0 19 Mar 2024
Large-scale flood modeling and forecasting with FloodCast Qingsong Xu Yilei Shi Jonathan Bamber Chaojun Ouyang Xiao Xiang Zhu AI4CE 39 12 0 18 Mar 2024
Learning Traveling Solitary Waves Using Separable Gaussian Neural Networks Siyuan Xing E. Charalampidis 13 0 0 07 Mar 2024
Emergent Equivariance in Deep Ensembles Jan E. Gerken Pan Kessel UQCV MDE 30 6 0 05 Mar 2024
Physics-Informed Neural Networks with Skip Connections for Modeling and Control of Gas-Lifted Oil Wells Jonas Ekeland Kittelsen Eric A. Antonelo E. Camponogara Lars Struen Imsland PINN AI4CE 26 4 0 04 Mar 2024
Geometry-Informed Neural Networks Arturs Berzins Andreas Radler Sebastian Sanokowski Sepp Hochreiter Johannes Brandstetter GAN AI4CE 30 1 0 21 Feb 2024
PARCv2: Physics-aware Recurrent Convolutional Neural Networks for Spatiotemporal Dynamics Modeling Phong C. H. Nguyen Xinlun Cheng Shahab Azarfar P. Seshadri Y. Nguyen Munho Kim Sanghun Choi H. Udaykumar Stephen Seung-Yeob Baek AI4CE PINN 33 1 0 19 Feb 2024
Deep adaptive sampling for surrogate modeling without labeled data Xili Wang Keju Tang Jiayu Zhai Xiaoliang Wan Chao Yang 27 2 0 17 Feb 2024
Kolmogorov n-Widths for Multitask Physics-Informed Machine Learning (PIML) Methods: Towards Robust Metrics Michael Penwarden H. Owhadi Robert M. Kirby AI4CE 22 1 0 16 Feb 2024
Exact Enforcement of Temporal Continuity in Sequential Physics-Informed Neural Networks Pratanu Roy Stephen T Castonguay PINN AI4TS 30 9 0 15 Feb 2024
RBF-PINN: Non-Fourier Positional Embedding in Physics-Informed Neural Networks Chengxi Zeng T. Burghardt A. Gambaruto AI4CE 13 3 0 13 Feb 2024
Feature Mapping in Physics-Informed Neural Networks (PINNs) Chengxi Zeng T. Burghardt A. Gambaruto 34 1 0 10 Feb 2024
The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks Andrea Bonfanti Giuseppe Bruno Cristina Cipriani 24 7 0 06 Feb 2024
PINN-BO: A Black-box Optimization Algorithm using Physics-Informed Neural Networks Dat Phan-Trong Hung The Tran A. Shilton Sunil R. Gupta 33 0 0 05 Feb 2024
Learning solutions of parametric Navier-Stokes with physics-informed neural networks M. Naderibeni Marcel J. T. Reinders L. Wu David Tax PINN 21 2 0 05 Feb 2024
Architectural Strategies for the optimization of Physics-Informed Neural Networks Hemanth Saratchandran Shin-Fang Chng Simon Lucey AI4CE 28 0 0 05 Feb 2024
DeepLag: Discovering Deep Lagrangian Dynamics for Intuitive Fluid Prediction Qilong Ma Haixu Wu Lanxiang Xing Jianmin Wang Mingsheng Long AI4CE 24 0 0 04 Feb 2024
Transolver: A Fast Transformer Solver for PDEs on General Geometries Haixu Wu Huakun Luo Haowen Wang Jianmin Wang Mingsheng Long AI4CE 38 40 0 04 Feb 2024
Challenges in Training PINNs: A Loss Landscape Perspective Pratik Rathore Weimu Lei Zachary Frangella Lu Lu Madeleine Udell AI4CE PINN ODL 33 39 0 02 Feb 2024
Preconditioning for Physics-Informed Neural Networks Songming Liu Chang Su J. Yao Zhongkai Hao Hang Su Youjia Wu Jun Zhu AI4CE PINN 33 5 0 01 Feb 2024
PirateNets: Physics-informed Deep Learning with Residual Adaptive Networks Sifan Wang Bowen Li Yuhan Chen P. Perdikaris AI4CE PINN 21 27 0 01 Feb 2024
Separable Physics-Informed Neural Networks for the solution of elasticity problems V. A. Es'kin Danil V. Davydov Julia V. Guréva Alexey O. Malkhanov Mikhail E. Smorkalov PINN AI4CE 18 2 0 24 Jan 2024
Binary structured physics-informed neural networks for solving equations with rapidly changing solutions Yanzhi Liu Ruifan Wu Ying Jiang PINN 19 2 0 23 Jan 2024
Space and Time Continuous Physics Simulation From Partial Observations Steeven Janny Madiha Nadri Wolf Julie Digne Christian Wolf AI4CE 34 5 0 17 Jan 2024
Multifidelity domain decomposition-based physics-informed neural networks and operators for time-dependent problems Alexander Heinlein Amanda A. Howard Damien Beecroft P. Stinis AI4CE 24 3 0 15 Jan 2024
Integration of physics-informed operator learning and finite element method for parametric learning of partial differential equations Shahed Rezaei Ahmad Moeineddin Michael Kaliske Markus Apel AI4CE 35 5 0 04 Jan 2024
Approximating Numerical Fluxes Using Fourier Neural Operators for Hyperbolic Conservation Laws Taeyoung Kim Myungjoo Kang AI4CE 15 2 0 03 Jan 2024
A Mathematical Guide to Operator Learning Nicolas Boullé Alex Townsend 29 36 0 22 Dec 2023
Efficient Discrete Physics-informed Neural Networks for Addressing Evolutionary Partial Differential Equations Siqi Chen Bin Shan Ye Li AI4CE PINN 19 1 0 22 Dec 2023
Meta-Prior: Meta learning for Adaptive Inverse Problem Solvers M. Terris Thomas Moreau 24 0 0 30 Nov 2023
Personalized Predictions of Glioblastoma Infiltration: Mathematical Models, Physics-Informed Neural Networks and Multimodal Scans Ray Zirui Zhang Ivan Ezhov Michal Balcerak Andy Zhu Benedikt Wiestler Bjoern H. Menze John S. Lowengrub AI4CE 47 6 0 28 Nov 2023
Probabilistic Physics-integrated Neural Differentiable Modeling for Isothermal Chemical Vapor Infiltration Process Deepak Akhare Zeping Chen R. Gulotty Tengfei Luo Jian-Xun Wang AI4CE 19 5 0 13 Nov 2023
Stacked networks improve physics-informed training: applications to neural networks and deep operator networks Amanda A. Howard Sarah H. Murphy Shady E. Ahmed P. Stinis AI4CE 50 18 0 11 Nov 2023
Solution of FPK Equation for Stochastic Dynamics Subjected to Additive Gaussian Noise via Deep Learning Approach Amir H. Khodabakhsh S. Pourtakdoust 11 6 0 08 Nov 2023
Solving High Frequency and Multi-Scale PDEs with Gaussian Processes Shikai Fang Madison Cooley Da Long Shibo Li R. Kirby Shandian Zhe 22 4 0 08 Nov 2023
Filtered Partial Differential Equations: a robust surrogate constraint in physics-informed deep learning framework Dashan Zhang Yuntian Chen Shiyi Chen AI4CE 21 2 0 07 Nov 2023
An Operator Learning Framework for Spatiotemporal Super-resolution of Scientific Simulations Valentin Duruisseaux Amit Chakraborty AI4CE 16 1 0 04 Nov 2023
TSONN: Time-stepping-oriented neural network for solving partial differential equations W. Cao Weiwei Zhang AI4TS 11 1 0 25 Oct 2023
Neural Tangent Kernels Motivate Graph Neural Networks with Cross-Covariance Graphs Shervin Khalafi Saurabh Sihag Alejandro Ribeiro 11 0 0 16 Oct 2023