Scalable Transformer for PDE Surrogate Modeling

27 May 2023

Papers citing "Scalable Transformer for PDE Surrogate Modeling"

50 / 50 papers shown

Title
PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systems Han Wan Rui Zhang Qi Wang Y. Liu Hao Sun PINN 35 0 0 03 May 2025
A Physics-preserved Transfer Learning Method for Differential Equations Hao-Ran Yang Chuan-Xian Ren 89 0 0 02 May 2025
SUPRA: Subspace Parameterized Attention for Neural Operator on General Domains Zherui Yang Zhengyang Xue Ligang Liu 17 0 0 22 Apr 2025
Integrating Locality-Aware Attention with Transformers for General Geometry PDEs Minsu Koh Beom-Chul Park Heejo Kong Seong-Whan Lee AI4CE 35 0 0 18 Apr 2025
PINP: Physics-Informed Neural Predictor with latent estimation of fluid flows Huaguan Chen Yang Liu Hao Sun PINN AI4CE 44 0 0 08 Apr 2025
Generative Latent Neural PDE Solver using Flow Matching Zijie Li Anthony Y. Zhou Amir Barati Farimani DiffM AI4CE 67 0 0 28 Mar 2025
AMR-Transformer: Enabling Efficient Long-range Interaction for Complex Neural Fluid Simulation Zeyi Xu Jinfan Liu Kuangxu Chen Ye Chen Zhangli Hu Bingbing Ni 52 0 0 13 Mar 2025
PIMRL: Physics-Informed Multi-Scale Recurrent Learning for Spatiotemporal Prediction Han Wan Qi Wang Hao Sun Hao Sun AI4CE 46 0 0 13 Mar 2025
MultiPDENet: PDE-embedded Learning with Multi-time-stepping for Accelerated Flow Simulation Qi Wang Yuan Mi H. Wang Yi Zhang Ruizhi Chengze Hongsheng Liu J. Wen Hao Sun AI4CE 38 0 0 28 Jan 2025
Orthogonal greedy algorithm for linear operator learning with shallow neural network Ye Lin Jiwei Jia Young Ju Lee Ran Zhang 34 1 0 06 Jan 2025
PACE: Pacing Operator Learning to Accurate Optical Field Simulation for Complicated Photonic Devices Hanqing Zhu Wenyan Cong Guojin Chen Shupeng Ning Ray T. Chen Jiaqi Gu D. Pan 21 1 0 05 Nov 2024
P $^2$ C $^2$ Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamics Qi Wang Pu Ren Hao Zhou Xin-Yang Liu Z. Deng ... Zidong Wang Jian-Xun Wang Ji-Rong_Wen Hao Sun Yang Liu 50 5 0 29 Oct 2024
Text2PDE: Latent Diffusion Models for Accessible Physics Simulation Anthony Y. Zhou Zijie Li Michael Schneier John R Buchanan Jr Amir Barati Farimani AI4CE DiffM 52 5 0 02 Oct 2024
Explain Like I'm Five: Using LLMs to Improve PDE Surrogate Models with Text Cooper Lorsung Amir Barati Farimani AI4CE 58 1 0 02 Oct 2024
DiffFluid: Plain Diffusion Models are Effective Predictors of Flow Dynamics Dongyu Luo Jianyu Wu Jing Wang Hairun Xie Xiangyu Yue Shixiang Tang DiffM AI4CE 28 0 0 20 Sep 2024
Separable Operator Networks Xinling Yu S. Hooten Z. Liu Yequan Zhao M. Fiorentino T. Van Vaerenbergh Zheng-Wei Zhang 41 4 0 15 Jul 2024
Towards Universal Mesh Movement Networks Mingrui Zhang Chunyang Wang Stephan Kramer Joseph G. Wallwork Siyi Li Jiancheng Liu Xiang Chen M. Piggott AI4CE 25 0 0 29 Jun 2024
Strategies for Pretraining Neural Operators Anthony Y. Zhou Cooper Lorsung AmirPouya Hemmasian Amir Barati Farimani AI4CE 34 4 0 12 Jun 2024
Vectorized Conditional Neural Fields: A Framework for Solving Time-dependent Parametric Partial Differential Equations Jan Hagnberger Marimuthu Kalimuthu Daniel Musekamp Mathias Niepert AI4TS AI4CE 37 5 0 06 Jun 2024
Flexible SE(2) graph neural networks with applications to PDE surrogates Maria Bånkestad Olof Mogren Aleksis Pirinen 39 1 0 30 May 2024
Unisolver: PDE-Conditional Transformers Are Universal PDE Solvers Zhou Hang Yuezhou Ma Haixu Wu Haowen Wang Mingsheng Long AI4CE 34 8 0 27 May 2024
Reference Neural Operators: Learning the Smooth Dependence of Solutions of PDEs on Geometric Deformations Ze Cheng Zhongkai Hao Xiaoqiang Wang Jianing Huang Youjia Wu Xudan Liu Yiru Zhao Songming Liu Hang Su AI4CE 29 2 0 27 May 2024
Spectral-Refiner: Accurate Fine-Tuning of Spatiotemporal Fourier Neural Operator for Turbulent Flows Shuhao Cao Francesco Brarda Ruipeng Li Yuanzhe Xi 31 0 0 27 May 2024
FUSE: Fast Unified Simulation and Estimation for PDEs Levi E. Lingsch Dana Grund Siddhartha Mishra Georgios Kissas AI4CE 26 0 0 23 May 2024
Hierarchical Neural Operator Transformer with Learnable Frequency-aware Loss Prior for Arbitrary-scale Super-resolution Xihaier Luo Xiaoning Qian Byung-Jun Yoon 35 3 0 20 May 2024
CaFA: Global Weather Forecasting with Factorized Attention on Sphere Zijie Li Anthony Y. Zhou Saurabh Patil A. Farimani 27 6 0 12 May 2024
ThermoPore: Predicting Part Porosity Based on Thermal Images Using Deep Learning P. Pak Francis Ogoke Andrew Polonsky Anthony Garland D. Bolintineanu Dan R. Moser Michael J. Heiden A. Farimani 16 4 0 23 Apr 2024
GrINd: Grid Interpolation Network for Scattered Observations Andrzej Dulny Paul Heinisch Andreas Hotho Anna Krause 25 1 0 28 Mar 2024
Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs Md Ashiqur Rahman Robert Joseph George Mogab Elleithy Daniel Leibovici Zong-Yi Li ... Julius Berner Raymond A. Yeh Jean Kossaifi Kamyar Azizzadenesheli A. Anandkumar AI4CE 49 19 0 19 Mar 2024
Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidance Hao Wu Fan Xu Yifan Duan Ziwei Niu Weiyan Wang Gaofeng Lu Kun Wang Yuxuan Liang Yang Wang DiffM AI4CE 37 8 0 18 Mar 2024
Latent Neural PDE Solver: a reduced-order modelling framework for partial differential equations Zijie Li Saurabh Patil Francis Ogoke Dule Shu Wilson Zhen Michael Schneier John R. Buchanan A. Farimani AI4CE 32 5 0 27 Feb 2024
Inpainting Computational Fluid Dynamics with Deep Learning Dule Shu Wilson Zhen Zijie Li A. Farimani AI4CE 29 0 0 27 Feb 2024
Building Flexible Machine Learning Models for Scientific Computing at Scale Tianyu Chen Haoyi Zhou Ying Li Hao Wang Chonghan Gao Shanghang Zhang Jianxin Li AI4CE 25 0 0 25 Feb 2024
DeepLag: Discovering Deep Lagrangian Dynamics for Intuitive Fluid Prediction Qilong Ma Haixu Wu Lanxiang Xing Jianmin Wang Mingsheng Long AI4CE 19 0 0 04 Feb 2024
Transolver: A Fast Transformer Solver for PDEs on General Geometries Haixu Wu Huakun Luo Haowen Wang Jianmin Wang Mingsheng Long AI4CE 38 40 0 04 Feb 2024
PICL: Physics Informed Contrastive Learning for Partial Differential Equations Cooper Lorsung A. Farimani AI4CE 28 4 0 29 Jan 2024
Multi-scale Time-stepping of Partial Differential Equations with Transformers AmirPouya Hemmasian A. Farimani AI4CE 42 13 0 03 Nov 2023
Improved Operator Learning by Orthogonal Attention Zipeng Xiao Zhongkai Hao Bokai Lin Zhijie Deng Hang Su 19 11 0 19 Oct 2023
HelmFluid: Learning Helmholtz Dynamics for Interpretable Fluid Prediction Lanxiang Xing Haixu Wu Yuezhou Ma Jianmin Wang Mingsheng Long MDE AI4CE 10 4 0 16 Oct 2023
Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEs Jean Kossaifi Nikola B. Kovachki Kamyar Azizzadenesheli Anima Anandkumar AI4CE 42 32 0 29 Sep 2023
Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equations Tengfei Xu Dachuan Liu Peng Hao Bo Wang 28 4 0 09 Apr 2023
Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformers Steeven Janny Aurélien Béneteau Madiha Nadri Wolf Julie Digne Nicolas Thome Christian Wolf AI4CE 71 32 0 16 Feb 2023
Mitigating spectral bias for the multiscale operator learning Xinliang Liu Bo Xu Shuhao Cao Lei Zhang AI4CE 20 25 0 19 Oct 2022
Towards Multi-spatiotemporal-scale Generalized PDE Modeling Jayesh K. Gupta Johannes Brandstetter AI4CE 53 117 0 30 Sep 2022
Clifford Neural Layers for PDE Modeling Johannes Brandstetter Rianne van den Berg Max Welling Jayesh K. Gupta AI4CE 60 79 0 08 Sep 2022
Multiwavelet-based Operator Learning for Differential Equations Gaurav Gupta Xiongye Xiao P. Bogdan 124 200 0 28 Sep 2021
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 203 2,272 0 18 Oct 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 251 2,009 0 28 Jul 2020
MeshfreeFlowNet: A Physics-Constrained Deep Continuous Space-Time Super-Resolution Framework C. Jiang S. Esmaeilzadeh Kamyar Azizzadenesheli K. Kashinath Mustafa A. Mustafa H. Tchelepi P. Marcus P. Prabhat Anima Anandkumar AI4CE 182 140 0 01 May 2020
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 214 7,687 0 17 Aug 2015