DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training

6 March 2024

Hang Su

Jun Zhu

Papers citing "DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training"

20 / 20 papers shown

Title
DISCO: learning to DISCover an evolution Operator for multi-physics-agnostic prediction Rudy Morel Jiequn Han Edouard Oyallon AI4CE 46 0 0 28 Apr 2025
COAST: Intelligent Time-Adaptive Neural Operators Z. Wu Shiyang Zhang Sizhuang He Sifan Wang M. Zhu Anran Jiao Lu Lu David van Dijk 86 1 0 12 Feb 2025
Data-Efficient Inference of Neural Fluid Fields via SciML Foundation Model Yuqiu Liu Jingxuan Xu Mauricio Soroco Yunchao Wei Wuyang Chen AI4CE 65 2 0 18 Dec 2024
Model Balancing Helps Low-data Training and Fine-tuning Zihang Liu Y. Hu Tianyu Pang Yefan Zhou Pu Ren Yaoqing Yang 16 0 0 16 Oct 2024
Zebra: In-Context and Generative Pretraining for Solving Parametric PDEs Louis Serrano Armand K. Koupai Thomas X. Wang Pierre Erbacher Patrick Gallinari AI4CE 13 3 0 04 Oct 2024
Text2PDE: Latent Diffusion Models for Accessible Physics Simulation Anthony Y. Zhou Zijie Li Michael Schneier John R Buchanan Jr Amir Barati Farimani AI4CE DiffM 39 5 0 02 Oct 2024
Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materials Sifan Wang Tong-Rui Liu Shyam Sankaran P. Perdikaris AI4CE 25 2 0 23 Sep 2024
Reduced-Order Neural Operators: Learning Lagrangian Dynamics on Highly Sparse Graphs Hrishikesh Viswanath Yue Chang Julius Berner Peter Yichen Chen Aniket Bera AI4CE 40 2 0 04 Jul 2024
Strategies for Pretraining Neural Operators Anthony Y. Zhou Cooper Lorsung AmirPouya Hemmasian Amir Barati Farimani AI4CE 20 4 0 12 Jun 2024
Unisolver: PDE-Conditional Transformers Are Universal PDE Solvers Zhou Hang Yuezhou Ma Haixu Wu Haowen Wang Mingsheng Long AI4CE 19 8 0 27 May 2024
Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs Md Ashiqur Rahman Robert Joseph George Mogab Elleithy Daniel Leibovici Zong-Yi Li ... Julius Berner Raymond A. Yeh Jean Kossaifi Kamyar Azizzadenesheli A. Anandkumar AI4CE 47 19 0 19 Mar 2024
UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptation Junhong Shen Tanya Marwah Ameet Talwalkar AI4CE 29 2 0 11 Mar 2024
Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learning Wuyang Chen Jialin Song Pu Ren Shashank Subramanian Dmitriy Morozov Michael W. Mahoney AI4CE 28 9 0 24 Feb 2024
Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operators Benedikt Alkin Andreas Fürst Simon Schmid Lukas Gruber Markus Holzleitner Johannes Brandstetter PINN AI4CE 27 8 0 19 Feb 2024
Solving High-Dimensional PDEs with Latent Spectral Models Haixu Wu Tengge Hu Huakun Luo Jianmin Wang Mingsheng Long AI4CE 55 36 0 30 Jan 2023
Towards Multi-spatiotemporal-scale Generalized PDE Modeling Jayesh K. Gupta Johannes Brandstetter AI4CE 53 117 0 30 Sep 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 255 7,337 0 11 Nov 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 239 2,554 0 04 May 2021
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 197 2,254 0 18 Oct 2020
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 226 74,467 0 18 May 2015