Strategies for Pretraining Neural Operators

Strategies for Pretraining Neural Operators

12 June 2024

Anthony Y. Zhou

AmirPouya Hemmasian

Amir Barati Farimani

Papers citing "Strategies for Pretraining Neural Operators"

13 / 13 papers shown

Title
Explain Like I'm Five: Using LLMs to Improve PDE Surrogate Models with Text Cooper Lorsung Amir Barati Farimani AI4CE 56 1 0 02 Oct 2024
Text2PDE: Latent Diffusion Models for Accessible Physics Simulation Anthony Y. Zhou Zijie Li Michael Schneier John R Buchanan Jr Amir Barati Farimani AI4CE DiffM 42 5 0 02 Oct 2024
Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs Md Ashiqur Rahman Robert Joseph George Mogab Elleithy Daniel Leibovici Zong-Yi Li ... Julius Berner Raymond A. Yeh Jean Kossaifi Kamyar Azizzadenesheli A. Anandkumar AI4CE 47 19 0 19 Mar 2024
PICL: Physics Informed Contrastive Learning for Partial Differential Equations Cooper Lorsung A. Farimani AI4CE 20 4 0 29 Jan 2024
A foundational neural operator that continuously learns without forgetting Tapas Tripura Souvik Chakraborty CLL 27 7 0 29 Oct 2023
Towards Multi-spatiotemporal-scale Generalized PDE Modeling Jayesh K. Gupta Johannes Brandstetter AI4CE 53 117 0 30 Sep 2022
Improving Molecular Contrastive Learning via Faulty Negative Mitigation and Decomposed Fragment Contrast Yuyang Wang Rishikesh Magar Chen Liang A. Farimani 30 78 0 18 Feb 2022
VLP: A Survey on Vision-Language Pre-training Feilong Chen Duzhen Zhang Minglun Han Xiuyi Chen Jing Shi Shuang Xu Bo Xu VLM 74 208 0 18 Feb 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 255 7,337 0 11 Nov 2021
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 197 2,254 0 18 Oct 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 220 3,054 0 23 Jan 2020
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 234 11,568 0 09 Mar 2017
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 226 74,467 0 18 May 2015