Panda: A pretrained forecast model for universal representation of chaotic dynamics

19 May 2025

Papers citing "Panda: A pretrained forecast model for universal representation of chaotic dynamics"

43 / 43 papers shown

Title
Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaos Chris Pedersen L. Zanna Joan Bruna 97 5 0 24 Mar 2025
Round and Round We Go! What makes Rotary Positional Encodings useful? Federico Barbero Alex Vitvitskyi Christos Perivolaropoulos Razvan Pascanu Petar Velickovic 129 29 0 08 Oct 2024
Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts Xiaoming Shi Shiyu Wang Yuqi Nie Dianqi Li Zhou Ye Qingsong Wen Ming Jin AI4TS 150 56 0 24 Sep 2024
Zero-shot forecasting of chaotic systems Yuanzhao Zhang William Gilpin AI4TS 260 8 0 24 Sep 2024
Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamics Yenho Chen Noga Mudrik Kyle A. Johnsen Sankaraleengam (Sankar) Alagapan Adam S. Charles Christopher Rozell 77 3 0 29 Aug 2024
FMint: Bridging Human Designed and Data Pretrained Models for Differential Equation Foundation Model Zezheng Song Jiaxin Yuan Haizhao Yang AI4CE 107 18 0 23 Apr 2024
Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolation Jingmin Sun Yuxuan Liu Zecheng Zhang Hayden Schaeffer AI4CE 154 20 0 18 Apr 2024
Decision Transformer as a Foundation Model for Partially Observable Continuous Control Xiangyuan Zhang Weichao Mao Haoran Qiu Tamer Basar OffRL AI4CE 93 6 0 03 Apr 2024
Out-of-Domain Generalization in Dynamical Systems Reconstruction Niclas Alexander Göring Florian Hess Manuel Brenner Zahra Monfared Daniel Durstewitz AI4CE 102 16 0 28 Feb 2024
Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learning Wuyang Chen Jialin Song Pu Ren Shashank Subramanian Dmitriy Morozov Michael W. Mahoney AI4CE 119 12 0 24 Feb 2024
LLMs learn governing principles of dynamical systems, revealing an in-context neural scaling law Toni J. B. Liu Nicolas Boullé Raphaël Sarfati Christopher Earls AI4TS 96 18 0 01 Feb 2024
Neural General Circulation Models for Weather and Climate Dmitrii Kochkov J. Yuval I. Langmore Peter C. Norgaard Jamie A. Smith ... Peter W. Battaglia Alvaro Sanchez-Gonzalez Matthew Willson Michael P. Brenner Stephan Hoyer AI4Cl AI4CE 131 166 0 13 Nov 2023
RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation Yufei Wang Zhou Xian Feng Chen Tsun-Hsuan Wang Yian Wang Katerina Fragkiadaki Zackory M. Erickson David Held Chuang Gan LM&Ro 118 110 0 02 Nov 2023
A foundational neural operator that continuously learns without forgetting Tapas Tripura Souvik Chakraborty CLL 88 9 0 29 Oct 2023
A decoder-only foundation model for time-series forecasting Abhimanyu Das Weihao Kong Rajat Sen Yichen Zhou AI4TS AI4CE 133 242 0 14 Oct 2023
ODEFormer: Symbolic Regression of Dynamical Systems with Transformers Stéphane d’Ascoli Soren Becker Alexander Mathis Philippe Schwaller Niki Kilbertus 105 25 0 09 Oct 2023
Predicting Ordinary Differential Equations with Transformers Soren Becker M. Klein Alexander Neitz Giambattista Parascandolo Niki Kilbertus 89 17 0 24 Jul 2023
Inferring dynamic regulatory interaction graphs from time series data with perturbations Dhananjay Bhaskar Sumner Magruder E. Brouwer Aarthi Venkat Frederik Wenkel Guy Wolf Smita Krishnaswamy 55 5 0 13 Jun 2023
Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behavior Shashank Subramanian P. Harrington Kurt Keutzer W. Bhimji Dmitriy Morozov Michael W. Mahoney A. Gholami AI4CE 120 80 0 01 Jun 2023
Generative modeling of time-dependent densities via optimal transport and projection pursuit Jonah Botvinick-Greenhouse Yunan Yang R. Maulik OT 73 3 0 19 Apr 2023
Model scale versus domain knowledge in statistical forecasting of chaotic systems W. Gilpin AI4TS 99 23 0 13 Mar 2023
Recurrences reveal shared causal drivers of complex time series W. Gilpin CML AI4TS 77 8 0 31 Jan 2023
A Time Series is Worth 64 Words: Long-term Forecasting with Transformers Yuqi Nie Nam H. Nguyen Phanwadee Sinthong Jayant Kalagnanam AIFin AI4TS 108 1,438 0 27 Nov 2022
Continuous PDE Dynamics Forecasting with Implicit Neural Representations Yuan Yin Matthieu Kirchmeyer Jean-Yves Franceschi A. Rakotomamonjy Patrick Gallinari AI4CE 87 53 0 29 Sep 2022
In-context Learning and Induction Heads Catherine Olsson Nelson Elhage Neel Nanda Nicholas Joseph Nova Dassarma ... Tom B. Brown Jack Clark Jared Kaplan Sam McCandlish C. Olah 344 528 0 24 Sep 2022
Data Augmentation vs. Equivariant Networks: A Theory of Generalization on Dynamics Forecasting Rui Wang Robin Walters Rose Yu 62 16 0 19 Jun 2022
Efficiently Modeling Long Sequences with Structured State Spaces Albert Gu Karan Goel Christopher Ré 229 1,843 0 31 Oct 2021
On the difficulty of learning chaotic dynamics with RNNs Jonas M. Mikhaeil Zahra Monfared Daniel Durstewitz 127 59 0 14 Oct 2021
Chaos as an interpretable benchmark for forecasting and data-driven modelling W. Gilpin AI4TS 65 82 0 11 Oct 2021
Contemporary Symbolic Regression Methods and their Relative Performance William La Cava Patryk Orzechowski Bogdan Burlacu Fabrício Olivetti de Francca M. Virgolin Ying Jin M. Kommenda J. Moore 207 262 0 29 Jul 2021
Next Generation Reservoir Computing D. Gauthier Erik Bollt Aaron Griffith W. A. S. Barbosa 104 418 0 14 Jun 2021
Learning Dissipative Dynamics in Chaotic Systems Zong-Yi Li Miguel Liu-Schiaffini Nikola B. Kovachki Burigede Liu Kamyar Azizzadenesheli K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 83 31 0 13 Jun 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 346 2,540 0 20 Apr 2021
Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Maps Ren-Chuen Chen Molei Tao 88 52 0 09 Mar 2021
Modern Koopman Theory for Dynamical Systems Steven L. Brunton M. Budišić E. Kaiser J. Nathan Kutz AI4CE 126 420 0 24 Feb 2021
Quantifying Attention Flow in Transformers Samira Abnar Willem H. Zuidema 174 804 0 02 May 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 663 4,932 0 23 Jan 2020
Root Mean Square Layer Normalization Biao Zhang Rico Sennrich 111 765 0 16 Oct 2019
Intrinsically Motivated Discovery of Diverse Patterns in Self-Organizing Systems Chris Reinke Mayalen Etcheverry Pierre-Yves Oudeyer 75 27 0 19 Aug 2019
Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecasting Rajat Sen Hsiang-Fu Yu Inderjit Dhillon AI4TS 140 361 0 09 May 2019
Identifying nonlinear dynamical systems via generative recurrent neural networks with applications to fMRI G. Koppe Hazem Toutounji P. Kirsch S. Lis Daniel Durstewitz MedIm 86 79 0 19 Feb 2019
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 478 5,178 0 19 Jun 2018
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 180 17 0 27 Jun 2016