How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks

24 September 2020

Ken-ichi Kawarabayashi

Stefanie Jegelka

MLT

ArXiv PDF HTML

Papers citing "How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks"

50 / 62 papers shown

Title
Wide & Deep Learning for Node Classification Yancheng Chen Wenguo Yang Zhipeng Jiang GNN 33 0 0 04 May 2025
Hadamard product in deep learning: Introduction, Advances and Challenges Grigorios G. Chrysos Yongtao Wu Razvan Pascanu Philip Torr V. Cevher AAML 98 0 0 17 Apr 2025
NodeNAS: Node-Specific Graph Neural Architecture Search for Out-of-Distribution Generalization Qiyi Wang Yinning Shao Yunlong Ma Min Liu OOD 77 0 0 04 Mar 2025
Evolution and The Knightian Blindspot of Machine Learning Joel Lehman Elliot Meyerson Tarek El-Gaaly Kenneth O. Stanley Tarin Ziyaee 86 1 0 22 Jan 2025
Optimality of Message-Passing Architectures for Sparse Graphs Aseem Baranwal K. Fountoulakis Aukosh Jagannath 81 11 0 10 Jan 2025
Causal-aware Graph Neural Architecture Search under Distribution Shifts Peiwen Li Xin Wang Zeyang Zhang Yi Qin Ziwei Zhang Jialong Wang Yang Li Wenwu Zhu CML OOD 62 4 0 31 Dec 2024
Zero-shot forecasting of chaotic systems Yuanzhao Zhang William Gilpin AI4TS 37 4 0 24 Sep 2024
Scalable Graph Compressed Convolutions Junshu Sun Chen Yang Shuhui Wang Qingming Huang GNN 43 0 0 26 Jul 2024
Feature contamination: Neural networks learn uncorrelated features and fail to generalize Tianren Zhang Chujie Zhao Guanyu Chen Yizhou Jiang Feng Chen OOD MLT OODD 77 3 0 05 Jun 2024
Intervention-Assisted Policy Gradient Methods for Online Stochastic Queuing Network Optimization: Technical Report Jerrod Wigmore B. Shrader E. Modiano OffRL 21 1 0 05 Apr 2024
Hypergraph-Transformer (HGT) for Interactive Event Prediction in Laparoscopic and Robotic Surgery Lianhao Yin Yutong Ban J. Eckhoff O. Meireles Daniela Rus Guy Rosman 41 1 0 03 Feb 2024
Weak Correlations as the Underlying Principle for Linearization of Gradient-Based Learning Systems Ori Shem-Ur Yaron Oz 14 0 0 08 Jan 2024
Does Invariant Graph Learning via Environment Augmentation Learn Invariance? Yongqiang Chen Yatao Bian Kaiwen Zhou Binghui Xie Bo Han James Cheng OOD 28 34 0 29 Oct 2023
Centered Self-Attention Layers Ameen Ali Tomer Galanti Lior Wolf 28 6 0 02 Jun 2023
Wide neural networks: From non-gaussian random fields at initialization to the NTK geometry of training Luís Carvalho Joao L. Costa José Mourao Gonccalo Oliveira AI4CE 18 1 0 06 Apr 2023
MetaPhysiCa: OOD Robustness in Physics-informed Machine Learning S Chandra Mouli M. A. Alam Bruno Ribeiro OOD 29 4 0 06 Mar 2023
Neural Algorithmic Reasoning with Causal Regularisation Beatrice Bevilacqua Kyriacos Nikiforou Borja Ibarz Ioana Bica Michela Paganini Charles Blundell Jovana Mitrović Petar Velivcković OOD CML NAI 36 26 0 20 Feb 2023
Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusion Haotian Ju Dongyue Li Aneesh Sharma Hongyang R. Zhang 28 40 0 09 Feb 2023
Robust Scheduling with GFlowNets David W. Zhang Corrado Rainone M. Peschl Roberto Bondesan 29 48 0 17 Jan 2023
Graph Neural Networks are Inherently Good Generalizers: Insights by Bridging GNNs and MLPs Chenxiao Yang Qitian Wu Jiahua Wang Junchi Yan AI4CE 19 51 0 18 Dec 2022
Learnable Commutative Monoids for Graph Neural Networks Euan Ong Petar Velickovic 10 12 0 16 Dec 2022
Investigation of chemical structure recognition by encoder-decoder models in learning progress Katsuhisa Morita T. Mizuno Hiroyuki Kusuhara 19 8 0 24 Oct 2022
Transformers Learn Shortcuts to Automata Bingbin Liu Jordan T. Ash Surbhi Goel A. Krishnamurthy Cyril Zhang OffRL LRM 37 155 0 19 Oct 2022
Provably expressive temporal graph networks Amauri Souza Diego Mesquita Samuel Kaski Vikas K. Garg 89 54 0 29 Sep 2022
Learning Continuous Implicit Representation for Near-Periodic Patterns B. Chen Tiancheng Zhi M. Hebert S. Narasimhan CLL AI4TS 19 5 0 25 Aug 2022
Open World Learning Graph Convolution for Latency Estimation in Routing Networks Yifei Jin Marios Daoutis Sarunas Girdzijauskas A. Gionis 11 1 0 08 Jul 2022
Data-Efficient Brain Connectome Analysis via Multi-Task Meta-Learning Yi Yang Yanqiao Zhu Hejie Cui Xuan Kan Lifang He Ying Guo Carl Yang 33 30 0 09 Jun 2022
The CLRS Algorithmic Reasoning Benchmark Petar Velivcković Adria Puigdomenech Badia David Budden Razvan Pascanu Andrea Banino Mikhail Dashevskiy R. Hadsell Charles Blundell 161 87 0 31 May 2022
Graph-level Neural Networks: Current Progress and Future Directions Ge Zhang Jia Wu Jian Yang Shan Xue Wenbin Hu Chuan Zhou Hao Peng Quan.Z Sheng Charu C. Aggarwal GNN AI4CE 38 0 0 31 May 2022
OOD Link Prediction Generalization Capabilities of Message-Passing GNNs in Larger Test Graphs Yangze Zhou Gitta Kutyniok Bruno Ribeiro OODD AI4CE 73 37 0 30 May 2022
Trustworthy Graph Neural Networks: Aspects, Methods and Trends He Zhang Bang Wu Xingliang Yuan Shirui Pan Hanghang Tong Jian Pei 45 104 0 16 May 2022
Theory of Graph Neural Networks: Representation and Learning Stefanie Jegelka GNN AI4CE 33 68 0 16 Apr 2022
Graph Neural Networks are Dynamic Programmers Andrew Dudzik Petar Velickovic 28 63 0 29 Mar 2022
Eigenvalues of Autoencoders in Training and at Initialization Ben Dees S. Agarwala Corey Lowman 19 0 0 27 Jan 2022
To what extent should we trust AI models when they extrapolate? Roozbeh Yousefzadeh Xuenan Cao 16 5 0 27 Jan 2022
OOD-GNN: Out-of-Distribution Generalized Graph Neural Network Haoyang Li Xin Eric Wang Ziwei Zhang Wenwu Zhu OODD OOD 26 97 0 07 Dec 2021
Decoding the Protein-ligand Interactions Using Parallel Graph Neural Networks C. Knutson Mridula Bontha Jenna A. Bilbrey Neeraj Kumar 20 34 0 30 Nov 2021
Learning on Random Balls is Sufficient for Estimating (Some) Graph Parameters Takanori Maehara Hoang NT 38 2 0 05 Nov 2021
On Provable Benefits of Depth in Training Graph Convolutional Networks Weilin Cong M. Ramezani M. Mahdavi 24 73 0 28 Oct 2021
How Does Knowledge Graph Embedding Extrapolate to Unseen Data: A Semantic Evidence View Ren Li Yanan Cao Qiannan Zhu Guanqun Bi Fang Fang Yi Liu Qian Li 22 68 0 24 Sep 2021
Implicit Behavioral Cloning Peter R. Florence Corey Lynch Andy Zeng Oscar Ramirez Ayzaan Wahid Laura Downs Adrian S. Wong Johnny Lee Igor Mordatch Jonathan Tompson OffRL 49 369 0 01 Sep 2021
How Powerful is Graph Convolution for Recommendation? Yifei Shen Yongji Wu Yao Zhang Caihua Shan Jun Zhang Khaled B. Letaief Dongsheng Li GNN 28 99 0 17 Aug 2021
Deep Extrapolation for Attribute-Enhanced Generation Alvin Chan Ali Madani Ben Krause Nikhil Naik 19 24 0 07 Jul 2021
A Theoretical Analysis of Fine-tuning with Linear Teachers Gal Shachaf Alon Brutzkus Amir Globerson 26 17 0 04 Jul 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 37 813 0 14 Jun 2021
Learning to Pool in Graph Neural Networks for Extrapolation Jihoon Ko Taehyung Kwon Kijung Shin Juho Lee 16 6 0 11 Jun 2021
GANTL: Towards Practical and Real-Time Topology Optimization with Conditional GANs and Transfer Learning M. Behzadi H. Ilies AI4CE 14 18 0 07 May 2021
On the Equivalence Between Temporal and Static Graph Representations for Observational Predictions Jianfei Gao Bruno Ribeiro 27 11 0 12 Mar 2021
Size-Invariant Graph Representations for Graph Classification Extrapolations Beatrice Bevilacqua Yangze Zhou Bruno Ribeiro OOD 35 108 0 08 Mar 2021
Domain Generalization: A Survey Kaiyang Zhou Ziwei Liu Yu Qiao Tao Xiang Chen Change Loy OOD AI4CE 72 980 0 03 Mar 2021