Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks

5 October 2020

Papers citing "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks"

20 / 70 papers shown

Title
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 44 68 0 08 Oct 2022
Learning Modular Structures That Generalize Out-of-Distribution Arjun Ashok Chaitanya Devaguptapu V. Balasubramanian OOD 14 1 0 07 Aug 2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks Tilman Raukur A. Ho Stephen Casper Dylan Hadfield-Menell AAML AI4CE 23 124 0 27 Jul 2022
How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition Jorge Armando Mendez Mendez Eric Eaton KELM CLL 29 27 0 15 Jul 2022
Memory-Based Model Editing at Scale E. Mitchell Charles Lin Antoine Bosselut Christopher D. Manning Chelsea Finn KELM 24 318 0 13 Jun 2022
Is a Modular Architecture Enough? Sarthak Mittal Yoshua Bengio Guillaume Lajoie 32 47 0 06 Jun 2022
Pruning for Feature-Preserving Circuits in CNNs Christopher Hamblin Talia Konkle G. Alvarez 20 2 0 03 Jun 2022
Clustering units in neural networks: upstream vs downstream information Richard D. Lange David Rolnick Konrad Paul Kording 14 10 0 22 Mar 2022
Neural Network Module Decomposition and Recomposition Hiroaki Kingetsu Kenichi Kobayashi Taiji Suzuki 19 10 0 25 Dec 2021
Sparse Interventions in Language Models with Differentiable Masking Nicola De Cao Leon Schmid Dieuwke Hupkes Ivan Titov 35 27 0 13 Dec 2021
Inducing Causal Structure for Interpretable Neural Networks Atticus Geiger Zhengxuan Wu Hanson Lu J. Rozner Elisa Kreiss Thomas F. Icard Noah D. Goodman Christopher Potts CML OOD 24 70 0 01 Dec 2021
Continual Learning via Local Module Composition O. Ostapenko Pau Rodríguez López Massimo Caccia Laurent Charlin KELM CLL 34 66 0 15 Nov 2021
The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers Róbert Csordás Kazuki Irie Jürgen Schmidhuber ViT 28 128 0 26 Aug 2021
Visual Representation Learning Does Not Generalize Strongly Within the Same Domain Lukas Schott Julius von Kügelgen Frederik Trauble Peter V. Gehler Chris Russell Matthias Bethge Bernhard Schölkopf Francesco Locatello Wieland Brendel OOD DRL 35 66 0 17 Jul 2021
Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignment Michael Chang Sid Kaushik Sergey Levine Thomas L. Griffiths 18 8 0 28 Jun 2021
Can Subnetwork Structure be the Key to Out-of-Distribution Generalization? Dinghuai Zhang Kartik Ahuja Yilun Xu Yisen Wang Aaron Courville OOD 20 95 0 05 Jun 2021
Dynamics of specialization in neural modules under resource constraints Gabriel Béna Dan F. M. Goodman 26 0 0 04 Jun 2021
Efficient and robust multi-task learning in the brain with modular latent primitives Christian David Márton Léo Gagnon Guillaume Lajoie Kanaka Rajan 17 6 0 28 May 2021
Editing Factual Knowledge in Language Models Nicola De Cao Wilker Aziz Ivan Titov KELM 45 473 0 16 Apr 2021
On the Binding Problem in Artificial Neural Networks Klaus Greff Sjoerd van Steenkiste Jürgen Schmidhuber OCL 224 254 0 09 Dec 2020