Finding the Needle in the Haystack with Convolutions: on the benefits of
architectural bias

Finding the Needle in the Haystack with Convolutions: on the benefits of architectural bias

16 June 2019

Stéphane dÁscoli

Joan Bruna

Papers citing "Finding the Needle in the Haystack with Convolutions: on the benefits of architectural bias"

12 / 12 papers shown

Title
$Intrinsic dimensionality and generalization properties of the $\mathcal{R}$-norm inductive bias$ Intrinsic dimensionality and generalization properties of the $\mathcal{R}$ -norm inductive bias Navid Ardeshir Daniel J. Hsu Clayton Sanford CML AI4CE 49 6 0 10 Jun 2022
Data-driven emergence of convolutional structure in neural networks Alessandro Ingrosso Sebastian Goldt 75 38 0 01 Feb 2022
Towards Biologically Plausible Convolutional Networks Roman Pogodin Yash Mehta Timothy Lillicrap P. Latham 52 22 0 22 Jun 2021
ResMLP: Feedforward networks for image classification with data-efficient training Hugo Touvron Piotr Bojanowski Mathilde Caron Matthieu Cord Alaaeldin El-Nouby ... Gautier Izacard Armand Joulin Gabriel Synnaeve Jakob Verbeek Hervé Jégou VLM 43 658 0 07 May 2021
Sifting out the features by pruning: Are convolutional networks the winning lottery ticket of fully connected ones? Franco Pellegrini Giulio Biroli 59 6 0 27 Apr 2021
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases Stéphane dÁscoli Hugo Touvron Matthew L. Leavitt Ari S. Morcos Giulio Biroli Levent Sagun ViT 72 812 0 19 Mar 2021
Align, then memorise: the dynamics of learning with feedback alignment Maria Refinetti Stéphane dÁscoli Ruben Ohana Sebastian Goldt 39 36 0 24 Nov 2020
Towards Learning Convolutions from Scratch Behnam Neyshabur SSL 244 71 0 27 Jul 2020
Neural Anisotropy Directions Guillermo Ortiz-Jiménez Apostolos Modas Seyed-Mohsen Moosavi-Dezfooli P. Frossard 40 16 0 17 Jun 2020
Shortcut Learning in Deep Neural Networks Robert Geirhos J. Jacobsen Claudio Michaelis R. Zemel Wieland Brendel Matthias Bethge Felix Wichmann 78 2,013 0 16 Apr 2020
Revisiting Spatial Invariance with Low-Rank Local Connectivity Gamaleldin F. Elsayed Prajit Ramachandran Jonathon Shlens Simon Kornblith 47 44 0 07 Feb 2020
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 323 2,908 0 15 Sep 2016