The Impact of Reinitialization on Generalization in Convolutional Neural
Networks

The Impact of Reinitialization on Generalization in Convolutional Neural Networks

1 September 2021

Ibrahim M. Alabdulmohsin

Hartmut Maennel

Papers citing "The Impact of Reinitialization on Generalization in Convolutional Neural Networks"

13 / 13 papers shown

Title
Breaking the Reclustering Barrier in Centroid-based Deep Clustering Lukas Miklautz Timo Klein Kevin Sidak Collin Leiber Thomas Lang Andrii Shkabrii Sebastian Tschiatschek Claudia Plant 34 0 0 04 Nov 2024
Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting Suraj Anand Michael A. Lepori Jack Merullo Ellie Pavlick CLL 31 6 0 28 May 2024
Conserve-Update-Revise to Cure Generalization and Robustness Trade-off in Adversarial Training Shruthi Gowda Bahram Zonooz Elahe Arani AAML 31 2 0 26 Jan 2024
Reset It and Forget It: Relearning Last-Layer Weights Improves Continual and Transfer Learning Lapo Frati Neil Traft Jeff Clune Nick Cheney CLL 21 0 0 12 Oct 2023
Improving Language Plasticity via Pretraining with Active Forgetting Yihong Chen Kelly Marchisio Roberta Raileanu David Ifeoluwa Adelani Pontus Stenetorp Sebastian Riedel Mikel Artetx KELM AI4CE CLL 28 23 0 03 Jul 2023
Robust Ante-hoc Graph Explainer using Bilevel Optimization Kha-Dinh Luong Mert Kosan A. Silva Ambuj K. Singh 34 6 0 25 May 2023
The Dormant Neuron Phenomenon in Deep Reinforcement Learning Ghada Sokar Rishabh Agarwal P. S. Castro Utku Evci CLL 40 88 0 24 Feb 2023
When Does Re-initialization Work? Sheheryar Zaidi Tudor Berariu Hyunjik Kim J. Bornschein Claudia Clopath Yee Whye Teh Razvan Pascanu 40 10 0 20 Jun 2022
The Primacy Bias in Deep Reinforcement Learning Evgenii Nikishin Max Schwarzer P. DÓro Pierre-Luc Bacon Aaron C. Courville OnRL 90 180 0 16 May 2022
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 11 42 0 01 Feb 2022
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 950 20,567 0 17 Apr 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,889 0 15 Sep 2016
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 119 577 0 27 Feb 2015