Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs

29 February 2020

Papers citing "Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs"

39 / 39 papers shown

Title
Dynamic Gradient Sparse Update for Edge Training I-Hsuan Li Tian-Sheuan Chang 66 1 0 23 Mar 2025
Training Hybrid Neural Networks with Multimode Optical Nonlinearities Using Digital Twins Ilker Oguz Louis J. E. Suter J. Hsieh Mustafa Yildirim Niyazi Ulaş Dinç Christophe Moser D. Psaltis 60 2 0 14 Jan 2025
Test-time Adaptation for Regression by Subspace Alignment Kazuki Adachi Shin'ya Yamaguchi Atsutoshi Kumagai Tomoki Hamagami TTA 46 0 0 04 Oct 2024
Advancing Depth Anything Model for Unsupervised Monocular Depth Estimation in Endoscopy Bojian Li Bo Liu Jinghua Yue F. Zhou Fugen Zhou MedIm MDE 53 2 0 12 Sep 2024
ST-SACLF: Style Transfer Informed Self-Attention Classifier for Bias-Aware Painting Classification Mridula Vijendran Frederick W. B. Li Jingjing Deng Hubert P. H. Shum 56 0 0 03 Aug 2024
Conserve-Update-Revise to Cure Generalization and Robustness Trade-off in Adversarial Training Shruthi Gowda Bahram Zonooz Elahe Arani AAML 31 2 0 26 Jan 2024
PERP: Rethinking the Prune-Retrain Paradigm in the Era of LLMs Max Zimmer Megi Andoni Christoph Spiegel Sebastian Pokutta VLM 52 10 0 23 Dec 2023
Identifying Interpretable Visual Features in Artificial and Biological Neural Systems David A. Klindt Sophia Sanborn Francisco Acosta Frédéric Poitevin Nina Miolane MILM FAtt 44 7 0 17 Oct 2023
ImageBind-LLM: Multi-modality Instruction Tuning Jiaming Han Renrui Zhang Wenqi Shao Peng Gao Peng Xu ... Yafei Wen Xiaoxin Chen Xiangyu Yue Hongsheng Li Yu Qiao MLLM 49 116 0 07 Sep 2023
AC-Norm: Effective Tuning for Medical Image Analysis via Affine Collaborative Normalization Chuyan Zhang Yuncheng Yang Hao Zheng Yun Gu 32 0 0 28 Jul 2023
Dynamical Isometry based Rigorous Fair Neural Architecture Search Jianxiang Luo Junyi Hu Tianji Pang Weihao Huang Chuan-Hsi Liu 21 0 0 05 Jul 2023
Parameter-Efficient Fine-Tuning for Medical Image Analysis: The Missed Opportunity Raman Dutt Linus Ericsson Pedro Sanchez Sotirios A. Tsaftaris Timothy M. Hospedales MedIm 27 50 0 14 May 2023
Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentation Julio Silva-Rodríguez Jose Dolz Ismail Ben Ayed 66 13 0 29 Mar 2023
Open-Set Face Identification on Few-Shot Gallery by Fine-Tuning Hojin Park Jaewoo Park Andrew Beng Jin Teoh CVBM 35 2 0 05 Jan 2023
Why Neural Networks Work Sayan Mukherjee Bernardo A. Huberman 13 2 0 26 Nov 2022
Learning to Generate Image Embeddings with User-level Differential Privacy Zheng Xu Maxwell D. Collins Yuxiao Wang Liviu Panait Sewoong Oh S. Augenstein Ting Liu Florian Schroff H. B. McMahan FedML 30 29 0 20 Nov 2022
On Fine-Tuned Deep Features for Unsupervised Domain Adaptation Qian Wang T. Breckon 30 3 0 25 Oct 2022
AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models S. Kwon Jeonghoon Kim Jeongin Bae Kang Min Yoo Jin-Hwa Kim Baeseong Park Byeongwook Kim Jung-Woo Ha Nako Sung Dongsoo Lee MQ 29 30 0 08 Oct 2022
Byzantines can also Learn from History: Fall of Centered Clipping in Federated Learning Kerem Ozfatura Emre Ozfatura Alptekin Kupcu Deniz Gunduz AAML FedML 36 13 0 21 Aug 2022
Sparse Structure Search for Parameter-Efficient Tuning Shengding Hu Zhen Zhang Ning Ding Yadao Wang Yasheng Wang Zhiyuan Liu Maosong Sun 34 16 0 15 Jun 2022
On Fragile Features and Batch Normalization in Adversarial Training Nils Philipp Walter David Stutz Bernt Schiele AAML 24 5 0 26 Apr 2022
Hidden-Fold Networks: Random Recurrent Residuals Using Sparse Supermasks Ángel López García-Arias Masanori Hashimoto Masato Motomura Jaehoon Yu 39 5 0 24 Nov 2021
Efficient and Private Federated Learning with Partially Trainable Networks Hakim Sidahmed Zheng Xu Ankush Garg Yuan Cao Mingqing Chen FedML 49 13 0 06 Oct 2021
Evaluating the fairness of fine-tuning strategies in self-supervised learning Jason Ramapuram Dan Busbridge Russ Webb 27 6 0 01 Oct 2021
MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfer Ilias Chalkidis Manos Fergadiotis Ion Androutsopoulos AILaw 27 106 0 02 Sep 2021
BN-NAS: Neural Architecture Search with Batch Normalization Boyu Chen Peixia Li Baopu Li Chen Lin Chuming Li Ming Sun Junjie Yan Wanli Ouyang 29 30 0 16 Aug 2021
Batch Normalization Preconditioning for Neural Network Training Susanna Lange Kyle E. Helfrich Qiang Ye 27 9 0 02 Aug 2021
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models Elad Ben-Zaken Shauli Ravfogel Yoav Goldberg 50 1,154 0 18 Jun 2021
Efficient Self-supervised Vision Transformers for Representation Learning Chunyuan Li Jianwei Yang Pengchuan Zhang Mei Gao Bin Xiao Xiyang Dai Lu Yuan Jianfeng Gao ViT 37 209 0 17 Jun 2021
Single-Layer Vision Transformers for More Accurate Early Exits with Less Overhead Arian Bakhtiarnia Qi Zhang Alexandros Iosifidis 27 35 0 19 May 2021
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little Koustuv Sinha Robin Jia Dieuwke Hupkes J. Pineau Adina Williams Douwe Kiela 45 243 0 14 Apr 2021
Multi-Prize Lottery Ticket Hypothesis: Finding Accurate Binary Neural Networks by Pruning A Randomly Weighted Network James Diffenderfer B. Kailkhura MQ 35 75 0 17 Mar 2021
Pretrained Transformers as Universal Computation Engines Kevin Lu Aditya Grover Pieter Abbeel Igor Mordatch 28 217 0 09 Mar 2021
Reservoir Transformers Sheng Shen Alexei Baevski Ari S. Morcos Kurt Keutzer Michael Auli Douwe Kiela 35 17 0 30 Dec 2020
FreezeNet: Full Performance by Reduced Storage Costs Paul Wimmer Jens Mehnert A. P. Condurache 28 13 0 28 Nov 2020
Improving robustness against common corruptions by covariate shift adaptation Steffen Schneider E. Rusak L. Eck Oliver Bringmann Wieland Brendel Matthias Bethge VLM 42 463 0 30 Jun 2020
Supermasks in Superposition Mitchell Wortsman Vivek Ramanujan Rosanne Liu Aniruddha Kembhavi Mohammad Rastegari J. Yosinski Ali Farhadi SSL CLL 30 279 0 26 Jun 2020
What shapes feature representations? Exploring datasets, architectures, and training Katherine L. Hermann Andrew Kyle Lampinen OOD 23 153 0 22 Jun 2020
DeepRetinotopy: Predicting the Functional Organization of Human Visual Cortex from Structural MRI Data using Geometric Deep Learning Fernanda L. Ribeiro S. Bollmann A. M. Puckett MedIm 21 15 0 26 May 2020