Micro-Batch Training with Batch-Channel Normalization and Weight Standardization

25 March 2019

Siyuan Qiao

Papers citing "Micro-Batch Training with Batch-Channel Normalization and Weight Standardization"

50 / 88 papers shown

Title
Blending 3D Geometry and Machine Learning for Multi-View Stereopsis Vibhas Kumar Vats Md. Alimoor Reza David J. Crandall Soon-Heung Jung 3DV 27 0 0 06 May 2025
ZNorm: Z-Score Gradient Normalization for Deep Neural Networks Giorgia Adorni Alberto Piatti 20 0 0 02 Aug 2024
Fake or Compromised? Making Sense of Malicious Clients in Federated Learning Hamid Mozaffari Sunav Choudhary Amir Houmansadr 27 2 0 10 Mar 2024
GC-MVSNet: Multi-View, Multi-Scale, Geometrically-Consistent Multi-View Stereo Vibhas Kumar Vats Sripad Joshi David J. Crandall Md. Alimoor Reza Soon-Heung Jung 3DV 26 6 0 30 Oct 2023
Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks Atli Kosson Bettina Messmer Martin Jaggi 27 11 0 26 May 2023
Revisiting Context Aggregation for Image Matting Qinglin Liu Xiaoqian Lv Quanling Meng Zonglin Li Xiangyuan Lan Shuo Yang Shengping Zhang Liqiang Nie 26 5 0 03 Apr 2023
Equivariant Differentially Private Deep Learning: Why DP-SGD Needs Sparser Models Florian A. Hölzl Daniel Rueckert Georgios Kaissis 24 4 0 30 Jan 2023
Sequential Learning Of Neural Networks for Prequential MDL J. Bornschein Yazhe Li Marcus Hutter AI4TS 27 6 0 14 Oct 2022
Unsupervised Learning of Equivariant Structure from Sequences Takeru Miyato Masanori Koyama Kenji Fukumizu 13 12 0 12 Oct 2022
Online Training Through Time for Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 45 60 0 09 Oct 2022
Federated Training of Dual Encoding Models on Small Non-IID Client Datasets Raviteja Vemulapalli Warren Morningstar Philip Mansfield Hubert Eichner K. Singhal Arash Afkanpour Bradley Green FedML 29 2 0 30 Sep 2022
One-Trimap Video Matting Hongje Seong Seoung Wug Oh Brian L. Price Euntai Kim Joon-Young Lee 26 13 0 27 Jul 2022
$L_2$ BN: Enhancing Batch Normalization by Equalizing the $L_2$ Norms of Features Zhennan Wang Kehan Li Runyi Yu Yian Zhao Pengchong Qiao Chang-rui Liu Fan Xu Xiangyang Ji Guoli Song Jie Chen 14 0 0 06 Jul 2022
Generalization to translation shifts: a study in architectures and augmentations Suriya Gunasekar 11 1 0 05 Jul 2022
Realistic One-shot Mesh-based Head Avatars Taras Khakhulin V. Sklyarova Victor Lempitsky Egor Zakharov 3DH 29 97 0 16 Jun 2022
Self-Labeling Refinement for Robust Representation Learning with Bootstrap Your Own Latent Siddhant Garg Dhruval Jain SSL 33 0 0 09 Apr 2022
Logit Normalization for Long-tail Object Detection Liang Zhao Yao Teng Limin Wang 26 10 0 31 Mar 2022
Holistic Fine-grained GGS Characterization: From Detection to Unbalanced Classification Yuzhe Lu Haichun Yang Zuhayr Asad Zheyu Zhu Tianyuan Yao Jiachen Xu Agnes B. Fogo Yuankai Huo 19 1 0 31 Jan 2022
GUNNEL: Guided Mixup Augmentation and Multi-View Fusion for Aquatic Animal Segmentation Minh-Quan Le Trung-Nghia Le Tam V. Nguyen Isao Echizen M. Tran 23 0 0 12 Dec 2021
Towards Learning Universal Audio Representations Luyu Wang Pauline Luc Yan Wu Adrià Recasens Lucas Smaira ... Andrew Jaegle Jean-Baptiste Alayrac Sander Dieleman João Carreira Aaron van den Oord SSL 24 68 0 23 Nov 2021
MQBench: Towards Reproducible and Deployable Model Quantization Benchmark Yuhang Li Mingzhu Shen Jian Ma Yan Ren Mingxin Zhao Qi Zhang Ruihao Gong F. Yu Junjie Yan MQ 35 49 0 05 Nov 2021
Domain Adaptation and Active Learning for Fine-Grained Recognition in the Field of Biodiversity Bernd Gruner Matthias Körschens Björn Barz Joachim Denzler 16 0 0 22 Oct 2021
Single Plane-Wave Imaging using Physics-Based Deep Learning G. Pilikos C. L. D. Korte Tristan van Leeuwen F. Lucka 17 4 0 08 Sep 2021
Deep Learning for Multi-View Ultrasonic Image Fusion G. Pilikos L. Horchens Tristan van Leeuwen F. Lucka 11 2 0 08 Sep 2021
Tensor Normalization and Full Distribution Training Wolfgang Fuhl OOD 19 4 0 06 Sep 2021
Semi-weakly Supervised Contrastive Representation Learning for Retinal Fundus Images Boon Peng Yap B. Ng SSL 25 3 0 04 Aug 2021
The Evolution of Out-of-Distribution Robustness Throughout Fine-Tuning Anders Andreassen Yasaman Bahri Behnam Neyshabur Rebecca Roelofs OOD OODD 22 78 0 30 Jun 2021
Towards Single Stage Weakly Supervised Semantic Segmentation Peri Akiva Kristin J. Dana 19 8 0 18 Jun 2021
SPeCiaL: Self-Supervised Pretraining for Continual Learning Lucas Page-Caccia Joelle Pineau CLL SSL 11 18 0 16 Jun 2021
Contrastive Representation Learning for Hand Shape Estimation Christiane Zimmermann Max Argus Thomas Brox 3DH SSL 19 41 0 08 Jun 2021
Graph Barlow Twins: A self-supervised representation learning framework for graphs Piotr Bielak Tomasz Kajdanowicz Nitesh V. Chawla SSL 11 133 0 04 Jun 2021
Single Stage Class Agnostic Common Object Detection: A Simple Baseline Chuong H. Nguyen Thuy C. Nguyen Anh H. Vo Yamazaki Masayuki ObjD 19 1 0 25 Apr 2021
Does enhanced shape bias improve neural network robustness to common corruptions? Chaithanya Kumar Mummadi Ranjitha Subramaniam Robin Hutmacher Julien Vitay Volker Fischer J. H. Metzen 19 40 0 20 Apr 2021
Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditions Abhijit Guha Roy Jie Jessie Ren Shekoofeh Azizi Aaron Loh Vivek Natarajan ... Yun-hui Liu taylan. cemgil Alan Karthikesalingam Balaji Lakshminarayanan Jim Winkens 18 103 0 08 Apr 2021
Delving into Variance Transmission and Normalization: Shift of Average Gradient Makes the Network Collapse YuXiang Liu Jidong Ge Chuanyi Li Jie Gui 13 2 0 22 Mar 2021
Contrastive Learning Meets Transfer Learning: A Case Study In Medical Image Analysis Yuzhe Lu Aadarsh Jha Yuankai Huo MedIm 19 4 0 04 Mar 2021
Low-Precision Reinforcement Learning: Running Soft Actor-Critic in Half Precision Johan Bjorck Xiangyu Chen Christopher De Sa Carla P. Gomes Kilian Q. Weinberger 15 6 0 26 Feb 2021
Large-Scale Representation Learning on Graphs via Bootstrapping S. Thakoor Corentin Tallec M. G. Azar Mehdi Azabou Eva L. Dyer Rémi Munos Petar Velivcković Michal Valko SSL 18 215 0 12 Feb 2021
High-Performance Large-Scale Image Recognition Without Normalization Andrew Brock Soham De Samuel L. Smith Karen Simonyan VLM 223 512 0 11 Feb 2021
Weight Rescaling: Effective and Robust Regularization for Deep Neural Networks with Batch Normalization Ziquan Liu Yufei Cui Jia Wan Yushun Mao Antoni B. Chan 10 2 0 06 Feb 2021
Meta Adversarial Training against Universal Patches J. H. Metzen Nicole Finnie Robin Hutmacher OOD AAML 17 21 0 27 Jan 2021
Characterizing signal propagation to close the performance gap in unnormalized ResNets Andrew Brock Soham De Samuel L. Smith 31 120 0 21 Jan 2021
Supervised Transfer Learning at Scale for Medical Imaging Basil Mustafa Aaron Loh Jan Freyberg Patricia MacWilliams Megan Wilson ... Shruthi Prabhakara Umesh Telang Alan Karthikesalingam N. Houlsby Vivek Natarajan LM&MA 14 67 0 14 Jan 2021
Positional Encoding as Spatial Inductive Bias in GANs Rui Xu Xintao Wang Kai-xiang Chen Bolei Zhou Chen Change Loy GAN 27 89 0 09 Dec 2020
Encoding the latent posterior of Bayesian Neural Networks for uncertainty quantification Gianni Franchi Andrei Bursuc Emanuel Aldea Séverine Dubuisson Isabelle Bloch BDL UQCV 14 22 0 04 Dec 2020
Inter-slice Context Residual Learning for 3D Medical Image Segmentation Jianpeng Zhang Yutong Xie Yan Wang Yong-quan Xia SSeg MedIm 24 88 0 28 Nov 2020
Scaling Wide Residual Networks for Panoptic Segmentation Liang-Chieh Chen Huiyu Wang Siyuan Qiao SSeg 27 47 0 23 Nov 2020
DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasets Jianpeng Zhang Yutong Xie Yong-quan Xia Chunhua Shen 14 155 0 20 Nov 2020
Channel Pruning Guided by Spatial and Channel Attention for DNNs in Intelligent Edge Computing Mengran Liu Weiwei Fang Xiaodong Ma Wenyuan Xu N. Xiong Yi Ding AAML 19 21 0 08 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 41 39,217 0 22 Oct 2020