Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs

13 March 2022

Jungong Han

Papers citing "Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs"

50 / 153 papers shown

Title
Towards Better Orthogonality Regularization with Disentangled Norm in Training Deep CNNs Changhao Wu Shenan Zhang Fangsong Long Ziliang Yin Tuo Leng 11 0 0 16 Jun 2023
FalconNet: Factorization for the Light-weight ConvNets Zhicheng Cai Qiu Shen 14 11 0 10 Jun 2023
Cross-LKTCN: Modern Convolution Utilizing Cross-Variable Dependency for Multivariate Time Series Forecasting Dependency for Multivariate Time Series Forecasting Donghao Luo Xue Wang BDL AI4TS 11 1 0 04 Jun 2023
Dilated Convolution with Learnable Spacings: beyond bilinear interpolation Ismail Khalfaoui-Hassani Thomas Pellegrini T. Masquelier 8 3 0 01 Jun 2023
Lightweight Vision Transformer with Bidirectional Interaction Qihang Fan Huaibo Huang Xiaoqiang Zhou Ran He ViT 25 27 0 01 Jun 2023
MixDehazeNet : Mix Structure Block For Image Dehazing Network Liping Lu Qian Xiong Duanfeng Chu Bingrong Xu 30 27 0 28 May 2023
Learning a Single Convolutional Layer Model for Low Light Image Enhancement Yuantong Zhang Baoxin Teng Daiqin Yang Zhenzhong Chen Haichuan Ma Gang Li Wenpeng Ding 18 7 0 23 May 2023
Value Iteration Networks with Gated Summarization Module Jinyu Cai Jialong Li Mingyue Zhang Kenji Tei 17 2 0 11 May 2023
Convolutional Neural Networks Rarely Learn Shape for Semantic Segmentation Yixin Zhang Maciej Mazurowski 3DV 3DPC 22 8 0 11 May 2023
Stimulative Training++: Go Beyond The Performance Limits of Residual Networks XinYu Piao Tong He DoangJoo Synn Baopu Li Tao Chen Lei Bai Jong-Kook Kim 42 4 0 04 May 2023
AxWin Transformer: A Context-Aware Vision Transformer Backbone with Axial Windows Fangjian Lin Yizhe Ma Sitong Wu Long Yu Sheng Tian ViT 19 4 0 02 May 2023
Consolidator: Mergeable Adapter with Grouped Connections for Visual Adaptation Tianxiang Hao Hui Chen Yuchen Guo Guiguang Ding 42 16 0 30 Apr 2023
OGMN: Occlusion-guided Multi-task Network for Object Detection in UAV Images Xuexue Li Wenhui Diao Yongqiang Mao Peng Gao Xiuhua Mao Xinming Li Xian Sun ObjD 20 30 0 24 Apr 2023
Omni Aggregation Networks for Lightweight Image Super-Resolution Hang Wang Xuanhong Chen Bingbing Ni Yutian Liu Jinfan Liu SupR 19 76 0 20 Apr 2023
RIFormer: Keep Your Vision Backbone Effective While Removing Token Mixer Jiahao Wang Songyang Zhang Yong Liu Taiqiang Wu Yujiu Yang Xihui Liu Kai-xiang Chen Ping Luo Dahua Lin 11 20 0 12 Apr 2023
Slide-Transformer: Hierarchical Vision Transformer with Local Self-Attention Xuran Pan Tianzhu Ye Zhuofan Xia S. Song Gao Huang ViT 17 53 0 09 Apr 2023
High-order Spatial Interactions Enhanced Lightweight Model for Optical Remote Sensing Image-based Small Ship Detection Y. Yin Xu Cheng Fan Shi Xiufeng Liu Huan Huo Shengyong Chen 19 11 0 07 Apr 2023
Towards an Effective and Efficient Transformer for Rain-by-snow Weather Removal Tao Gao Yuanbo Wen Kaihao Zhang Peng Cheng Ting Chen ViT 18 5 0 06 Apr 2023
SMPConv: Self-moving Point Representations for Continuous Convolution Sanghyeon Kim Eunbyung Park 3DPC 21 12 0 05 Apr 2023
VoxelFormer: Bird's-Eye-View Feature Generation based on Dual-view Attention for Multi-view 3D Object Detection Zhuoling Li Chuanrui Zhang Wei-Chiu Ma Yipin Zhou Linyan Huang Haoqian Wang SerNam Lim Hengshuang Zhao 10 6 0 03 Apr 2023
LinK: Linear Kernel for LiDAR-based 3D Perception Tao Lu Xiang Ding Haisong Liu Gangshan Wu Liming Wang 20 34 0 28 Mar 2023
Incorporating Transformer Designs into Convolutions for Lightweight Image Super-Resolution Gang Wu Junjun Jiang Yuanchao Bai Xianming Liu SupR ViT 19 6 0 25 Mar 2023
Large Selective Kernel Network for Remote Sensing Object Detection Yuxuan Li Qibin Hou Zhaohui Zheng Mingmei Cheng Jian Yang Xiang Li ObjD 21 236 0 16 Mar 2023
Scaling Up 3D Kernels with Bayesian Frequency Re-parameterization for Medical Image Segmentation Ho Hin Lee Quan Liu Shunxing Bao Qi Yang Xin Yu L. Cai Thomas Z. Li Yuankai Huo X. Koutsoukos Bennett A. Landman 15 13 0 10 Mar 2023
Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks Jierun Chen Shiu-hong Kao Hao He Weipeng Zhuo Song Wen Chul-Ho Lee Shueng-Han Gary Chan OOD 27 679 0 07 Mar 2023
KBNet: Kernel Basis Network for Image Restoration Y. Zhang Dasong Li Xiaoyu Shi Dailan He Kangning Song Xiaogang Wang Hongwei Qin Hongsheng Li 89 55 0 06 Mar 2023
DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network Xuan Shen Yaohua Wang Ming Lin Yi-Li Huang Hao Tang Xiuyu Sun Yanzhi Wang 60 32 0 05 Mar 2023
Spacetime-Efficient Low-Depth Quantum State Preparation with Applications Kaiwen Gui A. Dalzell Alessandro Achille Martin Suchara Frederic T. Chong 25 17 0 03 Mar 2023
Image as Set of Points Xu Ma Yuqian Zhou Huan Wang Can Qin Bin Sun Chang Liu Yun Fu VLM 37 48 0 02 Mar 2023
Patch Network for medical image Segmentation Weihu Song Heng Yu Jianhua Wu MedIm SSeg 11 0 0 23 Feb 2023
A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuning Jin Zhu Guang Yang Pietro Lio' ViT MedIm 24 5 0 22 Feb 2023
Towards Efficient Visual Adaption via Structural Re-parameterization Gen Luo Minglang Huang Yiyi Zhou Xiaoshuai Sun Guannan Jiang Zhiyu Wang Rongrong Ji VLM VPVLM 8 76 0 16 Feb 2023
Optical flow estimation from event-based cameras and spiking neural networks Javier Cuadrado Ulysse Rançon Benoit R. Cottereau Francisco Barranco T. Masquelier 3DPC 17 37 0 13 Feb 2023
SwinCross: Cross-modal Swin Transformer for Head-and-Neck Tumor Segmentation in PET/CT Images Gary Y. Li Junyu Chen Se-In Jang Kuang Gong Quanzheng Li ViT MedIm 23 14 0 08 Feb 2023
Revisiting Image Deblurring with an Efficient ConvNet Lingyan Ruan Mojtaba Bemana Hans-peter Seidel K. Myszkowski Bin Chen 28 10 0 04 Feb 2023
Scaling Up Computer Vision Neural Networks Using Fast Fourier Transform Siddharth Agrawal 13 0 0 02 Feb 2023
The Power of Linear Combinations: Learning with Random Convolutions Paul Gavrikov J. Keuper 24 2 0 26 Jan 2023
A Simple Adaptive Unfolding Network for Hyperspectral Image Reconstruction Junyu Wang Shijie Wang Wenyu Liu Zengqiang Zheng Xinggang Wang 13 2 0 24 Jan 2023
Progressive Meta-Pooling Learning for Lightweight Image Classification Model Peijie Dong Xin-Yi Niu Zhiliang Tian Lujun Li Xiaodong Wang Zimian Wei H. Pan Dongsheng Li VLM 27 7 0 24 Jan 2023
Long Range Pooling for 3D Large-Scale Scene Understanding Xiang-Li Li Meng-Hao Guo Tai-Jiang Mu Ralph Robert Martin Shiyong Hu 3DV 3DPC 6 2 0 17 Jan 2023
FemtoDet: An Object Detection Baseline for Energy Versus Performance Tradeoffs Peng Tu Xu Xie Guo Ai Ming Ling Ya-Yao Huang Yefeng Zheng 19 9 0 17 Jan 2023
Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling Keyu Tian Yi-Xin Jiang Qishuai Diao Chen Lin Liwei Wang Zehuan Yuan 9 98 0 09 Jan 2023
Enabling Augmented Segmentation and Registration in Ultrasound-Guided Spinal Surgery via Realistic Ultrasound Synthesis from Diagnostic CT Volume A. Li Jiayi Han Yongjian Zhao Keyu Li Li Liu 20 4 0 05 Jan 2023
BiMLP: Compact Binary Architectures for Vision Multi-Layer Perceptrons Yixing Xu Xinghao Chen Yunhe Wang MQ 14 8 0 29 Dec 2022
A Close Look at Spatial Modeling: From Attention to Convolution Xu Ma Huan Wang Can Qin Kunpeng Li Xing Zhao Jie Fu Yun Fu ViT 3DPC 9 11 0 23 Dec 2022
Reversible Column Networks Yuxuan Cai Yi Zhou Qi Han Jianjian Sun Xiangwen Kong Jun Yu Li Xiangyu Zhang VLM 26 53 0 22 Dec 2022
Revisiting Residual Networks for Adversarial Robustness: An Architectural Perspective Shihua Huang Zhichao Lu Kalyanmoy Deb Vishnu Naresh Boddeti OOD 19 39 0 21 Dec 2022
LOANet: A Lightweight Network Using Object Attention for Extracting Buildings and Roads from UAV Aerial Remote Sensing Images Xiaoxiang Han Yiman Liu Gang Liu Yuanjie Lin Qiaohong Liu 19 11 0 16 Dec 2022
SBSS: Stacking-Based Semantic Segmentation Framework for Very High Resolution Remote Sensing Image Yuanzhi Cai Lei Fan Yuan-Sheng Fang 8 17 0 15 Dec 2022
RTMDet: An Empirical Study of Designing Real-Time Object Detectors Chengqi Lyu Wenwei Zhang Haian Huang Yue Zhou Yudong Wang Yanyi Liu Shilong Zhang Kai-xiang Chen ObjD 37 372 0 14 Dec 2022