Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs

13 March 2022

Jungong Han

Papers citing "Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs"

50 / 153 papers shown

Title
ConvShareViT: Enhancing Vision Transformers with Convolutional Attention Mechanisms for Free-Space Optical Accelerators Riad Ibadulla Thomas M. Chen C. Reyes-Aldasoro ViT 17 0 0 15 Apr 2025
Content-Aware Transformer for All-in-one Image Restoration Gang Wu Junjun Jiang Kui Jiang Xianming Liu ViT 50 0 0 07 Apr 2025
HGFormer: Topology-Aware Vision Transformer with HyperGraph Learning Hao Wang Shuo Zhang Biao Leng ViT 59 0 0 03 Apr 2025
YOLO-MS: Rethinking Multi-Scale Representation Learning for Real-time Object Detection Yuming Chen Xinbin Yuan Ruiqi Wu Jiabao Wang Qibin Hou Mingg-Ming Cheng Ming-Ming Cheng ObjD 138 51 0 21 Feb 2025
Learning Motion and Temporal Cues for Unsupervised Video Object Segmentation Yunzhi Zhuge Hongyu Gu Lu Zhang Jinqing Qi Huchuan Lu VOS 62 2 0 14 Jan 2025
Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Training Man Yao Xuerui Qiu Tianxiang Hu J. Hu Yuhong Chou Keyu Tian Jianxing Liao Luziwei Leng Bo Xu Guoqi Li 71 4 0 25 Nov 2024
CasDyF-Net: Image Dehazing via Cascaded Dynamic Filters Wang Yinglong He Bin 33 2 0 13 Sep 2024
Sampling Foundational Transformer: A Theoretical Perspective Viet Anh Nguyen Minh Lenhat Khoa Nguyen Duong Duc Hieu Dao Huu Hung Truong Son-Hy 42 0 0 11 Aug 2024
Mamba meets crack segmentation Zhili He Yuhao Wang Mamba 29 3 0 22 Jul 2024
A lightweight residual network for unsupervised deformable image registration Ahsan Raza Siyal A. E. Grams Markus Haltmeier ViT MedIm 24 0 0 14 Jun 2024
Building Vision Models upon Heat Conduction Zhaozhi Wang Yue Liu Yunfan Liu Hongtian Yu Yaowei Wang QiXiang Ye ViT VLM 50 0 0 26 May 2024
CAM Back Again: Large Kernel CNNs from a Weakly Supervised Object Localization Perspective Shunsuke Yasuki Masato Taki AAML 19 0 0 11 Mar 2024
DRSI-Net: Dual-Residual Spatial Interaction Network for Multi-Person Pose Estimation Shang Wu Bin Wang 14 1 0 26 Feb 2024
An FPGA-Based Accelerator Enabling Efficient Support for CNNs with Arbitrary Kernel Sizes Miaoxin Wang Xiao Wu Jun Lin Zhongfeng Wang 23 2 0 22 Feb 2024
YOLO-Ant: A Lightweight Detector via Depthwise Separable Convolutional and Large Kernel Design for Antenna Interference Source Detection Xiaoyu Tang Xingming Chen Jintao Cheng Jin Wu Rui Fan Chengxi Zhang Zebo Zhou 21 4 0 20 Feb 2024
Troublemaker Learning for Low-Light Image Enhancement Yinghao Song Zhiyuan Cao Wanhong Xiang Sifan Long Bo Yang H. Ge Yanchun Liang Chunguo Wu 32 0 0 07 Feb 2024
LKFormer: Large Kernel Transformer for Infrared Image Super-Resolution Feiwei Qin Kang Yan Changmiao Wang Ruiquan Ge Yong Peng Kai Zhang ViT 16 9 0 22 Jan 2024
Slicer Networks Hang Zhang Xiang Chen Rongguang Wang Renjiu Hu Dongdong Liu Gaolei Li MedIm 23 2 0 18 Jan 2024
Efficient Image Super-Resolution via Symmetric Visual Attention Network Chengxu Wu Qinrui Fan Shu Hu Xi Wu Xin Wang Jing Hu SupR 22 3 0 17 Jan 2024
Transforming Image Super-Resolution: A ConvFormer-based Efficient Approach Gang Wu Junjun Jiang Junpeng Jiang Xianming Liu SupR 22 7 0 11 Jan 2024
PPEA-Depth: Progressive Parameter-Efficient Adaptation for Self-Supervised Monocular Depth Estimation Yue-Jiang Dong Yuanchen Guo Ying-Tian Liu Fang-Lue Zhang Song-Hai Zhang MDE 19 4 0 20 Dec 2023
Post-Training Quantization for Re-parameterization via Coarse & Fine Weight Splitting Dawei Yang Ning He Xing Hu Zhihang Yuan Jiangyong Yu Chen Xu Zhe Jiang MQ 17 5 0 17 Dec 2023
NeuroFlow: Development of lightweight and efficient model integration scheduling strategy for autonomous driving system Eunbin Seo Gwanjun Shin Eunho Lee 13 0 0 15 Dec 2023
Factorization Vision Transformer: Modeling Long Range Dependency with Local Window Cost Haolin Qin Daquan Zhou Tingfa Xu Ziyang Bian Jianan Li 19 9 0 14 Dec 2023
The Counterattack of CNNs in Self-Supervised Learning: Larger Kernel Size might be All You Need Tianjin Huang Tianlong Chen Zhangyang Wang Shiwei Liu 22 1 0 09 Dec 2023
Rethinking Detection Based Table Structure Recognition for Visually Rich Document Images Bin Xiao Murat Simsek B. Kantarci Ala Abu Alkheir LMTD 22 1 0 01 Dec 2023
PillarNeSt: Embracing Backbone Scaling and Pretraining for Pillar-based 3D Object Detection Weixin Mao Tiancai Wang Diankun Zhang Junjie Yan Osamu Yoshie 3DPC 33 5 0 29 Nov 2023
TransNeXt: Robust Foveal Visual Perception for Vision Transformers Dai Shi ViT 11 72 0 28 Nov 2023
Spatially Covariant Image Registration with Text Prompts Xiang Chen Min Liu Rongguang Wang Renjiu Hu Dongdong Liu Gaolei Li Hang Zhang MedIm 35 7 0 27 Nov 2023
Innovative Horizons in Aerial Imagery: LSKNet Meets DiffusionDet for Advanced Object Detection Ahmed Sharshar Aleksandr Matsun 13 2 0 21 Nov 2023
TransXNet: Learning Both Global and Local Dynamics with a Dual Dynamic Token Mixer for Visual Recognition Meng Lou Hong-Yu Zhou Sibei Yang Yizhou Yu Chuan Wu Yizhou Yu ViT 31 35 0 30 Oct 2023
Low-Resolution Self-Attention for Semantic Segmentation Yu-Huan Wu Shi-Chen Zhang Yun-Hai Liu Le Zhang Xin Zhan Daquan Zhou Jiashi Feng Ming-Ming Cheng Liangli Zhen ViT 32 3 0 08 Oct 2023
DeformUX-Net: Exploring a 3D Foundation Backbone for Medical Image Segmentation with Depthwise Deformable Convolution Ho Hin Lee Quan Liu Qi Yang Xin Yu Shunxing Bao Yuankai Huo Bennett A. Landman MedIm 17 2 0 30 Sep 2023
Interpret Vision Transformers as ConvNets with Dynamic Convolutions Chong Zhou Chen Change Loy Bo Dai ViT 25 1 0 19 Sep 2023
TF-SepNet: An Efficient 1D Kernel Design in CNNs for Low-Complexity Acoustic Scene Classification Yiqian Cai Peihong Zhang Shengchen Li 30 6 0 15 Sep 2023
Large Separable Kernel Attention: Rethinking the Large Kernel Attention Design in CNN Kin Wai Lau L. Po Yasar Abbas Ur Rehman VLM 10 197 0 04 Sep 2023
DAT++: Spatially Dynamic Vision Transformer with Deformable Attention Zhuofan Xia Xuran Pan Shiji Song Li Erran Li Gao Huang ViT 19 22 0 04 Sep 2023
ARFA: An Asymmetric Receptive Field Autoencoder Model for Spatiotemporal Prediction Wenxuan Zhang Xuechao Zou Li Wu Xiaoying Wang Jianqiang Huang Junliang Xing 9 0 0 01 Sep 2023
ADNet: Lane Shape Prediction via Anchor Decomposition Lingyu Xiao Xiang Li Sen Yang Wankou Yang 28 18 0 21 Aug 2023
Large-kernel Attention for Efficient and Robust Brain Lesion Segmentation Liam Chalcroft Ruben Lourencco Pereira Mikael Brudfors Andrew S. Kayser M. D’Esposito Cathy J. Price Ioannis Pappas John Ashburner ViT 3DV MedIm 11 8 0 14 Aug 2023
SCSC: Spatial Cross-scale Convolution Module to Strengthen both CNNs and Transformers Xijun Wang Xiaojie Chu Chunrui Han Xiangyu Zhang ViT 15 1 0 14 Aug 2023
A Novel Convolutional Neural Network Architecture with a Continuous Symmetry Y. Liu Han-Juan Shao Bing Bai AI4CE 13 2 0 03 Aug 2023
PVG: Progressive Vision Graph for Vision Recognition Jiafu Wu Jian Li Jiangning Zhang Boshen Zhang M. Chi Yabiao Wang Chengjie Wang ViT 8 12 0 01 Aug 2023
SR-R $^2$ KAC: Improving Single Image Defocus Deblurring Peng Tang Zhiqiang Xu Pengfei Wei Xiaobin Hu Peilin Zhao Xin Cao Chunlai Zhou Tobias Lasser SupR 16 0 0 30 Jul 2023
Adaptive Frequency Filters As Efficient Global Token Mixers Zhipeng Huang Zhizheng Zhang Cuiling Lan Zhengjun Zha Yan Lu B. Guo 25 36 0 26 Jul 2023
Digital Modeling on Large Kernel Metamaterial Neural Network Quan Liu Hanyu Zheng Brandon T. Swartz Ho Hin Lee Zuhayr Asad I. Kravchenko Jason G Valentine Yuankai Huo 6 4 0 21 Jul 2023
Meta-Transformer: A Unified Framework for Multimodal Learning Yiyuan Zhang Kaixiong Gong Kaipeng Zhang Hongsheng Li Yu Qiao Wanli Ouyang Xiangyu Yue 16 135 0 20 Jul 2023
AudioInceptionNeXt: TCL AI LAB Submission to EPIC-SOUND Audio-Based-Interaction-Recognition Challenge 2023 Kin Wai Lau Yasar Abbas Ur Rehman Yuyang Xie Lan Ma 8 1 0 14 Jul 2023
Latent Graph Attention for Enhanced Spatial Context Ayush Singh Yash Bhambhu Himanshu Buckchash D. K. Gupta Dilip K. Prasad 19 3 0 09 Jul 2023
NBMOD: Find It and Grasp It in Noisy Background Boyuan Cao Xinyu Zhou Congmin Guo Baohua Zhang Yuchen Liu Qianqiu Tan 21 4 0 17 Jun 2023