DeepViT: Towards Deeper Vision Transformer

22 March 2021

Linjie Yang

Papers citing "DeepViT: Towards Deeper Vision Transformer"

50 / 253 papers shown

Title
Hyb-KAN ViT: Hybrid Kolmogorov-Arnold Networks Augmented Vision Transformer Sainath Dey Mitul Goswami Jashika Sethi Prasant Kumar Pattnaik ViT 28 0 0 07 May 2025
Optimal Hyperspectral Undersampling Strategy for Satellite Imaging Vita V. Vlasova Vladimir G. Kuzmin Maria S. Varetsa Natalia A. Ibragimova Oleg Y. Rogov Elena V. Lyapuntsova 19 0 0 27 Apr 2025
GRN+: A Simplified Generative Reinforcement Network for Tissue Layer Analysis in 3D Ultrasound Images for Chronic Low-back Pain Zixue Zeng Xiaoyan Zhao Matthew Cartier Xin Meng J. Pu MedIm 40 0 0 25 Mar 2025
Coeff-Tuning: A Graph Filter Subspace View for Tuning Attention-Based Large Models Zichen Miao Wei Chen Qiang Qiu 90 1 0 24 Mar 2025
Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks Kairong Yu Chengting Yu Tianqing Zhang Xiaochen Zhao Shu Yang Hongwei Wang Qiang Zhang Qi Xu 66 3 0 05 Mar 2025
Arrhythmia Classification from 12-Lead ECG Signals Using Convolutional and Transformer-Based Deep Learning Models Andrei Apostol Maria Nutu 60 0 0 25 Feb 2025
Scaling Laws in Patchification: An Image Is Worth 50,176 Tokens And More Feng Wang Yaodong Yu Guoyizhe Wei Wei Shao Yuyin Zhou Alan Yuille Cihang Xie ViT 88 4 0 06 Feb 2025
VMamba: Visual State Space Model Yue Liu Yunjie Tian Yuzhong Zhao Hongtian Yu Lingxi Xie Yaowei Wang Qixiang Ye Jianbin Jiao Yunfan Liu Mamba 113 609 0 31 Dec 2024
ImagePiece: Content-aware Re-tokenization for Efficient Image Recognition Seungdong Yoa Seungjun Lee Hyeseung Cho Bumsoo Kim Woohyung Lim ViT 67 0 0 21 Dec 2024
Slicing Vision Transformer for Flexible Inference Yitian Zhang Huseyin Coskun Xu Ma Huan Wang Ke Ma Xi Chen Derek Hao Hu Y. Fu ViT 76 0 0 06 Dec 2024
Vision Transformers for Weakly-Supervised Microorganism Enumeration Javier Ureña Santiago Thomas Ströhle Antonio Rodríguez-Sánchez Ruth Breu ViT 67 0 0 03 Dec 2024
Preventing Dimensional Collapse in Self-Supervised Learning via Orthogonality Regularization Junlin He Jinxiao Du Wei Ma SSL 33 0 0 01 Nov 2024
Enhancing Brain Tumor Classification Using TrAdaBoost and Multi-Classifier Deep Learning Approaches Mahin Mohammadi Saman Jamshidi 27 1 0 31 Oct 2024
Backdoor Attack Against Vision Transformers via Attention Gradient-Based Image Erosion Ji Guo Hongwei Li Wenbo Jiang Guoming Lu AAML 24 119 0 30 Oct 2024
Improving Vision Transformers by Overlapping Heads in Multi-Head Self-Attention Tianxiao Zhang Bo Luo G. Wang ViT 21 1 0 18 Oct 2024
Down-Sampling Inter-Layer Adapter for Parameter and Computation Efficient Ultra-Fine-Grained Image Recognition Edwin Arkel Rios Femiloye Oyerinde Min-Chun Hu Bo-Cheng Lai 24 0 0 17 Sep 2024
Sparks of Artificial General Intelligence(AGI) in Semiconductor Material Science: Early Explorations into the Next Frontier of Generative AI-Assisted Electron Micrograph Analysis Sakhinana Sagar Srinivas Geethan Sannidhi Sreeja Gangasani Chidaksh Ravuru Venkataramana Runkana 30 0 0 17 Sep 2024
FIF-UNet: An Efficient UNet Using Feature Interaction and Fusion for Medical Image Segmentation Xiaolin Gou Chuanlin Liao Jizhe Zhou Fengshuo Ye Yi Lin 11 0 0 09 Sep 2024
Parameter-Efficient Quantized Mixture-of-Experts Meets Vision-Language Instruction Tuning for Semiconductor Electron Micrograph Analysis Sakhinana Sagar Srinivas Chidaksh Ravuru Geethan Sannidhi Venkataramana Runkana 38 0 0 27 Aug 2024
Multi-Modal Instruction-Tuning Small-Scale Language-and-Vision Assistant for Semiconductor Electron Micrograph Analysis Sakhinana Sagar Srinivas Geethan Sannidhi Venkataramana Runkana 38 1 0 27 Aug 2024
LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentation Trung Dang Huy Hoang Nguyen A. Tiulpin Mamba 27 3 0 26 Aug 2024
Hierarchical Network Fusion for Multi-Modal Electron Micrograph Representation Learning with Foundational Large Language Models Sakhinana Sagar Srinivas Geethan Sannidhi Venkataramana Runkana 30 0 0 24 Aug 2024
Preliminary Investigations of a Multi-Faceted Robust and Synergistic Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision Transformers with Large Language and Multimodal Models Sakhinana Sagar Srinivas Geethan Sannidhi Sreeja Gangasani Chidaksh Ravuru Venkataramana Runkana 24 0 0 24 Aug 2024
Foundational Model for Electron Micrograph Analysis: Instruction-Tuning Small-Scale Language-and-Vision Assistant for Enterprise Adoption Sakhinana Sagar Srinivas Chidaksh Ravuru Geethan Sannidhi Venkataramana Runkana 33 0 0 23 Aug 2024
Vision HgNN: An Electron-Micrograph is Worth Hypergraph of Hypernodes Sakhinana Sagar Srinivas Rajat Kumar Sarkar Sreeja Gangasani Venkataramana Runkana 33 2 0 21 Aug 2024
EMCNet : Graph-Nets for Electron Micrographs Classification Sakhinana Sagar Srinivas Rajat Kumar Sarkar Venkataramana Runkana 32 0 0 21 Aug 2024
Research on Personalized Compression Algorithm for Pre-trained Models Based on Homomorphic Entropy Increase Yicong Li Xing Guo Haohua Du 30 0 0 16 Aug 2024
OPa-Ma: Text Guided Mamba for 360-degree Image Out-painting Penglei Gao Kai Yao Tiandi Ye Steven Wang Yuan Yao Xiaofeng Wang Mamba 27 1 0 15 Jul 2024
BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillation Zekai Xu Kang You Qinghai Guo Xiang Wang Zhezhi He 26 3 0 12 Jul 2024
Adaptive Parametric Activation Konstantinos Panagiotis Alexandridis Jiankang Deng Anh Nguyen Shan Luo 36 2 0 11 Jul 2024
MTS-Net: Dual-Enhanced Positional Multi-Head Self-Attention for 3D CT Diagnosis of May-Thurner Syndrome Yixin Huang Yiqi Jin Ke Tao Kaijian Xia Jianfeng Gu Lei Yu Lan Du Cunjian Chen 27 0 0 07 Jun 2024
Learning 1D Causal Visual Representation with De-focus Attention Networks Chenxin Tao Xizhou Zhu Shiqian Su Lewei Lu Changyao Tian ... Gao Huang Hongsheng Li Yu Qiao Jie Zhou Jifeng Dai 65 1 0 06 Jun 2024
Prototypical Transformer as Unified Motion Learners Cheng Han Yawen Lu Guohao Sun James Liang Zhiwen Cao ... S. Dianat Raghuveer M. Rao Tong Geng Zhiqiang Tao Dongfang Liu ViT 29 2 0 03 Jun 2024
You Only Need Less Attention at Each Stage in Vision Transformers Shuoxi Zhang Hanpeng Liu Stephen Lin Kun He 53 5 0 01 Jun 2024
MDS-ViTNet: Improving saliency prediction for Eye-Tracking with Vision Transformer Polezhaev Ignat Goncharenko Igor Iurina Natalya ViT 27 0 0 29 May 2024
BIMM: Brain Inspired Masked Modeling for Video Representation Learning Zhifan Wan Jie M. Zhang Chang-bo Li Shiguang Shan 62 0 0 21 May 2024
ViTamin: Designing Scalable Vision Models in the Vision-Language Era Jienneg Chen Qihang Yu Xiaohui Shen Alan L. Yuille Liang-Chieh Chen 3DV VLM 28 24 0 02 Apr 2024
Enhancing Efficiency in Vision Transformer Networks: Design Techniques and Insights Moein Heidari Reza Azad Sina Ghorbani Kolahi René Arimond Leon Niggemeier ... Afshin Bozorgpour Ehsan Khodapanah Aghdam A. Kazerouni I. Hacihaliloglu Dorit Merhof 41 7 0 28 Mar 2024
Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis Badri N. Patro Suhas Ranganath Vinay P. Namboodiri Vijay Srinivas Agneeswaran 43 2 0 26 Mar 2024
On permutation-invariant neural networks Masanari Kimura Ryotaro Shimizu Yuki Hirakawa Ryosuke Goto Yuki Saito OOD AAML 33 12 0 26 Mar 2024
Group-Mix SAM: Lightweight Solution for Industrial Assembly Line Applications Wu Liang X.-G. Ma 34 0 0 15 Mar 2024
Attacking Transformers with Feature Diversity Adversarial Perturbation Chenxing Gao Hang Zhou Junqing Yu Yuteng Ye Jiale Cai Junle Wang Wei Yang AAML 32 3 0 10 Mar 2024
SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning Zhihao Wen Jie Zhang Yuan Fang MoE 34 3 0 19 Feb 2024
Head-wise Shareable Attention for Large Language Models Zouying Cao Yifei Yang Hai Zhao 36 4 0 19 Feb 2024
Architecture Analysis and Benchmarking of 3D U-shaped Deep Learning Models for Thoracic Anatomical Segmentation Arash Harirpoush Amir Rasoulian Marta Kersten-Oertel Yiming Xiao 3DV 6 0 0 05 Feb 2024
SHViT: Single-Head Vision Transformer with Memory Efficient Macro Design Seokju Yun Youngmin Ro ViT 36 29 0 29 Jan 2024
Setting the Record Straight on Transformer Oversmoothing G. Dovonon M. Bronstein Matt J. Kusner 20 5 0 09 Jan 2024
Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket Zhaokun Zhou Kaiwei Che Wei Fang Keyu Tian Yuesheng Zhu Shuicheng Yan Yonghong Tian Liuliang Yuan ViT 37 27 0 04 Jan 2024
Deformable Audio Transformer for Audio Event Detection Wentao Zhu 28 0 0 24 Dec 2023
A mathematical perspective on Transformers Borjan Geshkovski Cyril Letrouit Yury Polyanskiy Philippe Rigollet EDL AI4CE 40 36 0 17 Dec 2023