Can Vision Transformers Perform Convolution?

Can Vision Transformers Perform Convolution?

2 November 2021

Papers citing "Can Vision Transformers Perform Convolution?"

14 / 14 papers shown

Title
Approximation Rate of the Transformer Architecture for Sequence Modeling Hao Jiang Qianxiao Li 48 9 0 03 Jan 2025
Artificial Human Intelligence: The role of Humans in the Development of Next Generation AI Suayb S. Arslan 23 2 0 24 Sep 2024
A Hyper-Transformer model for Controllable Pareto Front Learning with Split Feasibility Constraints Tran Anh Tuan Nguyen Viet Dung Tran Ngoc Thang 31 3 0 04 Feb 2024
DiffiT: Diffusion Vision Transformers for Image Generation Ali Hatamizadeh Jiaming Song Guilin Liu Jan Kautz Arash Vahdat 24 66 0 04 Dec 2023
Understanding the Role of the Projector in Knowledge Distillation Roy Miles K. Mikolajczyk 19 21 0 20 Mar 2023
A Brief Survey on the Approximation Theory for Sequence Modelling Hao Jiang Qianxiao Li Zhong Li Shida Wang AI4TS 28 12 0 27 Feb 2023
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers K. Choromanski Shanda Li Valerii Likhosherstov Kumar Avinava Dubey Shengjie Luo Di He Yiming Yang Tamás Sarlós Thomas Weingarten Adrian Weller 25 8 0 03 Feb 2023
Towards Flexible Inductive Bias via Progressive Reparameterization Scheduling Yunsung Lee Gyuseong Lee Kwang-seok Ryoo Hyojun Go Jihye Park Seung Wook Kim 24 5 0 04 Oct 2022
Comparison Analysis of Traditional Machine Learning and Deep Learning Techniques for Data and Image Classification Efstathios Karypidis Stylianos G. Mouslech Kassiani Skoulariki Alexandros Gazis 20 14 0 11 Apr 2022
CodedVTR: Codebook-based Sparse Voxel Transformer with Geometric Guidance Tianchen Zhao Niansong Zhang Xuefei Ning He-Nan Wang Li Yi Yu Wang 3DPC ViT 22 8 0 18 Mar 2022
Self-Promoted Supervision for Few-Shot Transformer Bowen Dong Pan Zhou Shuicheng Yan W. Zuo ViT 22 28 0 14 Mar 2022
ELSA: Enhanced Local Self-Attention for Vision Transformer Jingkai Zhou Pichao Wang Fan Wang Qiong Liu Hao Li Rong Jin ViT 34 37 0 23 Dec 2021
StyleSwin: Transformer-based GAN for High-resolution Image Generation Bo Zhang Shuyang Gu Bo Zhang Jianmin Bao Dong Chen Fang Wen Yong Wang B. Guo ViT 33 221 0 20 Dec 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 268 2,013 0 28 Jul 2020