v1v2 (latest)

Do Vision Transformers See Like Convolutional Neural Networks?

19 August 2021

Alexey Dosovitskiy

ArXiv (abs)PDF HTML HuggingFace (1 upvotes)

Papers citing "Do Vision Transformers See Like Convolutional Neural Networks?"

50 / 490 papers shown

Title
Uncovering Prototypical Knowledge for Weakly Open-Vocabulary Semantic SegmentationNeural Information Processing Systems (NeurIPS), 2023 Fei Zhang Tianfei Zhou Boyang Li Hao He Chaofan Ma Tianjiao Zhang Jiangchao Yao Ya Zhang Yanfeng Wang VLM 253 34 0 29 Oct 2023
Analyzing Vision Transformers for Image Classification in Class Embedding SpaceNeural Information Processing Systems (NeurIPS), 2023 Martina G. Vilas Timothy Schaumlöffel Gemma Roig ViT 161 31 0 29 Oct 2023
Optimization-Free Test-Time Adaptation for Cross-Person Activity RecognitionProceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (IMWUT), 2023 Shuoyuan Wang Yongfeng Zhang Huajun Xi Bob Zhang Lei Zhang Jianguo Huang TTA 289 20 0 28 Oct 2023
Unlocking the Potential of Prompt-Tuning in Bridging Generalized and Personalized Federated LearningComputer Vision and Pattern Recognition (CVPR), 2023 Wenlong Deng Christos Thrampoulidis Xiaoxiao Li 497 20 0 27 Oct 2023
MPrompt: Exploring Multi-level Prompt Tuning for Machine Reading ComprehensionConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Guoxin Chen Yiming Qian Bowen Wang Liangzhi Li 152 8 0 27 Oct 2023
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained ModelInternational Conference on Learning Representations (ICLR), 2023 Karsten Roth Lukas Thede Almut Sophia Koepke Oriol Vinyals Olivier J. Hénaff Zeynep Akata AAML 257 17 0 26 Oct 2023
CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language ModelConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Kaiyan Zhang Ning Ding Biqing Qi Xuekai Zhu Xinwei Long Bowen Zhou 239 5 0 24 Oct 2023
LoMAE: Low-level Vision Masked Autoencoders for Low-dose CT Denoising Dayang Wang Yongshun Xu Shuo Han Zhan Wu Li Zhou Bahareh Morovati Hengyong Yu MedIm 153 2 0 19 Oct 2023
Deep Neural Networks Can Learn Generalizable Same-Different Visual Relations Alexa R. Tartaglini Sheridan Feucht Michael A. Lepori Wai Keen Vong Charles Lovering Brenden M. Lake Ellie Pavlick OOD ViT 165 4 0 14 Oct 2023
ViT-A: Legged Robot Path Planning using Vision Transformer AIEEE-RAS International Conference on Humanoid Robots (Humanoids), 2023 Jianwei Liu Shirui Lyu Denis Hadjivelichkov Valerio Modugno Dimitrios Kanoulas 210 13 0 11 Oct 2023
Distilling Efficient Vision Transformers from CNNs for Semantic SegmentationPattern Recognition (Pattern Recogn.), 2023 Xueye Zheng Yunhao Luo Pengyuan Zhou Lin Wang 169 25 0 11 Oct 2023
Enhancing Representations through Heterogeneous Self-Supervised LearningIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Zhongyu Li Bo-Wen Yin Yongxiang Liu Tianpeng Liu Ming-Ming Cheng SSL 274 3 0 08 Oct 2023
Towards Free Data Selection with General-Purpose ModelsNeural Information Processing Systems (NeurIPS), 2023 Alessandro Mutti Mingyu Ding Patrizia Semeraro Wei Zhan 160 12 0 29 Sep 2023
Causal-DFQ: Causality Guided Data-free Network QuantizationIEEE International Conference on Computer Vision (ICCV), 2023 Yuzhang Shang Bingxin Xu Gaowen Liu Ramana Rao Kompella Yan Yan MQ CML 258 8 0 24 Sep 2023
RBFormer: Improve Adversarial Robustness of Transformer by Robust BiasBritish Machine Vision Conference (BMVC), 2023 Hao Cheng Jinhao Duan Hui Li Lyutianyang Zhang Jiahang Cao Ping Wang Jize Zhang Kaidi Xu Renjing Xu AAML 124 3 0 23 Sep 2023
Ano-SuPs: Multi-size anomaly detection for manufactured products by identifying suspected patches Hao Xu Juan Du Andi Wang YingCong Chen 222 1 0 20 Sep 2023
AnyOKP: One-Shot and Instance-Aware Object Keypoint Extraction with Pretrained ViTIEEE International Conference on Robotics and Automation (ICRA), 2023 Fangbo Qin Taogang Hou Shan Lin Kaiyuan Wang Michael C. Yip Shan Yu 123 0 0 15 Sep 2023
Keep It SimPool: Who Said Supervised Transformers Suffer from Attention Deficit?IEEE International Conference on Computer Vision (ICCV), 2023 Bill Psomas Ioannis Kakogeorgiou Konstantinos Karantzalos Yannis Avrithis ViT 180 14 0 13 Sep 2023
FLDNet: A Foreground-Aware Network for Polyp Segmentation Leveraging Long-Distance DependenciesInternational Conference on Neural Information Processing (ICONIP), 2023 Xuefeng Wei Xuan Zhou MedIm 117 0 0 12 Sep 2023
HAT: Hybrid Attention Transformer for Image RestorationIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Xiangyu Chen Xintao Wang Wenlong Zhang Xiangtao Kong Yu Qiao Jiantao Zhou Chao Dong 254 84 0 11 Sep 2023
Progressive Attention Guidance for Whole Slide Vulvovaginal Candidiasis ScreeningInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023 Jiangdong Cai Honglin Xiong Mao-Hong Cao Luyan Liu Lichi Zhang Qian Wang 102 4 0 06 Sep 2023
Continual Learning From a Stream of APIsIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Enneng Yang Zhenyi Wang Li Shen Nan Yin Tongliang Liu Guibing Guo Xingwei Wang Dacheng Tao CLL 239 5 0 31 Aug 2023
Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Colon Shikha Dubey Tushar Kataria Beatrice Knudsen Shireen Y. Elhabian 123 9 0 25 Aug 2023
Internal Cross-layer Gradients for Extending Homogeneity to Heterogeneity in Federated LearningInternational Conference on Learning Representations (ICLR), 2023 Yun-Hin Chan Rui Zhou Running Zhao Zhihan Jiang Edith C.H. Ngai FedML 169 10 0 22 Aug 2023
Exemplar-Free Continual Transformer with ConvolutionsIEEE International Conference on Computer Vision (ICCV), 2023 Anurag Roy Vinay Kumar Verma Sravan Voonna Kripabandhu Ghosh Saptarshi Ghosh Abir Das CLL BDL 110 12 0 22 Aug 2023
UnLoc: A Unified Framework for Video Localization TasksIEEE International Conference on Computer Vision (ICCV), 2023 Shengjia Yan Xuehan Xiong Arsha Nagrani Anurag Arnab Zhonghao Wang Weina Ge David A. Ross Cordelia Schmid 312 73 0 21 Aug 2023
Efficient Representation Learning for Healthcare with Cross-Architectural Self-SupervisionMachine Learning in Health Care (MLHC), 2023 P. Singh Jacopo Cirrone OOD SSL 163 2 0 19 Aug 2023
Diverse Cotraining Makes Strong Semi-Supervised SegmentorIEEE International Conference on Computer Vision (ICCV), 2023 Yijiang Li Xinjiang Wang Lihe Yang Xue Jiang Wayne Zhang Ying Gao 154 34 0 18 Aug 2023
OnUVS: Online Feature Decoupling Framework for High-Fidelity Ultrasound Video Synthesis Hangyu Zhou Dong Ni Ao Chang Xinrui Zhou Rusi Chen ... Yuhao Huang Tong Han Zhe-Yu Liu Deng-Ping Fan Xin Yang 128 2 0 16 Aug 2023
ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object DetectionPattern Recognition (Pattern Recogn.), 2023 Jifeng Shen Yifei Chen Yue Liu Xin Zuo Heng Fan Wankou Yang ViT 145 219 0 15 Aug 2023
Large-kernel Attention for Efficient and Robust Brain Lesion Segmentation Liam Chalcroft Ruben Lourencco Pereira Mikael Brudfors Andrew S. Kayser M. D’Esposito Cathy J. Price Ioannis Pappas John Ashburner ViT 3DV MedIm 173 9 0 14 Aug 2023
Which Tokens to Use? Investigating Token Reduction in Vision Transformers Joakim Bruslund Haurum Sergio Escalera Graham W. Taylor T. Moeslund ViT 234 61 0 09 Aug 2023
The Prospect of Enhancing Large-Scale Heterogeneous Federated Learning with Transformers Yulan Gao Zhaoxiang Hou Che-Sheng Yang Zengxiang Li Han Yu FedML 121 4 0 07 Aug 2023
Continual Domain Adaptation on Aerial Images under Gradually Degrading WeatherJournal of Applied Remote Sensing (JARS), 2023 C. S. Jahan Andreas E. Savakis 171 1 0 02 Aug 2023
Optical Flow boosts Unsupervised Localization and SegmentationIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2023 Xinyu Zhang Abdeslam Boularias 199 8 0 25 Jul 2023
Conditional Cross Attention Network for Multi-Space Embedding without Entanglement in Only a SINGLE NetworkIEEE International Conference on Computer Vision (ICCV), 2023 Chull Hwan Song Taebaek Hwang Jooyoung Yoon Shunghyun Choi Y. Gu 162 2 0 25 Jul 2023
A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic SegmentationIEEE International Conference on Computer Vision (ICCV), 2023 Jinjing Zhu Yuan Luo Xueye Zheng Hao Wang Lin Wang 134 41 0 24 Jul 2023
Robust face anti-spoofing framework with Convolutional Vision TransformerInternational Conference on Information Photonics (ICIP), 2023 Yunseung Lee Youngjun Kwak Jinho Shin CVBM ViT 137 6 0 24 Jul 2023
Learning Sparse Neural Networks with Identity LayersInternational Conference on Image and Graphics (ICIG), 2023 Mingjian Ni Guangyao Chen Xiawu Zheng Peixi Peng Liuliang Yuan Yonghong Tian 128 0 0 14 Jul 2023
What Happens During Finetuning of Vision Transformers: An Invariance Based Investigation Gabriele Merlin Vedant Nanda Ruchit Rawal Mariya Toneva 140 4 0 12 Jul 2023
Make A Long Image Short: Adaptive Token Length for Vision Transformers Yuqin Zhu Yichen Zhu ViT 181 21 0 05 Jul 2023
Hardwiring ViT Patch Selectivity into CNNs using Patch Mixing Ariel N. Lee Sarah Adel Bargal Janavi Kasera Stan Sclaroff Kate Saenko Nataniel Ruiz 183 0 0 30 Jun 2023
CellViT: Vision Transformers for Precise Cell Segmentation and Classification Fabian Horst Moritz Rempe Lukas Heine C. Seibold J. Keyl ... S. Ugurel J. Siveke Barbara Grünwald Jan Egger Jens Kleesiek MedIm ViT 145 191 0 27 Jun 2023
Accelerating Molecular Graph Neural Networks via Knowledge DistillationNeural Information Processing Systems (NeurIPS), 2023 Filip Ekstrom Kelvinius D. Georgiev Artur Toshev Johannes Gasteiger 233 14 0 26 Jun 2023
ExpPoint-MAE: Better interpretability and performance for self-supervised point cloud transformersIEEE Access (IEEE Access), 2023 Ioannis Romanelis Vlassis Fotis Konstantinos Moustakas Adrian Munteanu ViT 3DPC 293 5 0 19 Jun 2023
RedMotion: Motion Prediction via Redundancy Reduction Royden Wagner Omer Sahin Tas Marvin Klemp Carlos Fernandez Lopez Christoph Stiller 572 10 0 19 Jun 2023
Vista-Morph: Unsupervised Image Registration of Visible-Thermal Facial Pairs Catherine Ordun Edward Raff S. Purushotham 115 1 0 10 Jun 2023
FasterViT: Fast Vision Transformers with Hierarchical AttentionInternational Conference on Learning Representations (ICLR), 2023 Ali Hatamizadeh Greg Heinrich Hongxu Yin Andrew Tao J. Álvarez Jan Kautz Pavlo Molchanov ViT 303 104 0 09 Jun 2023
Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelsNeural Information Processing Systems (NeurIPS), 2023 G. Stein Jesse C. Cresswell Rasa Hosseinzadeh Yi Sui Brendan Leigh Ross Valentin Villecroze Zhaoyan Liu M. Volkovs J. E. T. Taylor Gabriel Loaiza-Ganem EGVM 346 152 0 07 Jun 2023
Instructive Feature Enhancement for Dichotomous Medical Image SegmentationInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023 Lian Liu Hangyu Zhou Jiongquan Chen Sijing Liu Wenlong Shi Dong Ni Deng-Ping Fan Xin Yang 115 8 0 06 Jun 2023

All Papers

Do Vision Transformers See Like Convolutional Neural Networks?

Papers citing "Do Vision Transformers See Like Convolutional Neural Networks?"