Do Vision Transformers See Like Convolutional Neural Networks?

19 August 2021

Alexey Dosovitskiy

Papers citing "Do Vision Transformers See Like Convolutional Neural Networks?"

50 / 440 papers shown

Title
Distilling Efficient Vision Transformers from CNNs for Semantic Segmentation Xueye Zheng Yunhao Luo Pengyuan Zhou Lin Wang 27 12 0 11 Oct 2023
Enhancing Representations through Heterogeneous Self-Supervised Learning Zhongyu Li Bo-Wen Yin Yongxiang Liu Li Liu Ming-Ming Cheng SSL 21 2 0 08 Oct 2023
Distilling Inductive Bias: Knowledge Distillation Beyond Model Compression Gousia Habib Tausifa Jan Saleem Brejesh Lall VLM 25 0 0 30 Sep 2023
Towards Free Data Selection with General-Purpose Models Alessandro Mutti Mingyu Ding Patrizia Semeraro Wei Zhan 29 9 0 29 Sep 2023
Causal-DFQ: Causality Guided Data-free Network Quantization Yuzhang Shang Bingxin Xu Gaowen Liu Ramana Rao Kompella Yan Yan MQ CML 11 8 0 24 Sep 2023
RBFormer: Improve Adversarial Robustness of Transformer by Robust Bias Hao Cheng Jinhao Duan Hui Li Lyutianyang Zhang Jiahang Cao Ping Wang Jize Zhang Kaidi Xu Renjing Xu AAML 27 3 0 23 Sep 2023
Ano-SuPs: Multi-size anomaly detection for manufactured products by identifying suspected patches Hao Xu Juan Du Andi Wang YingCong Chen 19 1 0 20 Sep 2023
AnyOKP: One-Shot and Instance-Aware Object Keypoint Extraction with Pretrained ViT Fangbo Qin Taogang Hou Shan Lin Kaiyuan Wang Michael C. Yip Shan Yu 19 0 0 15 Sep 2023
Keep It SimPool: Who Said Supervised Transformers Suffer from Attention Deficit? Bill Psomas Ioannis Kakogeorgiou Konstantinos Karantzalos Yannis Avrithis ViT 25 8 0 13 Sep 2023
FLDNet: A Foreground-Aware Network for Polyp Segmentation Leveraging Long-Distance Dependencies Xuefeng Wei Xuan Zhou MedIm 22 0 0 12 Sep 2023
HAT: Hybrid Attention Transformer for Image Restoration Xiangyu Chen Xintao Wang Wenlong Zhang Xiangtao Kong Yu Qiao Jiantao Zhou Chao Dong 24 44 0 11 Sep 2023
Progressive Attention Guidance for Whole Slide Vulvovaginal Candidiasis Screening Jiangdong Cai Honglin Xiong Mao-Hong Cao Luyan Liu Lichi Zhang Qian Wang 13 4 0 06 Sep 2023
Continual Learning From a Stream of APIs Enneng Yang Zhenyi Wang Li Shen Nan Yin Tongliang Liu Guibing Guo Xingwei Wang Dacheng Tao CLL 22 3 0 31 Aug 2023
Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Colon Shikha Dubey Tushar Kataria Beatrice S. Knudsen Shireen Elhabian 19 6 0 25 Aug 2023
Internal Cross-layer Gradients for Extending Homogeneity to Heterogeneity in Federated Learning Yun-Hin Chan Rui Zhou Running Zhao Zhihan Jiang Edith C. H. Ngai FedML 30 8 0 22 Aug 2023
Exemplar-Free Continual Transformer with Convolutions Anurag Roy Vinay K. Verma Sravan Voonna Kripabandhu Ghosh Saptarshi Ghosh Abir Das CLL BDL 15 10 0 22 Aug 2023
UnLoc: A Unified Framework for Video Localization Tasks Shengjia Yan Xuehan Xiong Arsha Nagrani Anurag Arnab Zhonghao Wang Weina Ge David A. Ross Cordelia Schmid 22 53 0 21 Aug 2023
Efficient Representation Learning for Healthcare with Cross-Architectural Self-Supervision P. Singh Jacopo Cirrone OOD SSL 24 2 0 19 Aug 2023
Diverse Cotraining Makes Strong Semi-Supervised Segmentor Yijiang Li Xinjiang Wang Lihe Yang Litong Feng Wayne Zhang Ying Gao 14 15 0 18 Aug 2023
OnUVS: Online Feature Decoupling Framework for High-Fidelity Ultrasound Video Synthesis Hangyu Zhou Dong Ni Ao Chang Xinrui Zhou Rusi Chen ... Yuhao Huang Tong Han Zhe-Yu Liu Deng-Ping Fan Xin Yang 12 1 0 16 Aug 2023
ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detection Jifeng Shen Yifei Chen Yue Liu Xin Zuo Heng Fan Wankou Yang ViT 21 88 0 15 Aug 2023
Large-kernel Attention for Efficient and Robust Brain Lesion Segmentation Liam Chalcroft Ruben Lourencco Pereira Mikael Brudfors Andrew S. Kayser M. D’Esposito Cathy J. Price Ioannis Pappas John Ashburner ViT 3DV MedIm 19 8 0 14 Aug 2023
Which Tokens to Use? Investigating Token Reduction in Vision Transformers Joakim Bruslund Haurum Sergio Escalera Graham W. Taylor T. Moeslund ViT 38 33 0 09 Aug 2023
The Prospect of Enhancing Large-Scale Heterogeneous Federated Learning with Transformers Yulan Gao Zhaoxiang Hou Che-Sheng Yang Zengxiang Li Han Yu FedML 19 2 0 07 Aug 2023
Continual Domain Adaptation on Aerial Images under Gradually Degrading Weather C. S. Jahan Andreas E. Savakis 9 1 0 02 Aug 2023
Optical Flow boosts Unsupervised Localization and Segmentation Xinyu Zhang Abdeslam Boularias 18 5 0 25 Jul 2023
Conditional Cross Attention Network for Multi-Space Embedding without Entanglement in Only a SINGLE Network Chull Hwan Song Taebaek Hwang Jooyoung Yoon Shunghyun Choi Y. Gu 29 0 0 25 Jul 2023
A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation Jinjing Zhu Yuan Luo Xueye Zheng Hao Wang Lin Wang 14 33 0 24 Jul 2023
Robust face anti-spoofing framework with Convolutional Vision Transformer Yunseung Lee Youngjun Kwak Jinho Shin CVBM ViT 15 5 0 24 Jul 2023
Learning Sparse Neural Networks with Identity Layers Mingjian Ni Guangyao Chen Xiawu Zheng Peixi Peng Liuliang Yuan Yonghong Tian 8 0 0 14 Jul 2023
What Happens During Finetuning of Vision Transformers: An Invariance Based Investigation Gabriele Merlin Vedant Nanda Ruchit Rawal Mariya Toneva 15 3 0 12 Jul 2023
Make A Long Image Short: Adaptive Token Length for Vision Transformers Yuqin Zhu Yichen Zhu ViT 57 17 0 05 Jul 2023
Hardwiring ViT Patch Selectivity into CNNs using Patch Mixing Ariel N. Lee Sarah Adel Bargal Janavi Kasera Stan Sclaroff Kate Saenko Nataniel Ruiz 25 0 0 30 Jun 2023
CellViT: Vision Transformers for Precise Cell Segmentation and Classification Fabian Horst Moritz Rempe Lukas Heine C. Seibold J. Keyl ... S. Ugurel J. Siveke Barbara Grünwald Jan Egger Jens Kleesiek MedIm ViT 18 88 0 27 Jun 2023
Accelerating Molecular Graph Neural Networks via Knowledge Distillation Filip Ekstrom Kelvinius D. Georgiev Artur P. Toshev Johannes Gasteiger 24 6 0 26 Jun 2023
ExpPoint-MAE: Better interpretability and performance for self-supervised point cloud transformers Ioannis Romanelis Vlassis Fotis Konstantinos Moustakas Adrian Munteanu ViT 3DPC 21 4 0 19 Jun 2023
RedMotion: Motion Prediction via Redundancy Reduction Royden Wagner Ömer Sahin Tas Marvin Klemp Carlos Fernandez Lopez Christoph Stiller 44 6 0 19 Jun 2023
Vista-Morph: Unsupervised Image Registration of Visible-Thermal Facial Pairs Catherine Ordun Edward Raff S. Purushotham 21 1 0 10 Jun 2023
FasterViT: Fast Vision Transformers with Hierarchical Attention Ali Hatamizadeh Greg Heinrich Hongxu Yin Andrew Tao J. Álvarez Jan Kautz Pavlo Molchanov ViT 17 66 0 09 Jun 2023
Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models G. Stein Jesse C. Cresswell Rasa Hosseinzadeh Yi Sui Brendan Leigh Ross Valentin Villecroze Zhaoyan Liu Anthony L. Caterini J. E. T. Taylor G. Loaiza-Ganem EGVM 30 95 0 07 Jun 2023
Instructive Feature Enhancement for Dichotomous Medical Image Segmentation Lian Liu Hangyu Zhou Jiongquan Chen Sijing Liu Wenlong Shi Dong Ni Deng-Ping Fan Xin Yang 24 5 0 06 Jun 2023
Deep neural networks architectures from the perspective of manifold learning German Magai AAML AI4CE 16 6 0 06 Jun 2023
Masked Autoencoders with Multi-Window Local-Global Attention Are Better Audio Learners Sarthak Yadav Sergios Theodoridis Lars Kai Hansen Z. Tan 20 7 0 01 Jun 2023
ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning Xiao Xu Bei Li Chenfei Wu Shao-Yen Tseng Anahita Bhiwandiwalla Shachar Rosenman Vasudev Lal Wanxiang Che Nan Duan AIFin VLM 26 2 0 31 May 2023
Pointwise Representational Similarity Camila Kolling Till Speicher Vedant Nanda Mariya Toneva Krishna P. Gummadi 13 1 0 30 May 2023
Training Transitive and Commutative Multimodal Transformers with LoReTTa Manuel Tran Yashin Dicente Cid Amal Lahiani Fabian J. Theis Tingying Peng Eldad Klaiman 18 2 0 23 May 2023
Efficient Large-Scale Visual Representation Learning And Evaluation Eden Dolev A. Awad Denisa Roberts Zahra Ebrahimzadeh Marcin Mejran Vaibhav Malpani Mahir Yavuz 30 0 0 22 May 2023
Similarity of Neural Network Models: A Survey of Functional and Representational Measures Max Klabunde Tobias Schumacher M. Strohmaier Florian Lemmerich 47 64 0 10 May 2023
Application of Artificial Intelligence in the Classification of Microscopical Starch Images for Drug Formulation Marvellous Ajala Blessing Oko David Oba-Fidelis Joycelyn Iyasele J. Odimegwu 20 0 0 09 May 2023
Learning Summary-Worthy Visual Representation for Abstractive Summarization in Video Zenan Xu Xiaojun Meng Yasheng Wang Qinliang Su Zexuan Qiu Xin Jiang Qun Liu 22 3 0 08 May 2023