Escaping the Big Data Paradigm with Compact Transformers

12 April 2021

Papers citing "Escaping the Big Data Paradigm with Compact Transformers"

50 / 215 papers shown

Title
Two Birds, One Stone: A Unified Framework for Joint Learning of Image and Video Style Transfers Bohai Gu Heng Fan Libo Zhang 8 9 0 22 Apr 2023
$$R^{2}$Former: Unified $R$etrieval and $R$eranking Transformer for Place Recognition$ $R^{2}$ Former: Unified $R$ etrieval and $R$ eranking Transformer for Place Recognition Sijie Zhu Linjie Yang C. L. P. Chen M. Shah Xiaohui Shen Heng Wang ViT 28 87 0 06 Apr 2023
Astroformer: More Data Might not be all you need for Classification Rishit Dagli 18 7 0 03 Apr 2023
Machine Learning for Brain Disorders: Transformers and Visual Transformers Robin Courant Maika Edberg Nicolas Dufour Vicky Kalogeiton MedIm ViT 22 1 0 21 Mar 2023
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices Chen Tang Li Lyna Zhang Huiqiang Jiang Jiahang Xu Ting Cao Quanlu Zhang Yuqing Yang Zhi Wang Mao Yang 15 11 0 17 Mar 2023
Vector Quantized Time Series Generation with a Bidirectional Prior Model Daesoo Lee Sara Malacarne Erlend Aune BDL 32 25 0 08 Mar 2023
Magnification Invariant Medical Image Analysis: A Comparison of Convolutional Networks, Vision Transformers, and Token Mixers Pranav Jeevan Nikhil Cherian Kurian A. Sethi MedIm 11 1 0 22 Feb 2023
An Experimental Study of Byzantine-Robust Aggregation Schemes in Federated Learning Shenghui Li Edith C. H. Ngai Thiemo Voigt FedML AAML 14 51 0 14 Feb 2023
PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformer Zitong Yu Yuming Shen Jingang Shi Hengshuang Zhao Yawen Cui Jiehua Zhang Philip H. S. Torr Guoying Zhao ViT MedIm 29 80 0 07 Feb 2023
V1T: large-scale mouse V1 response prediction using a Vision Transformer Bryan M. Li I. M. Cornacchia Nathalie L Rochefort A. Onken 16 8 0 06 Feb 2023
POSTER++: A simpler and stronger facial expression recognition network Jia-ju Mao Rui Xu Xuesong Yin Yuan Chang Binling Nie Aibin Huang CVBM 19 38 0 28 Jan 2023
A benchmark for toxic comment classification on Civil Comments dataset Corentin Duchene Henri Jamet Pierre Guillaume Reda Dehak 10 8 0 26 Jan 2023
Enhancing ResNet Image Classification Performance by using Parameterized Hypercomplex Multiplication Nazmul Shahadat Anthony Maida 17 5 0 11 Jan 2023
Rethinking Vision Transformers for MobileNet Size and Speed Yanyu Li Ju Hu Yang Wen Georgios Evangelidis Kamyar Salahi Yanzhi Wang Sergey Tulyakov Jian Ren ViT 21 157 0 15 Dec 2022
Masked autoencoders are effective solution to transformer data-hungry Jia-ju Mao Honggu Zhou Xuesong Yin Binling Nie MedIm 25 6 0 12 Dec 2022
Position Embedding Needs an Independent Layer Normalization Runyi Yu Zhennan Wang Yinhuai Wang Kehan Li Yian Zhao Jian Andrew Zhang Guoli Song Jie Chen 13 1 0 10 Dec 2022
From CNNs to Shift-Invariant Twin Models Based on Complex Wavelets Hubert Leterme K. Polisano V. Perrier Alahari Karteek 21 1 0 01 Dec 2022
Bi-directional Feature Reconstruction Network for Fine-Grained Few-Shot Image Classification Jijie Wu Dongliang Chang Aneeshan Sain Xiaoxu Li Zhanyu Ma Jie Cao Jun Guo Yi-Zhe Song 19 35 0 30 Nov 2022
MPCViT: Searching for Accurate and Efficient MPC-Friendly Vision Transformer with Heterogeneous Attention Wenyuan Zeng Meng Li Wenjie Xiong Tong Tong Wen-jie Lu Jin Tan Runsheng Wang Ru Huang 22 20 0 25 Nov 2022
Spikeformer: A Novel Architecture for Training High-Performance Low-Latency Spiking Neural Network Yudong Li Yunlin Lei Xu Yang 16 26 0 19 Nov 2022
MultiCrossViT: Multimodal Vision Transformer for Schizophrenia Prediction using Structural MRI and Functional Network Connectivity Data Yuda Bi A. Abrol Z. Fu Vince D. Calhoun MedIm 8 3 0 12 Nov 2022
Token Transformer: Can class token help window-based transformer build better long-range interactions? Jia-ju Mao Yuan Chang Xuesong Yin 19 0 0 11 Nov 2022
StyleNAT: Giving Each Head a New Perspective Steven Walton Ali Hassani Xingqian Xu Zhangyang Wang Humphrey Shi ViT 20 22 0 10 Nov 2022
SPEAKER VGG CCT: Cross-corpus Speech Emotion Recognition with Speaker Embedding and Vision Transformers Alessandro Arezzo Stefano Berretti ViT 14 15 0 04 Nov 2022
Boosting Binary Neural Networks via Dynamic Thresholds Learning Jiehua Zhang Xueyang Zhang Z. Su Zitong Yu Yanghe Feng Xin Lu M. Pietikäinen Li Liu MQ 22 0 0 04 Nov 2022
PatchRot: A Self-Supervised Technique for Training Vision Transformers S. Chhabra Prabal Bijoy Dutta Hemanth Venkateswara Baoxin Li SSL ViT 8 2 0 27 Oct 2022
Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Data Huy Hoang Nguyen Matthew B. Blaschko S. Saarakkala A. Tiulpin MedIm AI4CE 48 15 0 25 Oct 2022
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification Junfei Xiao Yutong Bai Alan Yuille Zongwei Zhou MedIm ViT 30 59 0 23 Oct 2022
Optimizing Vision Transformers for Medical Image Segmentation Qianying Liu Chaitanya Kaul Jun Wang Christos Anagnostopoulos Roderick Murray-Smith F. Deligianni ViT MedIm 6 18 0 14 Oct 2022
TokenMixup: Efficient Attention-guided Token-level Data Augmentation for Transformers Hyeong Kyu Choi Joonmyung Choi Hyunwoo J. Kim ViT 21 35 0 14 Oct 2022
Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario Emily R. Bartusiak Edward J. Delp 17 12 0 14 Oct 2022
Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets Zhiying Lu Hongtao Xie Chuanbin Liu Yongdong Zhang ViT 10 56 0 12 Oct 2022
Learning Across Domains and Devices: Style-Driven Source-Free Domain Adaptation in Clustered Federated Learning Donald Shenaj Eros Fani Marco Toldo Debora Caldarola A. Tavera Umberto Michieli Marco Ciccone Pietro Zanuttigh Barbara Caputo FedML 21 39 0 05 Oct 2022
Towards Flexible Inductive Bias via Progressive Reparameterization Scheduling Yunsung Lee Gyuseong Lee Kwang-seok Ryoo Hyojun Go Jihye Park Seung Wook Kim 24 5 0 04 Oct 2022
Masked Spiking Transformer Ziqing Wang Yuetong Fang Jiahang Cao Qiang Zhang Zhongrui Wang Renjing Xu 20 38 0 03 Oct 2022
Attention Distillation: self-supervised vision transformer students need more guidance Kai Wang Fei Yang Joost van de Weijer ViT 17 16 0 03 Oct 2022
Dilated Neighborhood Attention Transformer Ali Hassani Humphrey Shi ViT MedIm 23 67 0 29 Sep 2022
Spikformer: When Spiking Neural Network Meets Transformer Zhaokun Zhou Yuesheng Zhu Chao He Yaowei Wang Shuicheng Yan Yonghong Tian Liuliang Yuan 143 236 0 29 Sep 2022
Exploring the Relationship between Architecture and Adversarially Robust Generalization Aishan Liu Shiyu Tang Siyuan Liang Ruihao Gong Boxi Wu Xianglong Liu Dacheng Tao AAML 21 18 0 28 Sep 2022
CCTCOVID: COVID-19 Detection from Chest X-Ray Images Using Compact Convolutional Transformers Abdolreza Marefat Mahdieh Marefat Javad Hassannataj Joloudari M. Nematollahi Reza Lashgari ViT MedIm 16 13 0 27 Sep 2022
SOCRATES: A Stereo Camera Trap for Monitoring of Biodiversity T. Haucke H. Kühl Volker Steinhage 23 11 0 19 Sep 2022
On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networks Hubert Leterme K. Polisano V. Perrier Alahari Karteek FAtt 38 2 0 19 Sep 2022
Bag of Tricks for FGSM Adversarial Training Zichao Li Li Liu Zeyu Wang Yuyin Zhou Cihang Xie AAML 14 6 0 06 Sep 2022
Multi-task Swin Transformer for Motion Artifacts Classification and Cardiac Magnetic Resonance Image Segmentation Michal K. Grzeszczyk Szymon Płotka Arkadiusz Sitek MedIm 8 1 0 06 Sep 2022
Artifact-Tolerant Clustering-Guided Contrastive Embedding Learning for Ophthalmic Images Mingzhi Shi Anagha Lokhande Mojtaba Sedigh Fazli Vishal Sharma Yu Tian ... Michael V. Boland Nazlee Zebardast D. Friedman Lucy Q. Shen Mengyu Wang MedIm 15 1 0 02 Sep 2022
VMFormer: End-to-End Video Matting with Transformer Jiacheng Li Vidit Goel Marianna Ohanyan Shant Navasardyan Yunchao Wei Humphrey Shi ViT 12 18 0 26 Aug 2022
Recent Progress in Transformer-based Medical Image Analysis Zhao-cheng Liu Qiujie Lv Ziduo Yang Yifan Li Chau Hung Lee Leizhao Shen MedIm 38 56 0 13 Aug 2022
Deep is a Luxury We Don't Have Ahmed Taha Yen Nhi Truong Vu Brent Mombourquette Thomas P. Matthews Jason Su Sadanand Singh ViT MedIm 16 2 0 11 Aug 2022
Surgical Skill Assessment via Video Semantic Aggregation Zhenqiang Li Lin Gu Weimin Wang Ryosuke Nakamura Yoichi Sato 20 13 0 04 Aug 2022
D3Former: Debiased Dual Distilled Transformer for Incremental Learning Abdel-rahman Mohamed Rushali Grandhe KJ Joseph Salman Khan F. Khan CLL 15 9 0 25 Jul 2022