Escaping the Big Data Paradigm with Compact Transformers

12 April 2021

Papers citing "Escaping the Big Data Paradigm with Compact Transformers"

50 / 215 papers shown

Title
Online Continual Learning with Contrastive Vision Transformer Zhen Wang Liu Liu Yajing Kong Jiaxian Guo Dacheng Tao CLL 18 29 0 24 Jul 2022
Locality Guidance for Improving Vision Transformers on Tiny Datasets Kehan Li Runyi Yu Zhennan Wang Li-ming Yuan Guoli Song Jie Chen ViT 17 43 0 20 Jul 2022
Multi-manifold Attention for Vision Transformers D. Konstantinidis Ilias Papastratis K. Dimitropoulos P. Daras ViT 14 16 0 18 Jul 2022
Big Learning Yulai Cong Miaoyun Zhao AI4CE 19 0 0 08 Jul 2022
Learning Sequential Descriptors for Sequence-based Visual Place Recognition R. Mereu Gabriele Trivigno Gabriele Berton Carlo Masone Barbara Caputo 8 30 0 08 Jul 2022
Vision Transformers: State of the Art and Research Challenges Bo-Kai Ruan Hong-Han Shuai Wen-Huang Cheng ViT 16 17 0 07 Jul 2022
Accurate and fast identification of minimally prepared bacteria phenotypes using Raman spectroscopy assisted by machine learning B. L. Thomsen J. Christensen O. Rodenko I. Usenov R. B. Grønnemose T. Andersen M. Lassen 11 22 0 27 Jun 2022
Quantization Robust Federated Learning for Efficient Inference on Heterogeneous Devices Kartik Gupta Marios Fournarakis M. Reisser Christos Louizos Markus Nagel FedML 14 14 0 22 Jun 2022
EfficientFormer: Vision Transformers at MobileNet Speed Yanyu Li Geng Yuan Yang Wen Eric Hu Georgios Evangelidis Sergey Tulyakov Yanzhi Wang Jian Ren ViT 16 343 0 02 Jun 2022
The Fully Convolutional Transformer for Medical Image Segmentation Athanasios Tragakis Chaitanya Kaul Roderick Murray-Smith D. Husmeier ViT MedIm 12 56 0 01 Jun 2022
Few-Shot Diffusion Models Giorgio Giannone Didrik Nielsen Ole Winther DiffM 171 49 0 30 May 2022
WaveMix: A Resource-efficient Neural Network for Image Analysis Pranav Jeevan Kavitha Viswanathan S. AnanduA A. Sethi 13 19 0 28 May 2022
On the Symmetries of Deep Learning Models and their Internal Representations Charles Godfrey Davis Brown Tegan H. Emerson Henry Kvinge 20 40 0 27 May 2022
FedBR: Improving Federated Learning on Heterogeneous Data via Local Learning Bias Reduction Yongxin Guo Xiaoying Tang Tao R. Lin FedML 49 27 0 26 May 2022
Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning Chong Ma Lin Zhao Yuzhong Chen Lu Zhang Zhe Xiao ... Tuo Zhang Qian Wang Dinggang Shen Dajiang Zhu Tianming Liu ViT MedIm 29 30 0 25 May 2022
One-Pixel Shortcut: on the Learning Preference of Deep Neural Networks Shutong Wu Sizhe Chen Cihang Xie X. Huang AAML 40 26 0 24 May 2022
Test-Time Robust Personalization for Federated Learning Liang Jiang Tao R. Lin FedML OOD TTA 75 43 0 22 May 2022
Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning Yuzhong Chen Zhe Xiao Lin Zhao Lu Zhang Haixing Dai ... Tuo Zhang Changying Li Dajiang Zhu Tianming Liu Xi Jiang 36 18 0 20 May 2022
ImageSig: A signature transform for ultra-lightweight image recognition Mohamed Ramzy Ibrahim Terry Lyons VLM 19 7 0 13 May 2022
CV4Code: Sourcecode Understanding via Visual Code Representations Ruibo Shi Lili Tao Rohan Saphal Fran Silavong Sean J. Moran 13 0 0 11 May 2022
Synthesized Speech Detection Using Convolutional Transformer-Based Spectrogram Analysis Emily R. Bartusiak Edward J. Delp ViT 20 18 0 03 May 2022
Adaptive Split-Fusion Transformer Zixuan Su Hao Zhang Jingjing Chen Lei Pang Chong-Wah Ngo Yu-Gang Jiang ViT 9 7 0 26 Apr 2022
Deeper Insights into the Robustness of ViTs towards Common Corruptions Rui Tian Zuxuan Wu Qi Dai Han Hu Yu-Gang Jiang ViT AAML 14 4 0 26 Apr 2022
Neighborhood Attention Transformer Ali Hassani Steven Walton Jiacheng Li Shengjia Li Humphrey Shi ViT AI4TS 14 249 0 14 Apr 2022
Malceiver: Perceiver with Hierarchical and Multi-modal Features for Android Malware Detection Niall McLaughlin 20 2 0 12 Apr 2022
Deep Visual Geo-localization Benchmark Gabriele Berton R. Mereu Gabriele Trivigno Carlo Masone G. Csurka Torsten Sattler Barbara Caputo ObjD 26 87 0 07 Apr 2022
Low-Dose CT Denoising via Sinogram Inner-Structure Transformer Liutao Yang Zhongnian Li Rongjun Ge Junyong Zhao Haipeng Si Daoqiang Zhang MedIm 11 52 0 07 Apr 2022
Rethinking Visual Geo-localization for Large-Scale Applications Gabriele Berton Carlo Masone Barbara Caputo ObjD 8 153 0 05 Apr 2022
Revisiting a kNN-based Image Classification System with High-capacity Storage K. Nakata Youyang Ng Daisuke Miyashita A. Maki Yu Lin J. Deguchi 19 26 0 03 Apr 2022
Brain-inspired Multilayer Perceptron with Spiking Neurons Wenshuo Li Hanting Chen Jianyuan Guo Ziyang Zhang Yunhe Wang 25 34 0 28 Mar 2022
WaveMix: Resource-efficient Token Mixing for Images Pranav Jeevan A. Sethi 8 10 0 07 Mar 2022
ViT-P: Rethinking Data-efficient Vision Transformers from Locality B. Chen Ran A. Wang Di Ming Xin Feng ViT 11 7 0 04 Mar 2022
Auto-scaling Vision Transformers without Training Wuyang Chen Wei Huang Xianzhi Du Xiaodan Song Zhangyang Wang Denny Zhou ViT 25 23 0 24 Feb 2022
RadioTransformer: A Cascaded Global-Focal Transformer for Visual Attention-guided Disease Classification Moinak Bhattacharya Shubham Jain Prateek Prasanna ViT MedIm 9 33 0 23 Feb 2022
Convolutional Xformers for Vision Pranav Jeevan Amit Sethi ViT 39 12 0 25 Jan 2022
SeMask: Semantically Masked Transformers for Semantic Segmentation Jitesh Jain Anukriti Singh Nikita Orlov Zilong Huang Jiachen Li Steven Walton Humphrey Shi ViT 24 92 0 23 Dec 2021
Understanding Memorization from the Perspective of Optimization via Efficient Influence Estimation Futong Liu Tao R. Lin Martin Jaggi TDI 12 8 0 16 Dec 2021
Couplformer:Rethinking Vision Transformer with Coupling Attention Map Hai Lan Xihao Wang Xian Wei ViT 17 3 0 10 Dec 2021
Non-Intrusive Binaural Speech Intelligibility Prediction from Discrete Latent Representations Alex F. McKinney Benjamin Cauchi 9 3 0 24 Nov 2021
CpT: Convolutional Point Transformer for 3D Point Cloud Processing Chaitanya Kaul Joshua Mitton H. Dai Roderick Murray-Smith 3DPC 17 6 0 21 Nov 2021
Full-attention based Neural Architecture Search using Context Auto-regression Yuan Zhou Haiyang Wang Shuwei Huo Boyu Wang 17 3 0 13 Nov 2021
Hybrid BYOL-ViT: Efficient approach to deal with small datasets Safwen Naimi Rien van Leeuwen W. Souidène S. B. Saoud SSL ViT 17 2 0 08 Nov 2021
Noisy Feature Mixup S. H. Lim N. Benjamin Erichson Francisco Utrera Winnie Xu Michael W. Mahoney AAML 8 37 0 05 Oct 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 207 484 0 01 Oct 2021
UFO-ViT: High Performance Linear Vision Transformer without Softmax Jeonggeun Song ViT 106 20 0 29 Sep 2021
Audiomer: A Convolutional Transformer For Keyword Spotting Surya Kant Sahu Sai Mitheran Juhi Kamdar Meet Gandhi 24 8 0 21 Sep 2021
ConvMLP: Hierarchical Convolutional MLPs for Vision Jiachen Li Ali Hassani Steven Walton Humphrey Shi 33 55 0 09 Sep 2021
Learning the Physics of Particle Transport via Transformers O. Pastor-Serrano Zoltán Perkó MedIm 11 13 0 08 Sep 2021
Reiterative Domain Aware Multi-Target Adaptation Sudipan Saha Shan Zhao Nasrullah Sheikh Xiao Xiang Zhu 19 1 0 26 Aug 2021
SERF: Towards better training of deep neural networks using log-Softplus ERror activation Function Sayan Nag Mayukh Bhattacharyya LLMSV 17 22 0 21 Aug 2021