ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2104.05704
  4. Cited By
Escaping the Big Data Paradigm with Compact Transformers

Escaping the Big Data Paradigm with Compact Transformers

12 April 2021
Ali Hassani
Steven Walton
Nikhil Shah
Abulikemu Abuduweili
Jiachen Li
Humphrey Shi
ArXivPDFHTML

Papers citing "Escaping the Big Data Paradigm with Compact Transformers"

50 / 215 papers shown
Title
Online Continual Learning with Contrastive Vision Transformer
Online Continual Learning with Contrastive Vision Transformer
Zhen Wang
Liu Liu
Yajing Kong
Jiaxian Guo
Dacheng Tao
CLL
18
29
0
24 Jul 2022
Locality Guidance for Improving Vision Transformers on Tiny Datasets
Locality Guidance for Improving Vision Transformers on Tiny Datasets
Kehan Li
Runyi Yu
Zhennan Wang
Li-ming Yuan
Guoli Song
Jie Chen
ViT
17
43
0
20 Jul 2022
Multi-manifold Attention for Vision Transformers
Multi-manifold Attention for Vision Transformers
D. Konstantinidis
Ilias Papastratis
K. Dimitropoulos
P. Daras
ViT
14
16
0
18 Jul 2022
Big Learning
Big Learning
Yulai Cong
Miaoyun Zhao
AI4CE
19
0
0
08 Jul 2022
Learning Sequential Descriptors for Sequence-based Visual Place
  Recognition
Learning Sequential Descriptors for Sequence-based Visual Place Recognition
R. Mereu
Gabriele Trivigno
Gabriele Berton
Carlo Masone
Barbara Caputo
8
30
0
08 Jul 2022
Vision Transformers: State of the Art and Research Challenges
Vision Transformers: State of the Art and Research Challenges
Bo-Kai Ruan
Hong-Han Shuai
Wen-Huang Cheng
ViT
16
17
0
07 Jul 2022
Accurate and fast identification of minimally prepared bacteria
  phenotypes using Raman spectroscopy assisted by machine learning
Accurate and fast identification of minimally prepared bacteria phenotypes using Raman spectroscopy assisted by machine learning
B. L. Thomsen
J. Christensen
O. Rodenko
I. Usenov
R. B. Grønnemose
T. Andersen
M. Lassen
11
22
0
27 Jun 2022
Quantization Robust Federated Learning for Efficient Inference on
  Heterogeneous Devices
Quantization Robust Federated Learning for Efficient Inference on Heterogeneous Devices
Kartik Gupta
Marios Fournarakis
M. Reisser
Christos Louizos
Markus Nagel
FedML
14
14
0
22 Jun 2022
EfficientFormer: Vision Transformers at MobileNet Speed
EfficientFormer: Vision Transformers at MobileNet Speed
Yanyu Li
Geng Yuan
Yang Wen
Eric Hu
Georgios Evangelidis
Sergey Tulyakov
Yanzhi Wang
Jian Ren
ViT
16
343
0
02 Jun 2022
The Fully Convolutional Transformer for Medical Image Segmentation
The Fully Convolutional Transformer for Medical Image Segmentation
Athanasios Tragakis
Chaitanya Kaul
Roderick Murray-Smith
D. Husmeier
ViT
MedIm
12
56
0
01 Jun 2022
Few-Shot Diffusion Models
Few-Shot Diffusion Models
Giorgio Giannone
Didrik Nielsen
Ole Winther
DiffM
171
49
0
30 May 2022
WaveMix: A Resource-efficient Neural Network for Image Analysis
WaveMix: A Resource-efficient Neural Network for Image Analysis
Pranav Jeevan
Kavitha Viswanathan
S. AnanduA
A. Sethi
13
19
0
28 May 2022
On the Symmetries of Deep Learning Models and their Internal
  Representations
On the Symmetries of Deep Learning Models and their Internal Representations
Charles Godfrey
Davis Brown
Tegan H. Emerson
Henry Kvinge
20
40
0
27 May 2022
FedBR: Improving Federated Learning on Heterogeneous Data via Local
  Learning Bias Reduction
FedBR: Improving Federated Learning on Heterogeneous Data via Local Learning Bias Reduction
Yongxin Guo
Xiaoying Tang
Tao R. Lin
FedML
49
27
0
26 May 2022
Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning
Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning
Chong Ma
Lin Zhao
Yuzhong Chen
Lu Zhang
Zhe Xiao
...
Tuo Zhang
Qian Wang
Dinggang Shen
Dajiang Zhu
Tianming Liu
ViT
MedIm
29
30
0
25 May 2022
One-Pixel Shortcut: on the Learning Preference of Deep Neural Networks
One-Pixel Shortcut: on the Learning Preference of Deep Neural Networks
Shutong Wu
Sizhe Chen
Cihang Xie
X. Huang
AAML
40
26
0
24 May 2022
Test-Time Robust Personalization for Federated Learning
Test-Time Robust Personalization for Federated Learning
Liang Jiang
Tao R. Lin
FedML
OOD
TTA
75
43
0
22 May 2022
Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning
Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning
Yuzhong Chen
Zhe Xiao
Lin Zhao
Lu Zhang
Haixing Dai
...
Tuo Zhang
Changying Li
Dajiang Zhu
Tianming Liu
Xi Jiang
36
18
0
20 May 2022
ImageSig: A signature transform for ultra-lightweight image recognition
ImageSig: A signature transform for ultra-lightweight image recognition
Mohamed Ramzy Ibrahim
Terry Lyons
VLM
19
7
0
13 May 2022
CV4Code: Sourcecode Understanding via Visual Code Representations
CV4Code: Sourcecode Understanding via Visual Code Representations
Ruibo Shi
Lili Tao
Rohan Saphal
Fran Silavong
Sean J. Moran
13
0
0
11 May 2022
Synthesized Speech Detection Using Convolutional Transformer-Based
  Spectrogram Analysis
Synthesized Speech Detection Using Convolutional Transformer-Based Spectrogram Analysis
Emily R. Bartusiak
Edward J. Delp
ViT
20
18
0
03 May 2022
Adaptive Split-Fusion Transformer
Adaptive Split-Fusion Transformer
Zixuan Su
Hao Zhang
Jingjing Chen
Lei Pang
Chong-Wah Ngo
Yu-Gang Jiang
ViT
9
7
0
26 Apr 2022
Deeper Insights into the Robustness of ViTs towards Common Corruptions
Deeper Insights into the Robustness of ViTs towards Common Corruptions
Rui Tian
Zuxuan Wu
Qi Dai
Han Hu
Yu-Gang Jiang
ViT
AAML
14
4
0
26 Apr 2022
Neighborhood Attention Transformer
Neighborhood Attention Transformer
Ali Hassani
Steven Walton
Jiacheng Li
Shengjia Li
Humphrey Shi
ViT
AI4TS
14
249
0
14 Apr 2022
Malceiver: Perceiver with Hierarchical and Multi-modal Features for
  Android Malware Detection
Malceiver: Perceiver with Hierarchical and Multi-modal Features for Android Malware Detection
Niall McLaughlin
20
2
0
12 Apr 2022
Deep Visual Geo-localization Benchmark
Deep Visual Geo-localization Benchmark
Gabriele Berton
R. Mereu
Gabriele Trivigno
Carlo Masone
G. Csurka
Torsten Sattler
Barbara Caputo
ObjD
26
87
0
07 Apr 2022
Low-Dose CT Denoising via Sinogram Inner-Structure Transformer
Low-Dose CT Denoising via Sinogram Inner-Structure Transformer
Liutao Yang
Zhongnian Li
Rongjun Ge
Junyong Zhao
Haipeng Si
Daoqiang Zhang
MedIm
11
52
0
07 Apr 2022
Rethinking Visual Geo-localization for Large-Scale Applications
Rethinking Visual Geo-localization for Large-Scale Applications
Gabriele Berton
Carlo Masone
Barbara Caputo
ObjD
8
153
0
05 Apr 2022
Revisiting a kNN-based Image Classification System with High-capacity
  Storage
Revisiting a kNN-based Image Classification System with High-capacity Storage
K. Nakata
Youyang Ng
Daisuke Miyashita
A. Maki
Yu Lin
J. Deguchi
19
26
0
03 Apr 2022
Brain-inspired Multilayer Perceptron with Spiking Neurons
Brain-inspired Multilayer Perceptron with Spiking Neurons
Wenshuo Li
Hanting Chen
Jianyuan Guo
Ziyang Zhang
Yunhe Wang
25
34
0
28 Mar 2022
WaveMix: Resource-efficient Token Mixing for Images
WaveMix: Resource-efficient Token Mixing for Images
Pranav Jeevan
A. Sethi
8
10
0
07 Mar 2022
ViT-P: Rethinking Data-efficient Vision Transformers from Locality
ViT-P: Rethinking Data-efficient Vision Transformers from Locality
B. Chen
Ran A. Wang
Di Ming
Xin Feng
ViT
11
7
0
04 Mar 2022
Auto-scaling Vision Transformers without Training
Auto-scaling Vision Transformers without Training
Wuyang Chen
Wei Huang
Xianzhi Du
Xiaodan Song
Zhangyang Wang
Denny Zhou
ViT
25
23
0
24 Feb 2022
RadioTransformer: A Cascaded Global-Focal Transformer for Visual
  Attention-guided Disease Classification
RadioTransformer: A Cascaded Global-Focal Transformer for Visual Attention-guided Disease Classification
Moinak Bhattacharya
Shubham Jain
Prateek Prasanna
ViT
MedIm
9
33
0
23 Feb 2022
Convolutional Xformers for Vision
Convolutional Xformers for Vision
Pranav Jeevan
Amit Sethi
ViT
39
12
0
25 Jan 2022
SeMask: Semantically Masked Transformers for Semantic Segmentation
SeMask: Semantically Masked Transformers for Semantic Segmentation
Jitesh Jain
Anukriti Singh
Nikita Orlov
Zilong Huang
Jiachen Li
Steven Walton
Humphrey Shi
ViT
24
92
0
23 Dec 2021
Understanding Memorization from the Perspective of Optimization via
  Efficient Influence Estimation
Understanding Memorization from the Perspective of Optimization via Efficient Influence Estimation
Futong Liu
Tao R. Lin
Martin Jaggi
TDI
12
8
0
16 Dec 2021
Couplformer:Rethinking Vision Transformer with Coupling Attention Map
Couplformer:Rethinking Vision Transformer with Coupling Attention Map
Hai Lan
Xihao Wang
Xian Wei
ViT
17
3
0
10 Dec 2021
Non-Intrusive Binaural Speech Intelligibility Prediction from Discrete
  Latent Representations
Non-Intrusive Binaural Speech Intelligibility Prediction from Discrete Latent Representations
Alex F. McKinney
Benjamin Cauchi
9
3
0
24 Nov 2021
CpT: Convolutional Point Transformer for 3D Point Cloud Processing
CpT: Convolutional Point Transformer for 3D Point Cloud Processing
Chaitanya Kaul
Joshua Mitton
H. Dai
Roderick Murray-Smith
3DPC
17
6
0
21 Nov 2021
Full-attention based Neural Architecture Search using Context
  Auto-regression
Full-attention based Neural Architecture Search using Context Auto-regression
Yuan Zhou
Haiyang Wang
Shuwei Huo
Boyu Wang
17
3
0
13 Nov 2021
Hybrid BYOL-ViT: Efficient approach to deal with small datasets
Hybrid BYOL-ViT: Efficient approach to deal with small datasets
Safwen Naimi
Rien van Leeuwen
W. Souidène
S. B. Saoud
SSL
ViT
17
2
0
08 Nov 2021
Noisy Feature Mixup
Noisy Feature Mixup
S. H. Lim
N. Benjamin Erichson
Francisco Utrera
Winnie Xu
Michael W. Mahoney
AAML
8
37
0
05 Oct 2021
ResNet strikes back: An improved training procedure in timm
ResNet strikes back: An improved training procedure in timm
Ross Wightman
Hugo Touvron
Hervé Jégou
AI4TS
207
484
0
01 Oct 2021
UFO-ViT: High Performance Linear Vision Transformer without Softmax
UFO-ViT: High Performance Linear Vision Transformer without Softmax
Jeonggeun Song
ViT
106
20
0
29 Sep 2021
Audiomer: A Convolutional Transformer For Keyword Spotting
Surya Kant Sahu
Sai Mitheran
Juhi Kamdar
Meet Gandhi
24
8
0
21 Sep 2021
ConvMLP: Hierarchical Convolutional MLPs for Vision
ConvMLP: Hierarchical Convolutional MLPs for Vision
Jiachen Li
Ali Hassani
Steven Walton
Humphrey Shi
33
55
0
09 Sep 2021
Learning the Physics of Particle Transport via Transformers
Learning the Physics of Particle Transport via Transformers
O. Pastor-Serrano
Zoltán Perkó
MedIm
11
13
0
08 Sep 2021
Reiterative Domain Aware Multi-Target Adaptation
Reiterative Domain Aware Multi-Target Adaptation
Sudipan Saha
Shan Zhao
Nasrullah Sheikh
Xiao Xiang Zhu
19
1
0
26 Aug 2021
SERF: Towards better training of deep neural networks using log-Softplus
  ERror activation Function
SERF: Towards better training of deep neural networks using log-Softplus ERror activation Function
Sayan Nag
Mayukh Bhattacharyya
LLMSV
17
22
0
21 Aug 2021
Previous
12345
Next