ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2104.05704
  4. Cited By
Escaping the Big Data Paradigm with Compact Transformers

Escaping the Big Data Paradigm with Compact Transformers

12 April 2021
Ali Hassani
Steven Walton
Nikhil Shah
Abulikemu Abuduweili
Jiachen Li
Humphrey Shi
ArXivPDFHTML

Papers citing "Escaping the Big Data Paradigm with Compact Transformers"

50 / 215 papers shown
Title
Beyond Attention: Toward Machines with Intrinsic Higher Mental States
Beyond Attention: Toward Machines with Intrinsic Higher Mental States
Ahsan Adeel
OffRL
LRM
19
0
0
02 May 2025
SteelBlastQC: Shot-blasted Steel Surface Dataset with Interpretable Detection of Surface Defects
SteelBlastQC: Shot-blasted Steel Surface Dataset with Interpretable Detection of Surface Defects
Irina Ruzavina
Lisa Sophie Theis
Jesse Lemeer
Rutger de Groen
Leo Ebeling
Andrej Hulak
Jouaria Ali
Guangzhi Tang
Rico Mockel
29
0
0
29 Apr 2025
zkVC: Fast Zero-Knowledge Proof for Private and Verifiable Computing
zkVC: Fast Zero-Knowledge Proof for Private and Verifiable Computing
Yancheng Zhang
Mengxin Zheng
Xun Chen
Jingtong Hu
W. Shi
Lei Ju
Yan Solihin
Qian Lou
44
0
0
16 Apr 2025
BTFL: A Bayesian-based Test-Time Generalization Method for Internal and External Data Distributions in Federated learning
Yu Zhou
Bingyan Liu
FedML
OOD
TTA
54
0
0
09 Mar 2025
MarsLGPR: Mars Rover Localization with Ground Penetrating Radar
Anja Sheppard
Katherine A. Skinner
37
1
0
06 Mar 2025
Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization
Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization
Shunxin Wang
Raymond N. J. Veldhuis
N. Strisciuglio
VLM
71
0
0
05 Mar 2025
Learning from Noisy Labels with Contrastive Co-Transformer
Yan Han
S. Roy
Mehrtash Harandi
L. Petersson
NoLa
59
0
0
04 Mar 2025
Escaping The Big Data Paradigm in Self-Supervised Representation Learning
Escaping The Big Data Paradigm in Self-Supervised Representation Learning
Carlos Vélez García
Miguel Cazorla
Jorge Pomares
49
0
0
25 Feb 2025
Unified CNNs and transformers underlying learning mechanism reveals multi-head attention modus vivendi
Unified CNNs and transformers underlying learning mechanism reveals multi-head attention modus vivendi
Ella Koresh
Ronit D. Gross
Yuval Meir
Yarden Tzach
Tal Halevi
Ido Kanter
ViT
43
0
0
22 Jan 2025
Contrastive Masked Autoencoders for Character-Level Open-Set Writer Identification
Contrastive Masked Autoencoders for Character-Level Open-Set Writer Identification
Xiaowei Jiang
Wenhao Ma
Yiqun Duan
T. Do
Chin-Teng Lin
29
0
0
21 Jan 2025
Aerial Flood Scene Classification Using Fine-Tuned Attention-based
  Architecture for Flood-Prone Countries in South Asia
Aerial Flood Scene Classification Using Fine-Tuned Attention-based Architecture for Flood-Prone Countries in South Asia
Ibne Hassan
Aman Mujahid
Abdullah Al Hasib
Andalib Rahman Shagoto
J. Mondal
Meem Arafat Manab
Jannatun Noor
ViT
25
0
0
31 Oct 2024
On Sampling Strategies for Spectral Model Sharding
On Sampling Strategies for Spectral Model Sharding
Denis Korzhenkov
Christos Louizos
FedML
32
0
0
31 Oct 2024
NYC-Event-VPR: A Large-Scale High-Resolution Event-Based Visual Place
  Recognition Dataset in Dense Urban Environments
NYC-Event-VPR: A Large-Scale High-Resolution Event-Based Visual Place Recognition Dataset in Dense Urban Environments
Taiyi Pan
Junyang He
Chao-Yeh Chen
Yiming Li
Chen Feng
17
1
0
28 Oct 2024
PointPatchRL -- Masked Reconstruction Improves Reinforcement Learning on
  Point Clouds
PointPatchRL -- Masked Reconstruction Improves Reinforcement Learning on Point Clouds
B. Gyenes
Nikolai Franke
P. Becker
Gerhard Neumann
3DPC
41
0
0
24 Oct 2024
Core Tokensets for Data-efficient Sequential Training of Transformers
Core Tokensets for Data-efficient Sequential Training of Transformers
Subarnaduti Paul
Manuel Brack
P. Schramowski
Kristian Kersting
Martin Mundt
23
0
0
08 Oct 2024
MASSFormer: Mobility-Aware Spectrum Sensing using Transformer-Driven
  Tiered Structure
MASSFormer: Mobility-Aware Spectrum Sensing using Transformer-Driven Tiered Structure
Dimpal Janu
Sandeep Mandia
Kuldeep Singh
Sandeep Kumar
16
0
0
26 Sep 2024
The Overfocusing Bias of Convolutional Neural Networks: A
  Saliency-Guided Regularization Approach
The Overfocusing Bias of Convolutional Neural Networks: A Saliency-Guided Regularization Approach
David Bertoin
Eduardo Hugo Sanchez
Mehdi Zouitine
Emmanuel Rachelson
23
0
0
25 Sep 2024
Beyond Skip Connection: Pooling and Unpooling Design for Elimination
  Singularities
Beyond Skip Connection: Pooling and Unpooling Design for Elimination Singularities
Chengkun Sun
Jinqian Pan
Juoli Jin
Russell Stevens Terry
Jiang Bian
Jie Xu
18
0
0
20 Sep 2024
Sparks of Artificial General Intelligence(AGI) in Semiconductor Material
  Science: Early Explorations into the Next Frontier of Generative AI-Assisted
  Electron Micrograph Analysis
Sparks of Artificial General Intelligence(AGI) in Semiconductor Material Science: Early Explorations into the Next Frontier of Generative AI-Assisted Electron Micrograph Analysis
Sakhinana Sagar Srinivas
Geethan Sannidhi
Sreeja Gangasani
Chidaksh Ravuru
Venkataramana Runkana
30
0
0
17 Sep 2024
Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models
Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models
Thanh-Dung Le
Vu Nguyen Ha
T. Nguyen
G. Eappen
P. Thiruvasagam
...
J. L. González-Rios
Luis M. Garces-Socarras
Symeon Chatzinotas
Juan Carlos Merlano-Duncan
Symeon Chatzinotas
29
4
0
05 Sep 2024
Parameter-Efficient Quantized Mixture-of-Experts Meets Vision-Language
  Instruction Tuning for Semiconductor Electron Micrograph Analysis
Parameter-Efficient Quantized Mixture-of-Experts Meets Vision-Language Instruction Tuning for Semiconductor Electron Micrograph Analysis
Sakhinana Sagar Srinivas
Chidaksh Ravuru
Geethan Sannidhi
Venkataramana Runkana
32
0
0
27 Aug 2024
Multi-Modal Instruction-Tuning Small-Scale Language-and-Vision Assistant
  for Semiconductor Electron Micrograph Analysis
Multi-Modal Instruction-Tuning Small-Scale Language-and-Vision Assistant for Semiconductor Electron Micrograph Analysis
Sakhinana Sagar Srinivas
Geethan Sannidhi
Venkataramana Runkana
38
1
0
27 Aug 2024
Hierarchical Network Fusion for Multi-Modal Electron Micrograph
  Representation Learning with Foundational Large Language Models
Hierarchical Network Fusion for Multi-Modal Electron Micrograph Representation Learning with Foundational Large Language Models
Sakhinana Sagar Srinivas
Geethan Sannidhi
Venkataramana Runkana
30
0
0
24 Aug 2024
Preliminary Investigations of a Multi-Faceted Robust and Synergistic
  Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision
  Transformers with Large Language and Multimodal Models
Preliminary Investigations of a Multi-Faceted Robust and Synergistic Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision Transformers with Large Language and Multimodal Models
Sakhinana Sagar Srinivas
Geethan Sannidhi
Sreeja Gangasani
Chidaksh Ravuru
Venkataramana Runkana
24
0
0
24 Aug 2024
Foundational Model for Electron Micrograph Analysis: Instruction-Tuning
  Small-Scale Language-and-Vision Assistant for Enterprise Adoption
Foundational Model for Electron Micrograph Analysis: Instruction-Tuning Small-Scale Language-and-Vision Assistant for Enterprise Adoption
Sakhinana Sagar Srinivas
Chidaksh Ravuru
Geethan Sannidhi
Venkataramana Runkana
33
0
0
23 Aug 2024
Vision HgNN: An Electron-Micrograph is Worth Hypergraph of Hypernodes
Vision HgNN: An Electron-Micrograph is Worth Hypergraph of Hypernodes
Sakhinana Sagar Srinivas
Rajat Kumar Sarkar
Sreeja Gangasani
Venkataramana Runkana
30
2
0
21 Aug 2024
EMCNet : Graph-Nets for Electron Micrographs Classification
EMCNet : Graph-Nets for Electron Micrographs Classification
Sakhinana Sagar Srinivas
Rajat Kumar Sarkar
Venkataramana Runkana
32
0
0
21 Aug 2024
Accurate and efficient structure elucidation from routine
  one-dimensional NMR spectra using multitask machine learning
Accurate and efficient structure elucidation from routine one-dimensional NMR spectra using multitask machine learning
Frank Hu
Michael S Chen
Grant M. Rotskoff
M. Kanan
T. Markland
20
3
0
15 Aug 2024
How Lightweight Can A Vision Transformer Be
How Lightweight Can A Vision Transformer Be
Jen Hong Tan
ViT
MoE
57
0
0
25 Jul 2024
This Probably Looks Exactly Like That: An Invertible Prototypical
  Network
This Probably Looks Exactly Like That: An Invertible Prototypical Network
Zachariah Carmichael
Timothy Redgrave
Daniel Gonzalez Cedre
Walter J. Scheirer
BDL
32
2
0
16 Jul 2024
Local-to-Global Cross-Modal Attention-Aware Fusion for HSI-X Semantic
  Segmentation
Local-to-Global Cross-Modal Attention-Aware Fusion for HSI-X Semantic Segmentation
Xuming Zhang
Naoto Yokoya
Xingfa Gu
Qingjiu Tian
Lorenzo Bruzzone
37
1
0
25 Jun 2024
SiT: Symmetry-Invariant Transformers for Generalisation in Reinforcement
  Learning
SiT: Symmetry-Invariant Transformers for Generalisation in Reinforcement Learning
Matthias Weissenbacher
Rishabh Agarwal
Yoshinobu Kawahara
OffRL
27
1
0
21 Jun 2024
Which Backbone to Use: A Resource-efficient Domain Specific Comparison for Computer Vision
Which Backbone to Use: A Resource-efficient Domain Specific Comparison for Computer Vision
Pranav Jeevan
Amit Sethi
VLM
23
4
0
09 Jun 2024
AdaFisher: Adaptive Second Order Optimization via Fisher Information
AdaFisher: Adaptive Second Order Optimization via Fisher Information
Damien Martins Gomes
Yanlei Zhang
Eugene Belilovsky
Guy Wolf
Mahdi S. Hosseini
ODL
74
2
0
26 May 2024
Client2Vec: Improving Federated Learning by Distribution Shifts Aware
  Client Indexing
Client2Vec: Improving Federated Learning by Distribution Shifts Aware Client Indexing
Yongxin Guo
Lin Wang
Xiaoying Tang
Tao R. Lin
FedML
OOD
27
0
0
25 May 2024
Neighborhood Attention Transformer with Progressive Channel Fusion for
  Speaker Verification
Neighborhood Attention Transformer with Progressive Channel Fusion for Speaker Verification
Nian Li
Jianguo Wei
ViT
30
0
0
20 May 2024
Enhancing Fine-Grained Image Classifications via Cascaded Vision
  Language Models
Enhancing Fine-Grained Image Classifications via Cascaded Vision Language Models
Canshi Wei
VLM
24
0
0
18 May 2024
Efficient Multimodal Large Language Models: A Survey
Efficient Multimodal Large Language Models: A Survey
Yizhang Jin
Jian Li
Yexin Liu
Tianjun Gu
Kai Wu
...
Xin Tan
Zhenye Gan
Yabiao Wang
Chengjie Wang
Lizhuang Ma
LRM
39
45
0
17 May 2024
Stable Diffusion-based Data Augmentation for Federated Learning with
  Non-IID Data
Stable Diffusion-based Data Augmentation for Federated Learning with Non-IID Data
Mahdi Morafah
M. Reisser
Bill Lin
Christos Louizos
FedML
27
5
0
13 May 2024
Few-Shot Class Incremental Learning via Robust Transformer Approach
Few-Shot Class Incremental Learning via Robust Transformer Approach
Naeem Paeedeh
Mahardhika Pratama
S. Wibirama
Wolfgang Mayer
Zehong Cao
Ryszard Kowalczyk
CLL
19
2
0
08 May 2024
A Mutual Information Perspective on Federated Contrastive Learning
A Mutual Information Perspective on Federated Contrastive Learning
Christos Louizos
M. Reisser
Denis Korzhenkov
SSL
FedML
16
2
0
03 May 2024
GvT: A Graph-based Vision Transformer with Talking-Heads Utilizing
  Sparsity, Trained from Scratch on Small Datasets
GvT: A Graph-based Vision Transformer with Talking-Heads Utilizing Sparsity, Trained from Scratch on Small Datasets
Dongjing Shan
guiqiang chen
ViT
37
0
0
07 Apr 2024
Improvement of Performance in Freezing of Gait detection in Parkinsons
  Disease using Transformer networks and a single waist worn triaxial
  accelerometer
Improvement of Performance in Freezing of Gait detection in Parkinsons Disease using Transformer networks and a single waist worn triaxial accelerometer
L. Sigcha
L. Borzì
I. Pavón
N. Costa
S. Costa
P. Arezes
J. López
G. de Arcas
15
28
0
04 Apr 2024
A noisy elephant in the room: Is your out-of-distribution detector
  robust to label noise?
A noisy elephant in the room: Is your out-of-distribution detector robust to label noise?
Galadrielle Humblot-Renaux
Sergio Escalera
T. Moeslund
OODD
UQCV
NoLa
27
5
0
02 Apr 2024
NYC-Indoor-VPR: A Long-Term Indoor Visual Place Recognition Dataset with
  Semi-Automatic Annotation
NYC-Indoor-VPR: A Long-Term Indoor Visual Place Recognition Dataset with Semi-Automatic Annotation
Diwei Sheng
Anbang Yang
John-Ross Rizzo
Chen Feng
27
2
0
31 Mar 2024
JIST: Joint Image and Sequence Training for Sequential Visual Place
  Recognition
JIST: Joint Image and Sequence Training for Sequential Visual Place Recognition
Gabriele Berton
Gabriele Trivigno
Barbara Caputo
Carlo Masone
VLM
29
3
0
28 Mar 2024
Benchmarking Image Transformers for Prostate Cancer Detection from
  Ultrasound Data
Benchmarking Image Transformers for Prostate Cancer Detection from Ultrasound Data
Mohamed Harmanani
P. Wilson
Fahimeh Fooladgar
A. Jamzad
Mahdi Gilany
Minh Nguyen Nhat To
Brian Wodlinger
Purang Abolmaesumi
P. Mousavi
ViT
MedIm
22
1
0
27 Mar 2024
Enhancing MRI-Based Classification of Alzheimer's Disease with
  Explainable 3D Hybrid Compact Convolutional Transformers
Enhancing MRI-Based Classification of Alzheimer's Disease with Explainable 3D Hybrid Compact Convolutional Transformers
Arindam Majee
Avisek Gupta
S. Raha
Swagatam Das
MedIm
18
2
0
24 Mar 2024
Group-Mix SAM: Lightweight Solution for Industrial Assembly Line
  Applications
Group-Mix SAM: Lightweight Solution for Industrial Assembly Line Applications
Wu Liang
X.-G. Ma
29
0
0
15 Mar 2024
Tune without Validation: Searching for Learning Rate and Weight Decay on
  Training Sets
Tune without Validation: Searching for Learning Rate and Weight Decay on Training Sets
Lorenzo Brigato
S. Mougiakakou
24
0
0
08 Mar 2024
12345
Next