Escaping the Big Data Paradigm with Compact Transformers

12 April 2021

Papers citing "Escaping the Big Data Paradigm with Compact Transformers"

50 / 215 papers shown

Title
Beyond Attention: Toward Machines with Intrinsic Higher Mental States Ahsan Adeel OffRL LRM 19 0 0 02 May 2025
SteelBlastQC: Shot-blasted Steel Surface Dataset with Interpretable Detection of Surface Defects Irina Ruzavina Lisa Sophie Theis Jesse Lemeer Rutger de Groen Leo Ebeling Andrej Hulak Jouaria Ali Guangzhi Tang Rico Mockel 29 0 0 29 Apr 2025
zkVC: Fast Zero-Knowledge Proof for Private and Verifiable Computing Yancheng Zhang Mengxin Zheng Xun Chen Jingtong Hu W. Shi Lei Ju Yan Solihin Qian Lou 44 0 0 16 Apr 2025
BTFL: A Bayesian-based Test-Time Generalization Method for Internal and External Data Distributions in Federated learning Yu Zhou Bingyan Liu FedML OOD TTA 54 0 0 09 Mar 2025
MarsLGPR: Mars Rover Localization with Ground Penetrating Radar Anja Sheppard Katherine A. Skinner 37 1 0 06 Mar 2025
Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization Shunxin Wang Raymond N. J. Veldhuis N. Strisciuglio VLM 71 0 0 05 Mar 2025
Learning from Noisy Labels with Contrastive Co-Transformer Yan Han S. Roy Mehrtash Harandi L. Petersson NoLa 59 0 0 04 Mar 2025
Escaping The Big Data Paradigm in Self-Supervised Representation Learning Carlos Vélez García Miguel Cazorla Jorge Pomares 49 0 0 25 Feb 2025
Unified CNNs and transformers underlying learning mechanism reveals multi-head attention modus vivendi Ella Koresh Ronit D. Gross Yuval Meir Yarden Tzach Tal Halevi Ido Kanter ViT 43 0 0 22 Jan 2025
Contrastive Masked Autoencoders for Character-Level Open-Set Writer Identification Xiaowei Jiang Wenhao Ma Yiqun Duan T. Do Chin-Teng Lin 29 0 0 21 Jan 2025
Aerial Flood Scene Classification Using Fine-Tuned Attention-based Architecture for Flood-Prone Countries in South Asia Ibne Hassan Aman Mujahid Abdullah Al Hasib Andalib Rahman Shagoto J. Mondal Meem Arafat Manab Jannatun Noor ViT 25 0 0 31 Oct 2024
On Sampling Strategies for Spectral Model Sharding Denis Korzhenkov Christos Louizos FedML 32 0 0 31 Oct 2024
NYC-Event-VPR: A Large-Scale High-Resolution Event-Based Visual Place Recognition Dataset in Dense Urban Environments Taiyi Pan Junyang He Chao-Yeh Chen Yiming Li Chen Feng 17 1 0 28 Oct 2024
PointPatchRL -- Masked Reconstruction Improves Reinforcement Learning on Point Clouds B. Gyenes Nikolai Franke P. Becker Gerhard Neumann 3DPC 41 0 0 24 Oct 2024
Core Tokensets for Data-efficient Sequential Training of Transformers Subarnaduti Paul Manuel Brack P. Schramowski Kristian Kersting Martin Mundt 23 0 0 08 Oct 2024
MASSFormer: Mobility-Aware Spectrum Sensing using Transformer-Driven Tiered Structure Dimpal Janu Sandeep Mandia Kuldeep Singh Sandeep Kumar 16 0 0 26 Sep 2024
The Overfocusing Bias of Convolutional Neural Networks: A Saliency-Guided Regularization Approach David Bertoin Eduardo Hugo Sanchez Mehdi Zouitine Emmanuel Rachelson 23 0 0 25 Sep 2024
Beyond Skip Connection: Pooling and Unpooling Design for Elimination Singularities Chengkun Sun Jinqian Pan Juoli Jin Russell Stevens Terry Jiang Bian Jie Xu 18 0 0 20 Sep 2024
Sparks of Artificial General Intelligence(AGI) in Semiconductor Material Science: Early Explorations into the Next Frontier of Generative AI-Assisted Electron Micrograph Analysis Sakhinana Sagar Srinivas Geethan Sannidhi Sreeja Gangasani Chidaksh Ravuru Venkataramana Runkana 30 0 0 17 Sep 2024
Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models Thanh-Dung Le Vu Nguyen Ha T. Nguyen G. Eappen P. Thiruvasagam ... J. L. González-Rios Luis M. Garces-Socarras Symeon Chatzinotas Juan Carlos Merlano-Duncan Symeon Chatzinotas 29 4 0 05 Sep 2024
Parameter-Efficient Quantized Mixture-of-Experts Meets Vision-Language Instruction Tuning for Semiconductor Electron Micrograph Analysis Sakhinana Sagar Srinivas Chidaksh Ravuru Geethan Sannidhi Venkataramana Runkana 32 0 0 27 Aug 2024
Multi-Modal Instruction-Tuning Small-Scale Language-and-Vision Assistant for Semiconductor Electron Micrograph Analysis Sakhinana Sagar Srinivas Geethan Sannidhi Venkataramana Runkana 38 1 0 27 Aug 2024
Hierarchical Network Fusion for Multi-Modal Electron Micrograph Representation Learning with Foundational Large Language Models Sakhinana Sagar Srinivas Geethan Sannidhi Venkataramana Runkana 30 0 0 24 Aug 2024
Preliminary Investigations of a Multi-Faceted Robust and Synergistic Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision Transformers with Large Language and Multimodal Models Sakhinana Sagar Srinivas Geethan Sannidhi Sreeja Gangasani Chidaksh Ravuru Venkataramana Runkana 24 0 0 24 Aug 2024
Foundational Model for Electron Micrograph Analysis: Instruction-Tuning Small-Scale Language-and-Vision Assistant for Enterprise Adoption Sakhinana Sagar Srinivas Chidaksh Ravuru Geethan Sannidhi Venkataramana Runkana 33 0 0 23 Aug 2024
Vision HgNN: An Electron-Micrograph is Worth Hypergraph of Hypernodes Sakhinana Sagar Srinivas Rajat Kumar Sarkar Sreeja Gangasani Venkataramana Runkana 30 2 0 21 Aug 2024
EMCNet : Graph-Nets for Electron Micrographs Classification Sakhinana Sagar Srinivas Rajat Kumar Sarkar Venkataramana Runkana 32 0 0 21 Aug 2024
Accurate and efficient structure elucidation from routine one-dimensional NMR spectra using multitask machine learning Frank Hu Michael S Chen Grant M. Rotskoff M. Kanan T. Markland 20 3 0 15 Aug 2024
How Lightweight Can A Vision Transformer Be Jen Hong Tan ViT MoE 57 0 0 25 Jul 2024
This Probably Looks Exactly Like That: An Invertible Prototypical Network Zachariah Carmichael Timothy Redgrave Daniel Gonzalez Cedre Walter J. Scheirer BDL 32 2 0 16 Jul 2024
Local-to-Global Cross-Modal Attention-Aware Fusion for HSI-X Semantic Segmentation Xuming Zhang Naoto Yokoya Xingfa Gu Qingjiu Tian Lorenzo Bruzzone 37 1 0 25 Jun 2024
SiT: Symmetry-Invariant Transformers for Generalisation in Reinforcement Learning Matthias Weissenbacher Rishabh Agarwal Yoshinobu Kawahara OffRL 27 1 0 21 Jun 2024
Which Backbone to Use: A Resource-efficient Domain Specific Comparison for Computer Vision Pranav Jeevan Amit Sethi VLM 23 4 0 09 Jun 2024
AdaFisher: Adaptive Second Order Optimization via Fisher Information Damien Martins Gomes Yanlei Zhang Eugene Belilovsky Guy Wolf Mahdi S. Hosseini ODL 74 2 0 26 May 2024
Client2Vec: Improving Federated Learning by Distribution Shifts Aware Client Indexing Yongxin Guo Lin Wang Xiaoying Tang Tao R. Lin FedML OOD 27 0 0 25 May 2024
Neighborhood Attention Transformer with Progressive Channel Fusion for Speaker Verification Nian Li Jianguo Wei ViT 30 0 0 20 May 2024
Enhancing Fine-Grained Image Classifications via Cascaded Vision Language Models Canshi Wei VLM 24 0 0 18 May 2024
Efficient Multimodal Large Language Models: A Survey Yizhang Jin Jian Li Yexin Liu Tianjun Gu Kai Wu ... Xin Tan Zhenye Gan Yabiao Wang Chengjie Wang Lizhuang Ma LRM 39 45 0 17 May 2024
Stable Diffusion-based Data Augmentation for Federated Learning with Non-IID Data Mahdi Morafah M. Reisser Bill Lin Christos Louizos FedML 27 5 0 13 May 2024
Few-Shot Class Incremental Learning via Robust Transformer Approach Naeem Paeedeh Mahardhika Pratama S. Wibirama Wolfgang Mayer Zehong Cao Ryszard Kowalczyk CLL 19 2 0 08 May 2024
A Mutual Information Perspective on Federated Contrastive Learning Christos Louizos M. Reisser Denis Korzhenkov SSL FedML 16 2 0 03 May 2024
GvT: A Graph-based Vision Transformer with Talking-Heads Utilizing Sparsity, Trained from Scratch on Small Datasets Dongjing Shan guiqiang chen ViT 37 0 0 07 Apr 2024
Improvement of Performance in Freezing of Gait detection in Parkinsons Disease using Transformer networks and a single waist worn triaxial accelerometer L. Sigcha L. Borzì I. Pavón N. Costa S. Costa P. Arezes J. López G. de Arcas 15 28 0 04 Apr 2024
A noisy elephant in the room: Is your out-of-distribution detector robust to label noise? Galadrielle Humblot-Renaux Sergio Escalera T. Moeslund OODD UQCV NoLa 27 5 0 02 Apr 2024
NYC-Indoor-VPR: A Long-Term Indoor Visual Place Recognition Dataset with Semi-Automatic Annotation Diwei Sheng Anbang Yang John-Ross Rizzo Chen Feng 27 2 0 31 Mar 2024
JIST: Joint Image and Sequence Training for Sequential Visual Place Recognition Gabriele Berton Gabriele Trivigno Barbara Caputo Carlo Masone VLM 29 3 0 28 Mar 2024
Benchmarking Image Transformers for Prostate Cancer Detection from Ultrasound Data Mohamed Harmanani P. Wilson Fahimeh Fooladgar A. Jamzad Mahdi Gilany Minh Nguyen Nhat To Brian Wodlinger Purang Abolmaesumi P. Mousavi ViT MedIm 22 1 0 27 Mar 2024
Enhancing MRI-Based Classification of Alzheimer's Disease with Explainable 3D Hybrid Compact Convolutional Transformers Arindam Majee Avisek Gupta S. Raha Swagatam Das MedIm 18 2 0 24 Mar 2024
Group-Mix SAM: Lightweight Solution for Industrial Assembly Line Applications Wu Liang X.-G. Ma 29 0 0 15 Mar 2024
Tune without Validation: Searching for Learning Rate and Weight Decay on Training Sets Lorenzo Brigato S. Mougiakakou 24 0 0 08 Mar 2024