AutoFormer: Searching Transformers for Visual Recognition

1 July 2021

Papers citing "AutoFormer: Searching Transformers for Visual Recognition"

50 / 155 papers shown

Title
L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision Transformers S. Casarin Sergio Escalera O. Lanz 27 0 0 12 May 2025
NeuRN: Neuro-inspired Domain Generalization for Image Classification Hamd Jalil Ahmed Qazi Asim Iqbal OOD MedIm 19 0 0 11 May 2025
Transferrable Surrogates in Expressive Neural Architecture Search Spaces Shiwen Qin Gabriela Kadlecová Martin Pilát Shay B. Cohen Roman Neruda Elliot J. Crowley Jovita Lukasik Linus Ericsson AI4CE 50 0 0 17 Apr 2025
Kernel-Level Energy-Efficient Neural Architecture Search for Tabular Dataset Hoang-Loc La Phuong Hoai Ha 27 0 0 11 Apr 2025
MDP: Multidimensional Vision Model Pruning with Latency Constraint Xinglong Sun Barath Lakshmanan Maying Shen Shiyi Lan Jingde Chen Jose M. Alvarez VLM 44 0 0 02 Apr 2025
Integrating Quantum-Classical Attention in Patch Transformers for Enhanced Time Series Forecasting Sanjay Chakraborty Fredrik Heintz AI4TS AIFin 35 0 0 31 Mar 2025
Enhancing Time Series Forecasting with Fuzzy Attention-Integrated Transformers Sanjay Chakraborty Fredrik Heintz AI4TS 31 0 0 31 Mar 2025
Subnet-Aware Dynamic Supernet Training for Neural Architecture Search Jeimin Jeon Youngmin Oh J. Lee Donghyeon Baek Dohyung Kim Chanho Eom Bumsub Ham 46 0 0 13 Mar 2025
TimeFound: A Foundation Model for Time Series Forecasting Congxi Xiao Jingbo Zhou Yixiong Xiao Xinjiang Lu Le Zhang Hui Xiong AI4TS 46 0 0 06 Mar 2025
Vision Transformer Neural Architecture Search for Out-of-Distribution Generalization: Benchmark and Insights Sy-Tuyen Ho Tuan Van Vo Somayeh Ebrahimkhani Ngai-man Cheung 35 0 0 08 Jan 2025
TimeRAG: BOOSTING LLM Time Series Forecasting via Retrieval-Augmented Generation Silin Yang Dong Wang Haoqi Zheng Ruochun Jin RALM AI4TS 72 2 0 21 Dec 2024
Slicing Vision Transformer for Flexible Inference Yitian Zhang Huseyin Coskun Xu Ma Huan Wang Ke Ma Xi Chen Derek Hao Hu Y. Fu ViT 74 0 0 06 Dec 2024
Efficient Deep Learning Board: Training Feedback Is Not All You Need Lina Gong Qi Gao Peng Li Mingqiang Wei Fei Wu OOD 21 0 0 17 Oct 2024
LLM-Mixer: Multiscale Mixing in LLMs for Time Series Forecasting Md. Kowsher Md. Shohanur Islam Sobuj Nusrat Jahan Prottasha E. Alejandro Alanis O. Garibay Niloofar Yousefi AI4TS 27 0 0 15 Oct 2024
General Compression Framework for Efficient Transformer Object Tracking Lingyi Hong Jinglun Li Xinyu Zhou Shilin Yan Pinxue Guo ... Zhaoyu Chen Shuyong Gao Wei Zhang Hong Lu Wenqiang Zhang ViT 32 0 0 26 Sep 2024
Towards Universal Large-Scale Foundational Model for Natural Gas Demand Forecasting Xinxing Zhou Jiaqi Ye Shubao Zhao Ming Jin Zhaoxiang Hou Chengyi Yang Zengxiang Li Yanlong Wen Xiaojie Yuan AI4TS 26 0 0 24 Sep 2024
Efficient Training of Large Vision Models via Advanced Automated Progressive Learning Changlin Li Jiawei Zhang Sihao Lin Zongxin Yang Junwei Liang Xiaodan Liang Xiaojun Chang VLM 21 0 0 06 Sep 2024
SCAN-Edge: Finding MobileNet-speed Hybrid Networks for Diverse Edge Devices via Hardware-Aware Evolutionary Search Hung-Yueh Chiang Diana Marculescu 23 0 0 27 Aug 2024
Toward Time-Continuous Data Inference in Sparse Urban CrowdSensing Ziyu Sun Haoyang Su Hanqi Sun E. Wang Wenbin Liu 16 0 0 27 Aug 2024
Neural Architecture Search based Global-local Vision Mamba for Palm-Vein Recognition Huafeng Qin Yuming Fu Jing Chen M. El-Yacoubi Xinbo Gao Feng Xi Mamba 37 1 0 11 Aug 2024
Quasar-ViT: Hardware-Oriented Quantization-Aware Architecture Search for Vision Transformers Zhengang Li Alec Lu Yanyue Xie Zhenglun Kong Mengshu Sun ... Peiyan Dong Caiwen Ding Yanzhi Wang Xue Lin Zhenman Fang 20 5 0 25 Jul 2024
HyTAS: A Hyperspectral Image Transformer Architecture Search Benchmark and Analysis Fangqin Zhou Mert Kilickaya Joaquin Vanschoren Ran Piao 21 1 0 23 Jul 2024
DeepClair: Utilizing Market Forecasts for Effective Portfolio Selection Donghee Choi Jinkyu Kim Mogan Gim Jinho Lee Jaewoo Kang 23 0 0 18 Jul 2024
Dynamic Encoder Size Based on Data-Driven Layer-wise Pruning for Speech Recognition Jingjing Xu Wei Zhou Zijian Yang Eugen Beck Ralf Schlueter 23 1 0 10 Jul 2024
PRANCE: Joint Token-Optimization and Structural Channel-Pruning for Adaptive ViT Inference Ye Li Chen Tang Yuan Meng Jiajun Fan Zenghao Chai Xinzhu Ma Zhi Wang Wenwu Zhu 29 1 0 06 Jul 2024
Optimizing Time Series Forecasting Architectures: A Hierarchical Neural Architecture Search Approach Difan Deng Marius Lindauer AI4TS 40 0 0 07 Jun 2024
Offline Multi-Objective Optimization Ke Xue Rong-Xi Tan Xiaobin Huang Chao Qian OffRL 36 5 0 06 Jun 2024
SNED: Superposition Network Architecture Search for Efficient Video Diffusion Model Zhengang Li Yan Kang Yuchen Liu Difan Liu Tobias Hinz Feng Liu Yanzhi Wang DiffM 19 1 0 31 May 2024
einspace: Searching for Neural Architectures from Fundamental Operations Linus Ericsson Miguel Espinosa Chenhongyi Yang Antreas Antoniou Amos Storkey Shay B. Cohen Steven G. McDonagh Elliot J. Crowley 36 1 0 31 May 2024
One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments Ke Yi Yuhui Xu Heng Chang Chen Tang Yuan Meng Tong Zhang Jia Li MQ 30 2 0 30 May 2024
Efficient Multimodal Large Language Models: A Survey Yizhang Jin Jian Li Yexin Liu Tianjun Gu Kai Wu ... Xin Tan Zhenye Gan Yabiao Wang Chengjie Wang Lizhuang Ma LRM 39 45 0 17 May 2024
HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models R. Sukthanker Arber Zela B. Staffler Aaron Klein Lennart Purucker Jorg K. H. Franke Frank Hutter ELM 36 3 0 16 May 2024
Differentiable Model Scaling using Differentiable Topk Kai Liu Ruohui Wang Jianfei Gao Kai Chen MedIm VLM 28 1 0 12 May 2024
From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks Xue Geng Zhe Wang Chunyun Chen Qing Xu Kaixin Xu ... Zhenghua Chen M. Aly Jie Lin Min-man Wu Xiaoli Li 31 1 0 09 May 2024
Concrete Dense Network for Long-Sequence Time Series Clustering Redemptor Jr Laceda Taloma Patrizio Pisani Danilo Comminiello AI4TS 29 0 0 08 May 2024
Data-independent Module-aware Pruning for Hierarchical Vision Transformers Yang He Joey Tianyi Zhou ViT 40 3 0 21 Apr 2024
SmartMem: Layout Transformation Elimination and Adaptation for Efficient DNN Execution on Mobile Wei Niu Md. Musfiqur Rahman Sanim Zhihao Shu Jiexiong Guan Xipeng Shen Miao Yin Gagan Agrawal Bin Ren 27 6 0 21 Apr 2024
Efficiently Distilling LLMs for Edge Applications Achintya Kundu Fabian Lim Aaron Chew L. Wynter Penny Chong Rhui Dih Lee 27 6 0 01 Apr 2024
Mixed-precision Supernet Training from Vision Foundation Models using Low Rank Adapter Yuiko Sakuma Masakazu Yoshimura Junji Otsuka Atsushi Irie Takeshi Ohashi MQ 27 0 0 29 Mar 2024
AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search Junghyup Lee Bumsub Ham 24 6 0 28 Mar 2024
Dense Vision Transformer Compression with Few Samples Hanxiao Zhang Yifan Zhou Guo-Hua Wang Jianxin Wu ViT VLM 19 1 0 27 Mar 2024
Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis Badri N. Patro Suhas Ranganath Vinay P. Namboodiri Vijay Srinivas Agneeswaran 43 2 0 26 Mar 2024
Once for Both: Single Stage of Importance and Sparsity Search for Vision Transformer Compression Hancheng Ye Chong Yu Peng Ye Renqiu Xia Yansong Tang Jiwen Lu Tao Chen Bo-Wen Zhang 46 3 0 23 Mar 2024
SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series Badri N. Patro Vijay Srinivas Agneeswaran Mamba 51 50 0 22 Mar 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 139 305 0 21 Mar 2024
When Training-Free NAS Meets Vision Transformer: A Neural Tangent Kernel Perspective Qiqi Zhou Yichen Zhu ViT 16 1 0 15 Mar 2024
Considering Nonstationary within Multivariate Time Series with Variational Hierarchical Transformer for Forecasting Muyao Wang Wenchao Chen Bo Chen 16 2 0 08 Mar 2024
DNA Family: Boosting Weight-Sharing NAS with Block-Wise Supervisions Guangrun Wang Changlin Li Liuchun Yuan Jiefeng Peng Xiaoyu Xian Xiaodan Liang Xiaojun Chang Liang Lin 36 1 0 02 Mar 2024
Enhancing Multivariate Time Series Forecasting with Mutual Information-driven Cross-Variable and Temporal Modeling Shiyi Qi Liangjiang Wen Yiduo Li Yuanhang Yang Zhe Li Zhongwen Rao Lujia Pan Zenglin Xu AI4TS 24 1 0 01 Mar 2024
Multi-objective Differentiable Neural Architecture Search R. Sukthanker Arber Zela B. Staffler Samuel Dooley Josif Grabocka Frank Hutter 37 1 0 28 Feb 2024