v1v2 (latest)

AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling

18 November 2020

ArXiv (abs)PDF HTML Github (104★)

Papers citing "AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling"

50 / 61 papers shown

Title
Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyond Weiyu Chen Xiaoyuan Zhang Baijiong Lin Xi Lin Han Zhao Qingfu Zhang James T. Kwok 172 5 0 19 Jan 2025
Vision Transformer Neural Architecture Search for Out-of-Distribution Generalization: Benchmark and Insights Sy-Tuyen Ho Tuan Van Vo Somayeh Ebrahimkhani Ngai-Man Cheung 90 0 0 08 Jan 2025
AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment Y. Fu Zhongzhi Yu Junwei Li Jiayi Qian Yongan Zhang Xiangchi Yuan Dachuan Shi Roman Yakunin Y. Lin 92 4 0 15 Nov 2024
PSE-Net: Channel Pruning for Convolutional Neural Networks with Parallel-subnets Estimator Shiguang Wang Tao Xie Haijun Liu Xingcheng Zhang Jian Cheng 70 2 0 29 Aug 2024
SalNAS: Efficient Saliency-prediction Neural Architecture Search with self-knowledge distillation C. Termritthikun Ayaz Umer Suwichaya Suwanwimolkul Xiwei Xu Ivan Lee 71 5 0 29 Jul 2024
Quasar-ViT: Hardware-Oriented Quantization-Aware Architecture Search for Vision Transformers Zhengang Li Alec Lu Yanyue Xie Zhenglun Kong Mengshu Sun ... Zhaoyang Han Caiwen Ding Yanzhi Wang Xue Lin Zhenman Fang 78 5 0 25 Jul 2024
PRANCE: Joint Token-Optimization and Structural Channel-Pruning for Adaptive ViT Inference Ye Li Chen Tang Yuan Meng Jiajun Fan Zenghao Chai Xinzhu Ma Zhi Wang Wenwu Zhu 87 2 0 06 Jul 2024
SNED: Superposition Network Architecture Search for Efficient Video Diffusion Model Zhengang Li Yan Kang Yuchen Liu Difan Liu Tobias Hinz Feng Liu Yanzhi Wang DiffM 63 1 0 31 May 2024
HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models R. Sukthanker Arber Zela B. Staffler Aaron Klein Lennart Purucker Jorg K. H. Franke Frank Hutter ELM 103 4 0 16 May 2024
Structural Pruning of Pre-trained Language Models via Neural Architecture Search Aaron Klein Jacek Golebiowski Xingchen Ma Valerio Perrone Cédric Archambeau 85 2 0 03 May 2024
Efficiently Distilling LLMs for Edge Applications Achintya Kundu Fabian Lim Aaron Chew L. Wynter Penny Chong Rhui Dih Lee 126 6 0 01 Apr 2024
Boosting Order-Preserving and Transferability for Neural Architecture Search: a Joint Architecture Refined Search and Fine-tuning Approach Beichen Zhang Xiaoxing Wang Xiaohan Qin Junchi Yan 71 4 0 18 Mar 2024
DNA Family: Boosting Weight-Sharing NAS with Block-Wise Supervisions Guangrun Wang Changlin Li Liuchun Yuan Jiefeng Peng Xiaoyu Xian Xiaodan Liang Xiaojun Chang Liang Lin 127 1 0 02 Mar 2024
Multi-objective Differentiable Neural Architecture Search R. Sukthanker Arber Zela B. Staffler Samuel Dooley Josif Grabocka Frank Hutter 161 1 0 28 Feb 2024
MatchNAS: Optimizing Edge AI in Sparse-Label Data Contexts via Automating Deep Neural Network Porting for Mobile Deployment Hongtao Huang Xiaojun Chang Wen Hu Lina Yao 78 0 0 21 Feb 2024
Retraining-free Model Quantization via One-Shot Weight-Coupling Learning Chen Tang Yuan Meng Jiacheng Jiang Shuzhao Xie Rongwei Lu Xinzhu Ma Zhi Wang Wenwu Zhu MQ 73 11 0 03 Jan 2024
Weight subcloning: direct initialization of transformers using larger pretrained ones Mohammad Samragh Mehrdad Farajtabar Sachin Mehta Raviteja Vemulapalli Fartash Faghri Devang Naik Oncel Tuzel Mohammad Rastegari 112 30 0 14 Dec 2023
Efficient Stitchable Task Adaptation Haoyu He Zizheng Pan Jing Liu Jianfei Cai Bohan Zhuang 126 3 0 29 Nov 2023
UGC: Unified GAN Compression for Efficient Image-to-Image Translation Yuxi Ren Jie Wu Peng Zhang Manlin Zhang Xuefeng Xiao Qian He Rui Wang Min Zheng Xin Pan 115 2 0 17 Sep 2023
InstaTune: Instantaneous Neural Architecture Search During Fine-Tuning S. N. Sridhar Souvik Kundu Sairam Sundaresan Maciej Szankin Anthony Sarah 46 3 0 29 Aug 2023
EQ-Net: Elastic Quantization Neural Networks Ke Xu Lei Han Ye Tian Shangshang Yang Xingyi Zhang MQ 124 10 0 15 Aug 2023
Shrink-Perturb Improves Architecture Mixing during Population Based Training for Neural Architecture Search A. Chebykin A. Dushatskiy Tanja Alderliesten Peter A. N. Bosman 91 1 0 28 Jul 2023
ShiftNAS: Improving One-shot NAS via Probability Shift Mingyang Zhang Xinyi Yu Haodong Zhao Linlin Ou 101 6 0 17 Jul 2023
LISSNAS: Locality-based Iterative Search Space Shrinkage for Neural Architecture Search Bhavna Gopal Arjun Sridhar Tunhou Zhang Yiran Chen 65 4 0 06 Jul 2023
Stitched ViTs are Flexible Vision Backbones Zizheng Pan Jing Liu Haoyu He Jianfei Cai Bohan Zhuang 53 3 0 30 Jun 2023
Rethink DARTS Search Space and Renovate a New Benchmark Jiuling Zhang Zhiming Ding 59 1 0 12 Jun 2023
Transfer-Once-For-All: AI Model Optimization for Edge Achintya Kundu L. Wynter Rhui Dih Lee L. A. Bathen 47 7 0 27 Mar 2023
DetOFA: Efficient Training of Once-for-All Networks for Object Detection Using Path Filter Yuiko Sakuma Masato Ishii T. Narihira 69 3 0 23 Mar 2023
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices Chen Tang Li Zhang Huiqiang Jiang Jiahang Xu Ting Cao Quanlu Zhang Yuqing Yang Zhi Wang Mao Yang 47 12 0 17 Mar 2023
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference Li Zhang Xudong Wang Jiahang Xu Quanlu Zhang Yujing Wang Yuqing Yang Ningxin Zheng Ting Cao Mao Yang MQ 55 3 0 15 Mar 2023
GP-NAS-ensemble: a model for NAS Performance Prediction Kunlong Chen Liu Yang Yitian Chen Kunjin Chen Yidan Xu Lujun Li 98 13 0 23 Jan 2023
Efficient Evaluation Methods for Neural Architecture Search: A Survey Xiangning Xie Xiaotian Song Zeqiong Lv Gary G. Yen Weiping Ding Yizhou Sun 116 12 0 14 Jan 2023
Slimmable Pruned Neural Networks Hideaki Kuratsu Atsuyoshi Nakamura 99 2 0 07 Dec 2022
HADAS: Hardware-Aware Dynamic Neural Architecture Search for Edge Performance Scaling Halima Bouzidi Mohanad Odema Hamza Ouarnoughi Mohammad Abdullah Al Faruque Smail Niar 77 19 0 06 Dec 2022
RoHNAS: A Neural Architecture Search Framework with Conjoint Optimization for Adversarial Robustness and Hardware Efficiency of Convolutional and Capsule Networks Alberto Marchisio Vojtěch Mrázek Andrea Massa Beatrice Bussolino Maurizio Martina Mohamed Bennai AAML 140 6 0 11 Oct 2022
Towards Regression-Free Neural Networks for Diverse Compute Platforms Rahul Duggal Hao Zhou Shuo Yang Jun Fang Yuanjun Xiong Wei Xia UQCV 79 1 0 27 Sep 2022
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance Li Zhang Youkow Homma Yujing Wang Min-man Wu Mao Yang Ruofei Zhang Ting Cao Wei Shen OffRL 78 5 0 30 Aug 2022
FocusFormer: Focusing on What We Need via Architecture Sampler Jing Liu Jianfei Cai Bohan Zhuang 65 8 0 23 Aug 2022
ObfuNAS: A Neural Architecture Search-based DNN Obfuscation Approach Tong Zhou Shaolei Ren Xiaolin Xu AAML 105 14 0 17 Aug 2022
TCR: A Transformer Based Deep Network for Predicting Cancer Drugs Response Jie Gao Jing Hu Wan-Na Sun Yili Shen Xiaonan Zhang Xiaomin Fang Fan Wang Guo-Guo Zhao MedIm 50 2 0 10 Jul 2022
FlowNAS: Neural Architecture Search for Optical Flow Estimation Zhiwei Lin Tingting Liang Taihong Xiao Yongtao Wang Zhi Tang Ming-Hsuan Yang 77 0 0 04 Jul 2022
Revisiting Architecture-aware Knowledge Distillation: Smaller Models and Faster Search Taehyeon Kim Heesoo Myeong Se-Young Yun 85 2 0 27 Jun 2022
Neural Prompt Search Yuanhan Zhang Kaiyang Zhou Ziwei Liu VPVLM VLM 106 152 0 09 Jun 2022
Does Interference Exist When Training a Once-For-All Network? Jordan Shipard Arnold Wiliem Clinton Fookes 34 0 0 20 Apr 2022
SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems Xin Dong B. D. Salvo Meng Li Chiao Liu Zhongnan Qu H. T. Kung Ziyun Li 3DGS 69 20 0 10 Apr 2022
A Survey of Supernet Optimization and its Applications: Spatial and Temporal Optimization for Neural Architecture Search Stephen Cha Taehyeon Kim Hayeon Lee Se-Young Yun AI4CE 80 2 0 08 Apr 2022
A Semi-Decoupled Approach to Fast and Optimal Hardware-Software Co-Design of Neural Accelerators Bingqian Lu Zheyu Yan Yiyu Shi Shaolei Ren 63 2 0 25 Mar 2022
MKQ-BERT: Quantized BERT with 4-bits Weights and Activations Hanlin Tang Xipeng Zhang Kai Liu Jianchen Zhu Zhanhui Kang VLM MQ 51 15 0 25 Mar 2022
Evolutionary Neural Cascade Search across Supernetworks A. Chebykin Tanja Alderliesten Peter A. N. Bosman 48 1 0 08 Mar 2022
Generalized Global Ranking-Aware Neural Architecture Ranker for Efficient Image Classifier Search Bicheng Guo Tao Chen Shibo He Haoyu Liu Lili Xu Peng Ye Jiming Chen 100 17 0 30 Jan 2022