v1v2 (latest)

Zero-Cost Proxies for Lightweight NAS

International Conference on Learning Representations (ICLR), 2021

20 January 2021

Mohamed S. Abdelfattah

Abhinav Mehrotra

Łukasz Dudziak

Nicholas D. Lane

ArXiv (abs)PDF HTML Github (152★)

Papers citing "Zero-Cost Proxies for Lightweight NAS"

50 / 165 papers shown

Title
CompressNAS : A Fast and Efficient Technique for Model Compression using Decomposition Sudhakar Sah Nikhil Chabbra Matthieu Durnerin 56 0 0 12 Nov 2025
Models Got Talent: Identifying High Performing Wearable Human Activity Recognition Models Without Training Richard Goldman Varun Komperla Thomas Ploetz H. Haresamudram 86 0 0 08 Nov 2025
Learning to Flow from Generative Pretext Tasks for Neural Architecture Encoding Sunwoo Kim Hyunjin Hwang Kijung Shin AI4CE 158 0 0 21 Oct 2025
FLRC: Fine-grained Low-Rank Compressor for Efficient LLM Inference Yu-Chen Lu Chong-Yan Chen Chi-Chih Chang Yu-Fang Hu Kai-Chiang Wu 44 0 0 10 Oct 2025
Universal Neural Architecture Space: Covering ConvNets, Transformers and Everything in Between Ondřej Týbl Lukáš Neumann AI4CE 144 0 0 07 Oct 2025
Regression Language Models for Code Yash Akhauri Xingyou Song Arissa Wongpanich Bryan Lewandowski Mohamed S. Abdelfattah 132 1 0 30 Sep 2025
OptiProxy-NAS: Optimization Proxy based End-to-End Neural Architecture Search Bo Lyu Yu Cui Tuo Shi Ke Li 88 0 0 06 Sep 2025
Dextr: Zero-Shot Neural Architecture Search with Singular Value Decomposition and Extrinsic Curvature Rohan Asthana Joschua Conrad M. Ortmanns Vasileios Belagiannis 76 0 0 18 Aug 2025
Where and How to Enhance: Discovering Bit-Width Contribution for Mixed Precision QuantizationInternational Joint Conference on Artificial Intelligence (IJCAI), 2025 Haidong Kang Lianbo Ma Guo-Ding Yu Shangce Gao MQ 152 1 0 05 Aug 2025
Zero-Shot Neural Architecture Search with Weighted Response Correlation Kun Jing Luoyu Chen Jungang Xu Jianwei Tai Yiyu Wang Shuaimin Li 109 0 0 08 Jul 2025
Dynamic Mixture of Curriculum LoRA Experts for Continual Multimodal Instruction Tuning Chendi Ge Xin Eric Wang Zeyang Zhang Hong Chen Jiapei Fan Longtao Huang Hui Xue Wenwu Zhu MoE CLL 162 5 0 13 Jun 2025
Loss Functions for Predictor-based Neural Architecture Search Han Ji Yuqi Feng Jiahao Fan Yanan Sun 131 0 0 06 Jun 2025
CARL: Causality-guided Architecture Representation Learning for an Interpretable Performance Predictor Han Ji Yuqi Feng Jiahao Fan Yanan Sun OOD CML 189 0 0 04 Jun 2025
Half Search Space is All You Need Pavel Rumiantsev Mark Coates 166 0 0 19 May 2025
GreenFactory: Ensembling Zero-Cost Proxies to Estimate Performance of Neural Networks Gabriel Cortes Nuno Lourenço Paolo Romano Penousal Machado UQCV FedML 160 1 0 14 May 2025
L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision TransformersComputer Vision and Pattern Recognition (CVPR), 2025 S. Casarin Sergio Escalera Oswald Lanz 322 2 0 12 May 2025
Modular Machine Learning: An Indispensable Path towards New-Generation Large Language Models X. Wang Haoyang Li Zeyang Zhang Zeyang Zhang Wenwu Zhu LRM 305 1 0 28 Apr 2025
Multi-Task Neural Architecture Search Using Architecture Embedding and Transfer Rank TingJie Zhang HaiLin Liu 136 2 0 01 Apr 2025
RBFleX-NAS: Training-Free Neural Architecture Search Using Radial Basis Function Kernel and Hyperparameter DetectionIEEE Transactions on Neural Networks and Learning Systems (IEEE TNNLS), 2025 Tomomasa Yamasaki Zhehui Wang Yaoyu Zhang Niangjun Chen Bo Wang 432 2 0 26 Mar 2025
ZeroLM: Data-Free Transformer Architecture Search for Language Models Zhen-Song Chen Hong-Wei Ding Xian-Jia Wang Witold Pedrycz 271 0 0 24 Mar 2025
Variation Matters: from Mitigating to Embracing Zero-Shot NAS Ranking Function Variation Pavel Rumiantsev Mark Coates 241 0 0 27 Feb 2025
NEAR: A Training-Free Pre-Estimator of Machine Learning Model PerformanceInternational Conference on Learning Representations (ICLR), 2024 Raphael T. Husistein Markus Reiher Marco Eckhoff 363 1 0 20 Feb 2025
Training-free Neural Architecture Search through Variance of Knowledge of Deep Network WeightsComputer Vision and Pattern Recognition (CVPR), 2025 Ondřej Týbl Lukáš Neumann 155 1 0 07 Feb 2025
Neural Architecture Codesign for Fast Physics Applications Jason Weitz Dmitri Demler Luke McDermott Nhan Tran Javier Mauricio Duarte AI4CE 92 4 0 09 Jan 2025
No More Adam: Learning Rate Scaling at Initialization is All You Need Minghao Xu Lichuan Xiang Xu Cai Hongkai Wen 261 4 0 16 Dec 2024
GradAlign for Training-free Model Performance Inference Yuxuan Li Yunhui Guo 220 0 0 29 Nov 2024
GreenMachine: Automatic Design of Zero-Cost Proxies for Energy-Efficient NAS Gabriel Cortes Nuno Lourenço Penousal Machado 259 1 0 22 Nov 2024
ActNAS : Generating Efficient YOLO Models using Activation NAS Sudhakar Sah Ravish Kumar Darshan C. Ganji Ehsan Saboori 149 1 0 11 Oct 2024
LPZero: Language Model Zero-cost Proxy Search from ZeroConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Peijie Dong Lujun Li Xiang Liu Zhenheng Tang Xuebo Liu Qiang Wang Xiaowen Chu 773 5 0 07 Oct 2024
ADEPT-Z: Zero-Shot Automated Circuit Topology Search for Pareto-Optimal Photonic Tensor CoresAsia and South Pacific Design Automation Conference (ASP-DAC), 2024 Ziyang Jiang Pingchuan Ma Meng Zhang Rena Huang Jiaqi Gu 281 1 0 02 Oct 2024
OStr-DARTS: Differentiable Neural Architecture Search based on Operation StrengthIEEE Transactions on Cybernetics (IEEE Trans. Cybern.), 2024 Le Yang Ziwei Zheng Yizeng Han Shiji Song Gao Huang Fan Li 208 5 0 22 Sep 2024
NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid ModelsIEEE Transactions on Circuits and Systems Part 1: Regular Papers (TCAS-I), 2024 Yang Xu Huihong Shi Zhongfeng Wang 189 1 0 07 Sep 2024
MONAS: Efficient Zero-Shot Neural Architecture Search for MCUs Ye Qiao Jingcheng Li Yifan Zhang Sitao Huang 310 1 0 26 Aug 2024
Efficient Multi-Objective Neural Architecture Search via Pareto Dominance-based Novelty Search An Vo Ngoc Hoang Luong 183 1 0 30 Jul 2024
On Supernet Transfer Learning for Effective Task Adaptation Prabhant Singh Joaquin Vanschoren AAML OOD 327 0 0 26 Jul 2024
HyTAS: A Hyperspectral Image Transformer Architecture Search Benchmark and Analysis Fangqin Zhou Mert Kilickaya Joaquin Vanschoren Ran Piao 197 2 0 23 Jul 2024
ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models Yash Akhauri Ahmed F. AbouElhamayed Jordan Dotzel Zhiru Zhang Alexander M Rush Safeen Huda Mohamed S. Abdelfattah 160 7 0 24 Jun 2024
Unlocking the Global Synergies in Low-Rank Adapters Zixi Zhang Cheng Zhang Xitong Gao Robert D. Mullins George A. Constantinides Yiren Zhao 126 1 0 21 Jun 2024
Optimizing Time Series Forecasting Architectures: A Hierarchical Neural Architecture Search Approach Difan Deng Marius Lindauer AI4TS 221 1 0 07 Jun 2024
CE-NAS: An End-to-End Carbon-Efficient Neural Architecture Search Framework Yiyang Zhao Yunzhuo Liu Bo Jiang Tian Guo 283 7 0 03 Jun 2024
Manifold Metric: A Loss Landscape Approach for Predicting Model Performance Pranshu Malviya Jerry Huang A. Baratin Quentin Fournier Sarath Chandar 209 0 0 24 May 2024
NeurDB: An AI-powered Autonomous Data System Bengchin Ooi Shaofeng Cai Gang Chen Yanyan Shen K. Tan ... Naili Xing Cong Yue Lingze Zeng Meihui Zhang Zhanhao Zhao 268 15 0 07 May 2024
Graph is all you need? Lightweight data-agnostic neural architecture search without training Zhenhan Huang Tejaswini Pedapati Pin-Yu Chen Chunheng Jiang Jianxi Gao GNN 308 1 0 02 May 2024
Surprisingly Strong Performance Prediction with Neural Graph Features Gabriela Kadlecová Jovita Lukasik Martin Pilát Petra Vidnerová Mahmoud Safari Roman Neruda Katharina Eggensperger GNN OOD 209 9 0 25 Apr 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey Hou-I Liu Marco Galindo Hongxia Xie Lai-Kuan Wong Hong-Han Shuai Yung-Hui Li Wen-Huang Cheng 263 135 0 08 Apr 2024
AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search Junghyup Lee Bumsub Ham 169 23 0 28 Mar 2024
Anytime Neural Architecture Search on Tabular Data Naili Xing Shaofeng Cai Zhaojing Luo Bengchin Ooi Jian Pei 230 3 0 15 Mar 2024
Robustifying and Boosting Training-Free Neural Architecture SearchInternational Conference on Learning Representations (ICLR), 2024 Zhenfeng He Yao Shu Zhongxiang Dai K. H. Low 160 6 0 12 Mar 2024
ECToNAS: Evolutionary Cross-Topology Neural Architecture Search Elisabeth J. Schiessler R. Aydin C. Cyron 150 0 0 08 Mar 2024
SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAS Yameng Peng Andy Song Haytham M. Fayek Victor Ciesielski Xiaojun Chang 415 14 0 07 Mar 2024

All Papers

Zero-Cost Proxies for Lightweight NAS

Papers citing "Zero-Cost Proxies for Lightweight NAS"