Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2101.08134
Cited By
v1
v2 (latest)
Zero-Cost Proxies for Lightweight NAS
International Conference on Learning Representations (ICLR), 2021
20 January 2021
Mohamed S. Abdelfattah
Abhinav Mehrotra
Łukasz Dudziak
Nicholas D. Lane
Re-assign community
ArXiv (abs)
PDF
HTML
Github (152★)
Papers citing
"Zero-Cost Proxies for Lightweight NAS"
50 / 165 papers shown
CompressNAS : A Fast and Efficient Technique for Model Compression using Decomposition
Sudhakar Sah
Nikhil Chabbra
Matthieu Durnerin
111
0
0
12 Nov 2025
Models Got Talent: Identifying High Performing Wearable Human Activity Recognition Models Without Training
Richard Goldman
Varun Komperla
Thomas Ploetz
H. Haresamudram
162
0
0
08 Nov 2025
Learning to Flow from Generative Pretext Tasks for Neural Architecture Encoding
Sunwoo Kim
Hyunjin Hwang
Kijung Shin
AI4CE
194
0
0
21 Oct 2025
FLRC: Fine-grained Low-Rank Compressor for Efficient LLM Inference
Yu-Chen Lu
Chong-Yan Chen
Chi-Chih Chang
Yu-Fang Hu
Kai-Chiang Wu
80
1
0
10 Oct 2025
Universal Neural Architecture Space: Covering ConvNets, Transformers and Everything in Between
Ondřej Týbl
Lukáš Neumann
AI4CE
208
0
0
07 Oct 2025
Regression Language Models for Code
Yash Akhauri
Xingyou Song
Arissa Wongpanich
Bryan Lewandowski
Mohamed S. Abdelfattah
184
3
0
30 Sep 2025
OptiProxy-NAS: Optimization Proxy based End-to-End Neural Architecture Search
Bo Lyu
Yu Cui
Tuo Shi
Ke Li
130
0
0
06 Sep 2025
Dextr: Zero-Shot Neural Architecture Search with Singular Value Decomposition and Extrinsic Curvature
Rohan Asthana
Joschua Conrad
M. Ortmanns
Vasileios Belagiannis
116
0
0
18 Aug 2025
Where and How to Enhance: Discovering Bit-Width Contribution for Mixed Precision Quantization
International Joint Conference on Artificial Intelligence (IJCAI), 2025
Haidong Kang
Lianbo Ma
Guo-Ding Yu
Shangce Gao
MQ
239
1
0
05 Aug 2025
Zero-Shot Neural Architecture Search with Weighted Response Correlation
Kun Jing
Luoyu Chen
Jungang Xu
Jianwei Tai
Yiyu Wang
Shuaimin Li
149
0
0
08 Jul 2025
Dynamic Mixture of Curriculum LoRA Experts for Continual Multimodal Instruction Tuning
Chendi Ge
Xin Eric Wang
Zeyang Zhang
Hong Chen
Jiapei Fan
Longtao Huang
Hui Xue
Wenwu Zhu
MoE
CLL
222
5
0
13 Jun 2025
Loss Functions for Predictor-based Neural Architecture Search
Han Ji
Yuqi Feng
Jiahao Fan
Yanan Sun
163
0
0
06 Jun 2025
CARL: Causality-guided Architecture Representation Learning for an Interpretable Performance Predictor
Han Ji
Yuqi Feng
Jiahao Fan
Yanan Sun
OOD
CML
235
0
0
04 Jun 2025
Half Search Space is All You Need
Pavel Rumiantsev
Mark Coates
216
0
0
19 May 2025
GreenFactory: Ensembling Zero-Cost Proxies to Estimate Performance of Neural Networks
Gabriel Cortes
Nuno Lourenço
Paolo Romano
Penousal Machado
UQCV
FedML
237
1
0
14 May 2025
L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision Transformers
Computer Vision and Pattern Recognition (CVPR), 2025
S. Casarin
Sergio Escalera
Oswald Lanz
366
2
0
12 May 2025
Modular Machine Learning: An Indispensable Path towards New-Generation Large Language Models
X. Wang
Haoyang Li
Zeyang Zhang
Zeyang Zhang
Wenwu Zhu
LRM
405
1
0
28 Apr 2025
Multi-Task Neural Architecture Search Using Architecture Embedding and Transfer Rank
TingJie Zhang
HaiLin Liu
221
2
0
01 Apr 2025
RBFleX-NAS: Training-Free Neural Architecture Search Using Radial Basis Function Kernel and Hyperparameter Detection
IEEE Transactions on Neural Networks and Learning Systems (IEEE TNNLS), 2025
Tomomasa Yamasaki
Zhehui Wang
Yaoyu Zhang
Niangjun Chen
Bo Wang
546
3
0
26 Mar 2025
ZeroLM: Data-Free Transformer Architecture Search for Language Models
Zhen-Song Chen
Hong-Wei Ding
Xian-Jia Wang
Witold Pedrycz
344
1
0
24 Mar 2025
Variation Matters: from Mitigating to Embracing Zero-Shot NAS Ranking Function Variation
Pavel Rumiantsev
Mark Coates
293
0
0
27 Feb 2025
NEAR: A Training-Free Pre-Estimator of Machine Learning Model Performance
International Conference on Learning Representations (ICLR), 2024
Raphael T. Husistein
Markus Reiher
Marco Eckhoff
407
1
0
20 Feb 2025
Training-free Neural Architecture Search through Variance of Knowledge of Deep Network Weights
Computer Vision and Pattern Recognition (CVPR), 2025
Ondřej Týbl
Lukáš Neumann
239
1
0
07 Feb 2025
Neural Architecture Codesign for Fast Physics Applications
Jason Weitz
Dmitri Demler
Luke McDermott
Nhan Tran
Javier Mauricio Duarte
AI4CE
140
7
0
09 Jan 2025
No More Adam: Learning Rate Scaling at Initialization is All You Need
Minghao Xu
Lichuan Xiang
Xu Cai
Hongkai Wen
341
4
0
16 Dec 2024
GradAlign for Training-free Model Performance Inference
Yuxuan Li
Yunhui Guo
264
0
0
29 Nov 2024
GreenMachine: Automatic Design of Zero-Cost Proxies for Energy-Efficient NAS
Gabriel Cortes
Nuno Lourenço
Penousal Machado
309
1
0
22 Nov 2024
ActNAS : Generating Efficient YOLO Models using Activation NAS
Sudhakar Sah
Ravish Kumar
Darshan C. Ganji
Ehsan Saboori
202
1
0
11 Oct 2024
LPZero: Language Model Zero-cost Proxy Search from Zero
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Peijie Dong
Lujun Li
Xiang Liu
Zhenheng Tang
Xuebo Liu
Qiang Wang
Xiaowen Chu
842
7
0
07 Oct 2024
ADEPT-Z: Zero-Shot Automated Circuit Topology Search for Pareto-Optimal Photonic Tensor Cores
Asia and South Pacific Design Automation Conference (ASP-DAC), 2024
Ziyang Jiang
Pingchuan Ma
Meng Zhang
Rena Huang
Jiaqi Gu
312
2
0
02 Oct 2024
OStr-DARTS: Differentiable Neural Architecture Search based on Operation Strength
IEEE Transactions on Cybernetics (IEEE Trans. Cybern.), 2024
Le Yang
Ziwei Zheng
Yizeng Han
Shiji Song
Gao Huang
Fan Li
240
7
0
22 Sep 2024
NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models
IEEE Transactions on Circuits and Systems Part 1: Regular Papers (TCAS-I), 2024
Yang Xu
Huihong Shi
Zhongfeng Wang
230
1
0
07 Sep 2024
MONAS: Efficient Zero-Shot Neural Architecture Search for MCUs
Ye Qiao
Jingcheng Li
Yifan Zhang
Sitao Huang
428
1
0
26 Aug 2024
Efficient Multi-Objective Neural Architecture Search via Pareto Dominance-based Novelty Search
An Vo
Ngoc Hoang Luong
218
1
0
30 Jul 2024
On Supernet Transfer Learning for Effective Task Adaptation
Prabhant Singh
Joaquin Vanschoren
AAML
OOD
402
0
0
26 Jul 2024
HyTAS: A Hyperspectral Image Transformer Architecture Search Benchmark and Analysis
Fangqin Zhou
Mert Kilickaya
Joaquin Vanschoren
Ran Piao
238
2
0
23 Jul 2024
ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models
Yash Akhauri
Ahmed F. AbouElhamayed
Jordan Dotzel
Zhiru Zhang
Alexander M Rush
Safeen Huda
Mohamed S. Abdelfattah
220
7
0
24 Jun 2024
Unlocking the Global Synergies in Low-Rank Adapters
Zixi Zhang
Cheng Zhang
Xitong Gao
Robert D. Mullins
George A. Constantinides
Yiren Zhao
153
1
0
21 Jun 2024
Optimizing Time Series Forecasting Architectures: A Hierarchical Neural Architecture Search Approach
Difan Deng
Marius Lindauer
AI4TS
297
1
0
07 Jun 2024
CE-NAS: An End-to-End Carbon-Efficient Neural Architecture Search Framework
Yiyang Zhao
Yunzhuo Liu
Bo Jiang
Tian Guo
340
7
0
03 Jun 2024
Manifold Metric: A Loss Landscape Approach for Predicting Model Performance
Pranshu Malviya
Jerry Huang
A. Baratin
Quentin Fournier
Sarath Chandar
267
0
0
24 May 2024
NeurDB: An AI-powered Autonomous Data System
Bengchin Ooi
Shaofeng Cai
Gang Chen
Yanyan Shen
K. Tan
...
Naili Xing
Cong Yue
Lingze Zeng
Meihui Zhang
Zhanhao Zhao
302
16
0
07 May 2024
Graph is all you need? Lightweight data-agnostic neural architecture search without training
Zhenhan Huang
Tejaswini Pedapati
Pin-Yu Chen
Chunheng Jiang
Jianxi Gao
GNN
356
1
0
02 May 2024
Surprisingly Strong Performance Prediction with Neural Graph Features
Gabriela Kadlecová
Jovita Lukasik
Martin Pilát
Petra Vidnerová
Mahmoud Safari
Roman Neruda
Katharina Eggensperger
GNN
OOD
265
10
0
25 Apr 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey
Hou-I Liu
Marco Galindo
Hongxia Xie
Lai-Kuan Wong
Hong-Han Shuai
Yung-Hui Li
Wen-Huang Cheng
363
151
0
08 Apr 2024
AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search
Junghyup Lee
Bumsub Ham
202
27
0
28 Mar 2024
Anytime Neural Architecture Search on Tabular Data
Naili Xing
Shaofeng Cai
Zhaojing Luo
Bengchin Ooi
Jian Pei
305
3
0
15 Mar 2024
Robustifying and Boosting Training-Free Neural Architecture Search
International Conference on Learning Representations (ICLR), 2024
Zhenfeng He
Yao Shu
Zhongxiang Dai
K. H. Low
208
8
0
12 Mar 2024
ECToNAS: Evolutionary Cross-Topology Neural Architecture Search
Elisabeth J. Schiessler
R. Aydin
C. Cyron
209
0
0
08 Mar 2024
SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAS
Yameng Peng
Andy Song
Haytham M. Fayek
Victor Ciesielski
Xiaojun Chang
547
16
0
07 Mar 2024
1
2
3
4
Next
