Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2101.08134
Cited By
v1
v2 (latest)
Zero-Cost Proxies for Lightweight NAS
International Conference on Learning Representations (ICLR), 2021
20 January 2021
Mohamed S. Abdelfattah
Abhinav Mehrotra
Łukasz Dudziak
Nicholas D. Lane
Re-assign community
ArXiv (abs)
PDF
HTML
Github (152★)
Papers citing
"Zero-Cost Proxies for Lightweight NAS"
50 / 165 papers shown
Encodings for Prediction-based Neural Architecture Search
Yash Akhauri
Mohamed S. Abdelfattah
AI4CE
214
6
0
04 Mar 2024
On Latency Predictors for Neural Architecture Search
Yash Akhauri
Mohamed S. Abdelfattah
OOD
222
7
0
04 Mar 2024
ParZC: Parametric Zero-Cost Proxies for Efficient NAS
Peijie Dong
Lujun Li
Xinglin Pan
Zimian Wei
Xiang Liu
Qiang-qiang Wang
Xiaowen Chu
190
10
0
03 Feb 2024
How Much Is Hidden in the NAS Benchmarks? Few-Shot Adaptation of a NAS Predictor
H. Loya
Łukasz Dudziak
Abhinav Mehrotra
Royson Lee
Javier Fernandez-Marques
Nicholas D. Lane
Hongkai Wen
OOD
241
1
0
30 Nov 2023
Efficient Stitchable Task Adaptation
Computer Vision and Pattern Recognition (CVPR), 2023
Haoyu He
Zizheng Pan
Jing Liu
Jianfei Cai
Bohan Zhuang
328
7
0
29 Nov 2023
TVT: Training-Free Vision Transformer Search on Tiny Datasets
Zimian Wei
H. Pan
Lujun Li
Peijie Dong
Zhiliang Tian
Xin-Yi Niu
Dongsheng Li
ViT
131
9
0
24 Nov 2023
SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape
Hua Zheng
Kuang-Hung Liu
Igor Fedorov
Xin Zhang
Wen-Yen Chen
Wei Wen
273
2
0
22 Nov 2023
Rankitect: Ranking Architecture Search Battling World-class Engineers at Meta Scale
The Web Conference (WWW), 2023
Wei Wen
Kuang-Hung Liu
Igor Fedorov
Xin Zhang
Hang Yin
...
Fangqiu Han
Jiyan Yang
Yuchen Hao
Liang Xiong
Wen-Yen Chen
245
2
0
14 Nov 2023
LLM Performance Predictors are good initializers for Architecture Search
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Ganesh Jawahar
Muhammad Abdul-Mageed
L. Lakshmanan
Dujian Ding
LRM
362
33
0
25 Oct 2023
LEMON: Lossless model expansion
International Conference on Learning Representations (ICLR), 2023
Yite Wang
Jiahao Su
Hanlin Lu
Cong Xie
Tianyi Liu
Jianbo Yuan
Yanghua Peng
Tian Ding
Hongxia Yang
214
20
0
12 Oct 2023
Entropic Score metric: Decoupling Topology and Size in Training-free NAS
Niccolò Cavagnero
Luc Robbiano
Francesca Pistilli
Barbara Caputo
Giuseppe Averta
176
3
0
06 Oct 2023
A Primer on Bayesian Neural Networks: Review and Debates
Federico Danieli
Konstantinos Pitas
M. Vladimirova
Vincent Fortuin
BDL
AAML
275
35
0
28 Sep 2023
DONNAv2 -- Lightweight Neural Architecture Search for Vision tasks
Sweta Priyadarshi
Tianyu Jiang
Hsin-Pai Cheng
S. Rama Krishna
Viswanath Ganapathy
C. Patel
298
2
0
26 Sep 2023
Brain-inspired Evolutionary Architectures for Spiking Neural Networks
IEEE Transactions on Artificial Intelligence (IEEE TAI), 2023
Wenxuan Pan
Feifei Zhao
Zhuoya Zhao
Yi Zeng
281
5
0
11 Sep 2023
Sculpting Efficiency: Pruning Medical Imaging Models for On-Device Inference
Sudarshan Sreeram
Bernhard Kainz
188
2
0
10 Sep 2023
Efficacy of Neural Prediction-Based Zero-Shot NAS
Minh Le
Nhan Nguyen
N. H. Luong
295
0
0
31 Aug 2023
Efficient Model Adaptation for Continual Learning at the Edge
Z. Daniels
Jun Hu
M. Lomnitz
P.E.T.E.R.G. Miller
Aswin Raghavan
Joe Zhang
M. Piacentino
David C. Zhang
OOD
230
4
0
03 Aug 2023
Shrink-Perturb Improves Architecture Mixing during Population Based Training for Neural Architecture Search
European Conference on Artificial Intelligence (ECAI), 2023
A. Chebykin
A. Dushatskiy
Tanja Alderliesten
Peter A. N. Bosman
291
1
0
28 Jul 2023
YOLOBench: Benchmarking Efficient Object Detectors on Embedded Systems
Ivan Lazarevich
Matteo Grimaldi
Ravi Kumar
Saptarshi Mitra
Shahrukh Khan
Sudhakar Sah
ObjD
FedML
ELM
291
22
0
26 Jul 2023
An Evaluation of Zero-Cost Proxies -- from Neural Architecture Performance to Model Robustness
Jovita Lukasik
Michael Moeller
Margret Keuper
210
4
0
18 Jul 2023
A Survey of Techniques for Optimizing Transformer Inference
Journal of systems architecture (JSA), 2023
Krishna Teja Chitty-Venkata
Sparsh Mittal
M. Emani
V. Vishwanath
Arun Somani
263
120
0
16 Jul 2023
Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Guihong Li
Duc-Tuong Hoang
Kartikeya Bhardwaj
Ming Lin
Zinan Lin
R. Marculescu
393
39
0
05 Jul 2023
AutoST: Training-free Neural Architecture Search for Spiking Transformers
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Ziqing Wang
Qidong Zhao
Jinku Cui
Xu Liu
Dongkuan Xu
242
7
0
01 Jul 2023
PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning
Neural Information Processing Systems (NeurIPS), 2023
Neeratyoy Mallik
Eddie Bergman
Carl Hvarfner
Daniel Stoll
Maciej Janowski
Marius Lindauer
Luigi Nardi
Katharina Eggensperger
288
41
0
21 Jun 2023
Neural Fine-Tuning Search for Few-Shot Learning
International Conference on Learning Representations (ICLR), 2023
Panagiotis Eustratiadis
Łukasz Dudziak
Da Li
Timothy M. Hospedales
198
7
0
15 Jun 2023
Generalizable Lightweight Proxy for Robust NAS against Diverse Perturbations
Neural Information Processing Systems (NeurIPS), 2023
Hyeonjeong Ha
Minseon Kim
Sung Ju Hwang
OOD
AAML
315
9
0
08 Jun 2023
Multi-Predict: Few Shot Predictors For Efficient Neural Architecture Search
Yash Akhauri
Mohamed S. Abdelfattah
180
8
0
04 Jun 2023
Training-free Neural Architecture Search for RNNs and Transformers
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Aaron Serianni
Jugal Kalita
185
8
0
01 Jun 2023
Pruning at Initialization -- A Sketching Perspective
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Noga Bar
Raja Giryes
266
1
0
27 May 2023
Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets
International Conference on Learning Representations (ICLR), 2023
Hayeon Lee
Sohyun An
Minseon Kim
Sung Ju Hwang
OOD
175
5
0
26 May 2023
Combining Multi-Objective Bayesian Optimization with Reinforcement Learning for TinyML
ACM Transactions on Evolutionary Learning and Optimization (TELO), 2023
M. Deutel
G. Kontes
Christopher Mutschler
Jürgen Teich
518
4
0
23 May 2023
Canvas: End-to-End Kernel Architecture Search in Neural Networks
Chenggang Zhao
Genghan Zhang
Mingyu Gao
177
2
0
16 Apr 2023
NTK-SAP: Improving neural network pruning by aligning training dynamics
International Conference on Learning Representations (ICLR), 2023
Yite Wang
Dawei Li
Tian Ding
227
32
0
06 Apr 2023
DisWOT: Student Architecture Search for Distillation WithOut Training
Computer Vision and Pattern Recognition (CVPR), 2023
Peijie Dong
Lujun Li
Zimian Wei
187
77
0
28 Mar 2023
Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?
International Conference on Machine Learning (ICML), 2023
Boris Knyazev
Doha Hwang
Damien Scieur
AI4CE
181
28
0
07 Mar 2023
Symbolic Synthesis of Neural Networks
Eli Whitehouse
243
1
0
06 Mar 2023
Bespoke: A Block-Level Neural Network Optimization Framework for Low-Cost Deployment
AAAI Conference on Artificial Intelligence (AAAI), 2023
Jong-Ryul Lee
Yong-Hyuk Moon
199
0
0
03 Mar 2023
A General-Purpose Transferable Predictor for Neural Architecture Search
SDM (SDM), 2023
Fred X. Han
Keith G. Mills
Fabián A. Chudak
Parsa Riahi
Mohammad Salameh
Jialin Zhang
Wei Lu
Shangling Jui
Di Niu
AI4CE
OOD
153
3
0
21 Feb 2023
Stitchable Neural Networks
Computer Vision and Pattern Recognition (CVPR), 2023
Zizheng Pan
Jianfei Cai
Bohan Zhuang
259
39
0
13 Feb 2023
Dynamic Ensemble of Low-fidelity Experts: Mitigating NAS "Cold-Start"
AAAI Conference on Artificial Intelligence (AAAI), 2023
Junbo Zhao
Xuefei Ning
En-hao Liu
Binxin Ru
Zixuan Zhou
Tianchen Zhao
Chen Chen
Jiajin Zhang
Q. Liao
Yu Wang
AI4CE
230
5
0
02 Feb 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients
International Conference on Learning Representations (ICLR), 2023
Guihong Li
Yuedong Yang
Kartikeya Bhardwaj
R. Marculescu
496
83
0
26 Jan 2023
RD-NAS: Enhancing One-shot Supernet Ranking Ability via Ranking Distillation from Zero-cost Proxies
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Peijie Dong
Xin-Yi Niu
Lujun Li
Zhiliang Tian
Xiaodong Wang
Zimian Wei
H. Pan
Dongsheng Li
262
17
0
24 Jan 2023
Neural Architecture Search: Insights from 1000 Papers
Colin White
Mahmoud Safari
R. Sukthanker
Binxin Ru
T. Elsken
Arber Zela
Debadeepta Dey
Katharina Eggensperger
3DV
AI4CE
409
191
0
20 Jan 2023
Efficient Evaluation Methods for Neural Architecture Search: A Survey
IEEE Transactions on Artificial Intelligence (IEEE TAI), 2023
Xiangning Xie
Xiaotian Song
Zeqiong Lv
Gary G. Yen
Weiping Ding
Yizhou Sun
248
28
0
14 Jan 2023
Differentiable Search of Accurate and Robust Architectures
Yuwei Ou
Xiangning Xie
Shan Gao
Yanan Sun
Kay Chen Tan
Jiancheng Lv
OOD
AAML
217
2
0
28 Dec 2022
DAS: Neural Architecture Search via Distinguishing Activation Score
Yuqiao Liu
Haipeng Li
Yanan Sun
Shuaicheng Liu
206
1
0
23 Dec 2022
AIO-P: Expanding Neural Performance Predictors Beyond Image Classification
AAAI Conference on Artificial Intelligence (AAAI), 2022
Keith G. Mills
Di Niu
Mohammad Salameh
Weichen Qiu
Fred X. Han
Puyuan Liu
Jialin Zhang
Wei Lu
Shangling Jui
287
7
0
30 Nov 2022
GENNAPE: Towards Generalized Neural Architecture Performance Estimators
AAAI Conference on Artificial Intelligence (AAAI), 2022
Keith G. Mills
Fred X. Han
Jialin Zhang
Fabián A. Chudak
A. Mamaghani
Mohammad Salameh
Wei Lu
Shangling Jui
Di Niu
259
8
0
30 Nov 2022
Joint Neural Architecture and Hyperparameter Search for Correlated Time Series Forecasting
Xinle Wu
Dalin Zhang
Miao Zhang
Chenjuan Guo
B. Yang
Christian S. Jensen
AI4TS
226
36
0
29 Nov 2022
Receptive Field Refinement for Convolutional Neural Networks Reliably Improves Predictive Performance
Mats L. Richter
C. Pal
166
5
0
26 Nov 2022
Previous
1
2
3
4
Next
