TransNAS-Bench-101: Improving Transferability and Generalizability of Cross-Task Neural Architecture Search

25 May 2021

Hang Xu

Tong Zhang

Papers citing "TransNAS-Bench-101: Improving Transferability and Generalizability of Cross-Task Neural Architecture Search"

49 / 49 papers shown

Title
L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision Transformers S. Casarin Sergio Escalera Oswald Lanz 34 0 0 12 May 2025
Evolution Meets Diffusion: Efficient Neural Architecture Generation Bingye Zhou Caiyang Yu DiffM 54 0 0 24 Apr 2025
Multi-Task Neural Architecture Search Using Architecture Embedding and Transfer Rank TingJie Zhang HaiLin Liu 43 1 0 01 Apr 2025
RBFleX-NAS: Training-Free Neural Architecture Search Using Radial Basis Function Kernel and Hyperparameter Detection Tomomasa Yamasaki Zhehui Wang Tao Luo Niangjun Chen Bo Wang 32 0 0 26 Mar 2025
Variation Matters: from Mitigating to Embracing Zero-Shot NAS Ranking Function Variation P. Rumiantsev Mark Coates 55 0 0 27 Feb 2025
SEKI: Self-Evolution and Knowledge Inspiration based Neural Architecture Search via Large Language Models Zicheng Cai Yaohua Tang Yutao Lai Hua Wang Zhaoyu Chen Hao Chen LLMAG VLM LRM 50 0 0 27 Feb 2025
NEAR: A Training-Free Pre-Estimator of Machine Learning Model Performance Raphael T. Husistein Markus Reiher Marco Eckhoff 142 1 0 20 Feb 2025
Task Adaptation of Reinforcement Learning-based NAS Agents through Transfer Learning Amber Cassimon Siegfried Mercelis Kevin Mets 88 1 0 02 Dec 2024
Design Principle Transfer in Neural Architecture Search via Large Language Models Xun Zhou Liang Feng Xingyu Wu Zhichao Lu Kay Chen Tan 41 3 0 21 Aug 2024
OvSW: Overcoming Silent Weights for Accurate Binary Neural Networks Jingyang Xiang Zuohui Chen Siqi Li Qing Wu Yong-Jin Liu 28 1 0 07 Jul 2024
HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models R. Sukthanker Arber Zela B. Staffler Aaron Klein Lennart Purucker Jorg K. H. Franke Frank Hutter ELM 43 3 0 16 May 2024
GRASP-GCN: Graph-Shape Prioritization for Neural Architecture Search under Distribution Shifts S. Casarin Oswald Lanz Sergio Escalera GNN OOD 21 0 0 11 May 2024
Graph is all you need? Lightweight data-agnostic neural architecture search without training Zhenhan Huang Tejaswini Pedapati Pin-Yu Chen Chunheng Jiang Jianxi Gao GNN 40 1 0 02 May 2024
Surprisingly Strong Performance Prediction with Neural Graph Features Gabriela Kadlecová Jovita Lukasik Martin Pilát Petra Vidnerová Mahmoud Safari Roman Neruda Frank Hutter GNN OOD 48 2 0 25 Apr 2024
Robust NAS under adversarial training: benchmark, theory, and beyond Yongtao Wu Fanghui Liu Carl-Johann Simon-Gabriel Grigorios G. Chrysos V. Cevher AAML OOD 35 3 0 19 Mar 2024
Robustifying and Boosting Training-Free Neural Architecture Search Zhenfeng He Yao Shu Zhongxiang Dai K. H. Low 43 1 0 12 Mar 2024
SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAS Yameng Peng Andy Song Haytham M. Fayek Victor Ciesielski Xiaojun Chang 37 4 0 07 Mar 2024
Encodings for Prediction-based Neural Architecture Search Yash Akhauri Mohamed S. Abdelfattah AI4CE 41 3 0 04 Mar 2024
On Latency Predictors for Neural Architecture Search Yash Akhauri Mohamed S. Abdelfattah OOD 27 2 0 04 Mar 2024
How Much Is Hidden in the NAS Benchmarks? Few-Shot Adaptation of a NAS Predictor H. Loya L. Dudziak Abhinav Mehrotra Royson Lee Javier Fernandez-Marques Nicholas D. Lane Hongkai Wen OOD 38 0 0 30 Nov 2023
Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities Guihong Li Duc-Tuong Hoang Kartikeya Bhardwaj Ming Lin Zhangyang Wang R. Marculescu 40 10 0 05 Jul 2023
Rethink DARTS Search Space and Renovate a New Benchmark Jiuling Zhang Zhiming Ding 35 1 0 12 Jun 2023
Neural Architecture Design and Robustness: A Dataset Steffen Jung Jovita Lukasik M. Keuper OOD AAML 46 19 0 11 Jun 2023
Multi-Predict: Few Shot Predictors For Efficient Neural Architecture Search Yash Akhauri Mohamed S. Abdelfattah 23 4 0 04 Jun 2023
Are Neural Architecture Search Benchmarks Well Designed? A Deeper Look Into Operation Importance Vasco Lopes Bruno Degardin L. A. Alexandre 30 5 0 29 Mar 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 36 61 0 26 Jan 2023
GP-NAS-ensemble: a model for NAS Performance Prediction Kunlong Chen Liu Yang Yitian Chen Kunjin Chen Yidan Xu Lujun Li 27 13 0 23 Jan 2023
Neural Architecture Search: Insights from 1000 Papers Colin White Mahmoud Safari R. Sukthanker Binxin Ru T. Elsken Arber Zela Debadeepta Dey Frank Hutter 3DV AI4CE 34 130 0 20 Jan 2023
Efficient Evaluation Methods for Neural Architecture Search: A Survey Xiangning Xie Xiaotian Song Zeqiong Lv Gary G. Yen Weiping Ding Yizhou Sun 32 12 0 14 Jan 2023
AIO-P: Expanding Neural Performance Predictors Beyond Image Classification Keith G. Mills Di Niu Mohammad Salameh Weichen Qiu Fred X. Han Puyuan Liu Jialin Zhang Wei Lu Shangling Jui 35 7 0 30 Nov 2022
Extensible Proxy for Efficient NAS Yuhong Li Jiajie Li Cong Han P. Li Jinjun Xiong De-huai Chen 20 1 0 17 Oct 2022
NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies Arjun Krishnakumar Colin White Arber Zela Renbo Tu Mahmoud Safari Frank Hutter 55 40 0 06 Oct 2022
Monte Carlo Tree Search based Variable Selection for High Dimensional Bayesian Optimization Lei Song Ke Xue Xiaobin Huang Chaojun Qian 14 34 0 04 Oct 2022
Neural Architecture Search as Multiobjective Optimization Benchmarks: Problem Formulation and Performance Assessment Zhichao Lu Ran Cheng Yaochu Jin Kay Chen Tan Kalyanmoy Deb 24 53 0 08 Aug 2022
The BUTTER Zone: An Empirical Study of Training Dynamics in Fully Connected Neural Networks Charles Edison Tripp J. Perr-Sauer L. Hayne M. Lunacek Jamil Gafur AI4CE 23 0 0 25 Jul 2022
Guided Evolutionary Neural Architecture Search With Efficient Performance Estimation Vasco Lopes Miguel Santos Bruno Degardin L. A. Alexandre 52 3 0 22 Jul 2022
Multi-Prior Learning via Neural Architecture Search for Blind Face Restoration Yanjiang Yu Puyang Zhang Kaihao Zhang Wenhan Luo Changsheng Li Ye Yuan Guoren Wang CVBM 10 5 0 28 Jun 2022
NAS-Bench-Graph: Benchmarking Graph Neural Architecture Search Yi Qin Ziwei Zhang Xin Wang Zeyang Zhang Wenwu Zhu 27 26 0 18 Jun 2022
Arch-Graph: Acyclic Architecture Relation Predictor for Task-Transferable Neural Architecture Search Minbin Huang Zhijian Huang Changlin Li Xin Chen Hangyang Xu Zhenguo Li Xiaodan Liang 36 18 0 12 Apr 2022
On Redundancy and Diversity in Cell-based Neural Architecture Search Xingchen Wan Binxin Ru Pedro M. Esperancca Zhenguo Li 33 20 0 16 Mar 2022
Towards Less Constrained Macro-Neural Architecture Search Vasco Lopes L. A. Alexandre 33 5 0 10 Mar 2022
NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easy Yash Mehta Colin White Arber Zela Arjun Krishnakumar Guri Zabergja Shakiba Moradian Mahmoud Safari Kaicheng Yu Frank Hutter 24 41 0 31 Jan 2022
Neural Architecture Search for Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Priyadarshini Panda 26 88 0 23 Jan 2022
NAS-HPO-Bench-II: A Benchmark Dataset on Joint Optimization of Convolutional Neural Network Architecture and Training Hyperparameters Yoichi Hirose Nozomu Yoshinari Shinichi Shirakawa 19 13 0 19 Oct 2021
NAS-Bench-360: Benchmarking Neural Architecture Search on Diverse Tasks Renbo Tu Nicholas Roberts M. Khodak Jun Shen Frederic Sala Ameet Talwalkar 20 33 0 12 Oct 2021
NASOA: Towards Faster Task-oriented Online Fine-tuning with a Zoo of Models Hang Xu Ning Kang Gengwei Zhang Chuanlong Xie Xiaodan Liang Zhenguo Li OnRL 25 7 0 07 Aug 2021
Conditional super-network weights Kevin Laube A. Zell 11 0 0 23 Apr 2021
Learning Versatile Neural Architectures by Propagating Network Codes Mingyu Ding Yuqi Huo Haoyu Lu Linjie Yang Zhe Wang Zhiwu Lu Jingdong Wang Ping Luo AAML 40 13 0 24 Mar 2021
DetNet: A Backbone network for Object Detection Zeming Li Chao Peng Gang Yu Xiangyu Zhang Yangdong Deng Jian Sun ObjD 88 263 0 17 Apr 2018