Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective

23 February 2021

Papers citing "Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective"

50 / 57 papers shown

Title
GreenFactory: Ensembling Zero-Cost Proxies to Estimate Performance of Neural Networks Gabriel Cortes Nuno Lourenço Paolo Romano Penousal Machado UQCV FedML 34 0 0 14 May 2025
L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision Transformers S. Casarin Sergio Escalera O. Lanz 34 0 0 12 May 2025
RBFleX-NAS: Training-Free Neural Architecture Search Using Radial Basis Function Kernel and Hyperparameter Detection Tomomasa Yamasaki Zhehui Wang Tao Luo Niangjun Chen Bo Wang 32 0 0 26 Mar 2025
Variation Matters: from Mitigating to Embracing Zero-Shot NAS Ranking Function Variation P. Rumiantsev Mark Coates 55 0 0 27 Feb 2025
NEAR: A Training-Free Pre-Estimator of Machine Learning Model Performance Raphael T. Husistein Markus Reiher Marco Eckhoff 142 1 0 20 Feb 2025
NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models Yang Xu Huihong Shi Zhongfeng Wang 39 0 0 07 Sep 2024
Neural Lineage Runpeng Yu Xinchao Wang 26 4 0 17 Jun 2024
TG-NAS: Leveraging Zero-Cost Proxies with Transformer and Graph Convolution Networks for Efficient Neural Architecture Search Ye Qiao Haocheng Xu Sitao Huang 19 0 0 30 Mar 2024
Anytime Neural Architecture Search on Tabular Data Naili Xing Shaofeng Cai Zhaojing Luo Bengchin Ooi Jian Pei 34 1 0 15 Mar 2024
Robustifying and Boosting Training-Free Neural Architecture Search Zhenfeng He Yao Shu Zhongxiang Dai K. H. Low 35 1 0 12 Mar 2024
MatchNAS: Optimizing Edge AI in Sparse-Label Data Contexts via Automating Deep Neural Network Porting for Mobile Deployment Hongtao Huang Xiaojun Chang Wen Hu Lina Yao 30 0 0 21 Feb 2024
Fast and Exact Enumeration of Deep Networks Partitions Regions Randall Balestriero Yann LeCun 18 5 0 20 Jan 2024
InstaTune: Instantaneous Neural Architecture Search During Fine-Tuning S. N. Sridhar Souvik Kundu Sairam Sundaresan Maciej Szankin Anthony Sarah 19 3 0 29 Aug 2023
An Evaluation of Zero-Cost Proxies -- from Neural Architecture Performance to Model Robustness Jovita Lukasik Michael Moeller M. Keuper 27 1 0 18 Jul 2023
GeNAS: Neural Architecture Search with Better Generalization Joonhyun Jeong Joonsang Yu Geondo Park Dongyoon Han Y. Yoo 30 4 0 15 May 2023
When Deep Learning Meets Polyhedral Theory: A Survey Joey Huchette Gonzalo Muñoz Thiago Serra Calvin Tsay AI4CE 94 32 0 29 Apr 2023
NTK-SAP: Improving neural network pruning by aligning training dynamics Yite Wang Dawei Li Ruoyu Sun 34 19 0 06 Apr 2023
SplineCam: Exact Visualization and Characterization of Deep Network Geometry and Decision Boundaries Ahmed Imtiaz Humayun Randall Balestriero Guha Balakrishnan Richard Baraniuk 24 17 0 24 Feb 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 36 60 0 26 Jan 2023
Deep Model Reassembly Xingyi Yang Zhou Daquan Songhua Liu Jingwen Ye Xinchao Wang MoMe 20 120 0 24 Oct 2022
Pareto-aware Neural Architecture Generation for Diverse Computational Budgets Yong Guo Yaofo Chen Yin Zheng Qi Chen P. Zhao Jian Chen Junzhou Huang Mingkui Tan 28 5 0 14 Oct 2022
Towards Theoretically Inspired Neural Initialization Optimization Yibo Yang Hong Wang Haobo Yuan Zhouchen Lin 21 9 0 12 Oct 2022
What Can the Neural Tangent Kernel Tell Us About Adversarial Robustness? Nikolaos Tsilivis Julia Kempe AAML 39 17 0 11 Oct 2022
Batch Normalization Explained Randall Balestriero Richard G. Baraniuk AAML 30 16 0 29 Sep 2022
EZNAS: Evolving Zero Cost Proxies For Neural Architecture Scoring Yash Akhauri J. P. Muñoz Nilesh Jain Ravi Iyer 46 13 0 15 Sep 2022
Generalization Properties of NAS under Activation and Skip Connection Search Zhenyu Zhu Fanghui Liu Grigorios G. Chrysos V. Cevher AI4CE 28 15 0 15 Sep 2022
On the Privacy Risks of Cell-Based NAS Architectures Haiping Huang Zhikun Zhang Yun Shen Michael Backes Qi Li Yang Zhang 27 7 0 04 Sep 2022
Can we achieve robustness from data alone? Nikolaos Tsilivis Jingtong Su Julia Kempe OOD DD 36 18 0 24 Jul 2022
Fast Finite Width Neural Tangent Kernel Roman Novak Jascha Narain Sohl-Dickstein S. Schoenholz AAML 20 53 0 17 Jun 2022
Lower and Upper Bounds for Numbers of Linear Regions of Graph Convolutional Networks Hao Chen Yu Wang Huan Xiong GNN 14 6 0 01 Jun 2022
Machine Learning for Microcontroller-Class Hardware: A Review Swapnil Sayan Saha S. Sandha Mani B. Srivastava 24 118 0 29 May 2022
Analyzing Tree Architectures in Ensembles via Neural Tangent Kernel Ryuichi Kanoh M. Sugiyama 23 2 0 25 May 2022
Graph-DETR3D: Rethinking Overlapping Regions for Multi-View 3D Object Detection Zehui Chen Zhenyu Li Shiquan Zhang Liangji Fang Qinhong Jiang Feng Zhao 21 45 0 25 Apr 2022
When NAS Meets Trees: An Efficient Algorithm for Neural Architecture Search Guocheng Qian Xuanyang Zhang G. Li Chen Zhao Yukang Chen X. Zhang Bernard Ghanem Jian-jun Sun 39 4 0 11 Apr 2022
A Semi-Decoupled Approach to Fast and Optimal Hardware-Software Co-Design of Neural Accelerators Bingqian Lu Zheyu Yan Yiyu Shi Shaolei Ren 23 2 0 25 Mar 2022
Training-free Transformer Architecture Search Qinqin Zhou Kekai Sheng Xiawu Zheng Ke Li Xing Sun Yonghong Tian Jie Chen Rongrong Ji ViT 32 46 0 23 Mar 2022
Global Convergence of MAML and Theory-Inspired Neural Architecture Search for Few-Shot Learning Haoxiang Wang Yite Wang Ruoyu Sun Bo-wen Li 27 27 0 17 Mar 2022
Learning Where To Look -- Generative NAS is Surprisingly Efficient Jovita Lukasik Steffen Jung M. Keuper 21 15 0 16 Mar 2022
Towards Less Constrained Macro-Neural Architecture Search Vasco Lopes L. A. Alexandre 28 5 0 10 Mar 2022
Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data Yaoqing Yang Ryan Theisen Liam Hodgkinson Joseph E. Gonzalez Kannan Ramchandran Charles H. Martin Michael W. Mahoney 86 17 0 06 Feb 2022
Demystify Optimization and Generalization of Over-parameterized PAC-Bayesian Learning Wei Huang Chunrui Liu Yilan Chen Tianyu Liu R. Xu BDL MLT 19 2 0 04 Feb 2022
Neural Architecture Search for Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Priyadarshini Panda 26 88 0 23 Jan 2022
Representation Topology Divergence: A Method for Comparing Neural Network Representations S. Barannikov I. Trofimov Nikita Balabin Evgeny Burnaev 3DPC 30 45 0 31 Dec 2021
Automated Deep Learning: Neural Architecture Search Is Not the End Xuanyi Dong D. Kedziora Katarzyna Musial Bogdan Gabrys 25 26 0 16 Dec 2021
ISNAS-DIP: Image-Specific Neural Architecture Search for Deep Image Prior Metin Ersin Arican Ozgur Kara G. Bredell E. Konukoglu 25 17 0 27 Nov 2021
MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection Zhenhong Sun Ming Lin Xiuyu Sun Zhiyu Tan Hao Li Rong Jin 23 32 0 26 Nov 2021
ProxyBO: Accelerating Neural Architecture Search via Bayesian Optimization with Zero-cost Proxies Yu Shen Yang Li Jian Zheng Wentao Zhang Peng Yao Jixiang Li Sen Yang Ji Liu Cui Bin AI4CE 37 30 0 20 Oct 2021
Neural Architecture Search in operational context: a remote sensing case-study Anthony Cazasnoves Pierre-Antoine Ganaye Kévin Sanchis Tugdual Ceillier 27 0 0 15 Sep 2021
NASI: Label- and Data-agnostic Neural Architecture Search at Initialization Yao Shu Shaofeng Cai Zhongxiang Dai Beng Chin Ooi K. H. Low 19 43 0 02 Sep 2021
FLASH: Fast Neural Architecture Search with Hardware Optimization Guihong Li Sumit K. Mandal Ümit Y. Ogras R. Marculescu 27 20 0 01 Aug 2021