A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions

1 June 2020

Pengzhen Ren

Yun Xiao

Xiaojun Chang

Po-Yao (Bernie) Huang

Papers citing "A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions"

50 / 220 papers shown

Title
Task Difficulty Aware Parameter Allocation & Regularization for Lifelong Learning Wenjin Wang Yunqing Hu Qianglong Chen Yin Zhang CLL 29 13 0 11 Apr 2023
Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search Alexandre Heuillet A. Nasser Hichem Arioui Hedi Tabia AI4CE 22 11 0 11 Apr 2023
Are Neural Architecture Search Benchmarks Well Designed? A Deeper Look Into Operation Importance Vasco Lopes Bruno Degardin L. A. Alexandre 30 5 0 29 Mar 2023
Online Non-Destructive Moisture Content Estimation of Filter Media During Drying Using Artificial Neural Networks C. R. Wewer Alexandros Iosifidis 14 2 0 27 Mar 2023
Core-Periphery Principle Guided Redesign of Self-Attention in Transformers Xiao-Xing Yu Lu Zhang Haixing Dai Yanjun Lyu Lin Zhao Zihao Wu David Liu Tianming Liu Dajiang Zhu GNN 28 9 0 27 Mar 2023
Window-Based Early-Exit Cascades for Uncertainty Estimation: When Deep Ensembles are More Efficient than Single Models Guoxuan Xia C. Bouganis UQCV 50 12 0 14 Mar 2023
Deep Learning for Inertial Positioning: A Survey Changhao Chen Xianfei Pan 16 47 0 07 Mar 2023
Structured Pruning for Deep Convolutional Neural Networks: A survey Yang He Lingao Xiao 3DPC 28 116 0 01 Mar 2023
Full Stack Optimization of Transformer Inference: a Survey Sehoon Kim Coleman Hooper Thanakul Wattanawong Minwoo Kang Ruohan Yan ... Qijing Huang Kurt Keutzer Michael W. Mahoney Y. Shao A. Gholami MQ 28 100 0 27 Feb 2023
AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning Han Zhou Xingchen Wan Ivan Vulić Anna Korhonen 16 45 0 28 Jan 2023
Neural Architecture Search: Insights from 1000 Papers Colin White Mahmoud Safari R. Sukthanker Binxin Ru T. Elsken Arber Zela Debadeepta Dey Frank Hutter 3DV AI4CE 32 128 0 20 Jan 2023
Efficient Evaluation Methods for Neural Architecture Search: A Survey Xiangning Xie Xiaotian Song Zeqiong Lv Gary G. Yen Weiping Ding Y. Sun 24 12 0 14 Jan 2023
Source-Free Unsupervised Domain Adaptation: A Survey Yuqi Fang P. Yap W. Lin Hongtu Zhu Mingxia Liu 130 90 0 31 Dec 2022
Meta-Learning for Automated Selection of Anomaly Detectors for Semi-Supervised Datasets David Schubert Pritha Gupta Marcel Wever 14 2 0 24 Nov 2022
Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation Jiawei Du Yiding Jiang Vincent Y. F. Tan Joey Tianyi Zhou Haizhou Li DD 35 109 0 20 Nov 2022
RUBICON: A Framework for Designing Efficient Deep Learning-Based Genomic Basecallers Gagandeep Singh M. Alser K. Denolf Can Firtina Alireza Khodamoradi Meryem Banu Cavlak Henk Corporaal O. Mutlu 38 12 0 06 Nov 2022
$Λ$ -DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells Sajad Movahedi Melika Adabinejad Ayyoob Imani Arezou Keshavarz Mostafa Dehghani A. Shakery Babak Nadjar Araabi 21 17 0 14 Oct 2022
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities Brian Bartoldson B. Kailkhura Davis W. Blalock 29 47 0 13 Oct 2022
EC-NAS: Energy Consumption Aware Tabular Benchmarks for Neural Architecture Search Pedram Bakhtiarifard Christian Igel Raghavendra Selvan 19 6 0 12 Oct 2022
Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problems Lianghao Cao Thomas O'Leary-Roseberry Prashant K. Jha J. Oden Omar Ghattas 21 26 0 06 Oct 2022
POPNASv2: An Efficient Multi-Objective Neural Architecture Search Technique Andrea Falanti Eugenio Lomurno Stefano Samele Danilo Ardagna Matteo Matteucci 6 7 0 06 Oct 2022
Toward Edge-Efficient Dense Predictions with Synergistic Multi-Task Neural Architecture Search Thanh Vu Yan-Quan Zhou Chun-Yung Wen Yueqi Li Jan-Michael Frahm 32 4 0 04 Oct 2022
NasHD: Efficient ViT Architecture Performance Ranking using Hyperdimensional Computing Dongning Ma Pengfei Zhao Xun Jiao 22 0 0 23 Sep 2022
Neural Networks Reduction via Lumping Dalila Ressi Riccardo Romanello S. Rossi Carla Piazza 27 4 0 15 Sep 2022
Scene Graph Modification as Incremental Structure Expanding Xuming Hu Zhijiang Guo Yuwei Fu Lijie Wen Philip S. Yu 31 2 0 15 Sep 2022
Generalization Properties of NAS under Activation and Skip Connection Search Zhenyu Zhu Fanghui Liu Grigorios G. Chrysos V. Cevher AI4CE 13 14 0 15 Sep 2022
Survey on Evolutionary Deep Learning: Principles, Algorithms, Applications and Open Issues Nan Li Lianbo Ma Guo-Ding Yu Bing Xue Mengjie Zhang Yaochu Jin 22 70 0 23 Aug 2022
Neural Architecture Search as Multiobjective Optimization Benchmarks: Problem Formulation and Performance Assessment Zhichao Lu Ran Cheng Yaochu Jin Kay Chen Tan Kalyanmoy Deb 19 53 0 08 Aug 2022
HPO: We won't get fooled again Kalifou René Traoré Andrés Camero Xiao Xiang Zhu 16 0 0 04 Aug 2022
Auto Machine Learning for Medical Image Analysis by Unifying the Search on Data Augmentation and Neural Architecture Jianwei Zhang Dong Li Lituan Wang Lei Zhang 18 2 0 21 Jul 2022
Single Model Uncertainty Estimation via Stochastic Data Centering Jayaraman J. Thiagarajan Rushil Anirudh V. Narayanaswamy P. Bremer UQCV OOD 17 26 0 14 Jul 2022
DASS: Differentiable Architecture Search for Sparse neural networks H. Mousavi Mohammad Loni Mina Alibeigi Masoud Daneshtalab 31 9 0 14 Jul 2022
Architecture Augmentation for Performance Predictor Based on Graph Isomorphism Xiangning Xie Yuqiao Liu Yanan Sun Mengjie Zhang Kay Chen Tan GNN AI4CE 17 2 0 03 Jul 2022
Machine Learning for Microcontroller-Class Hardware: A Review Swapnil Sayan Saha S. Sandha Mani B. Srivastava 19 117 0 29 May 2022
Incremental Learning with Differentiable Architecture and Forgetting Search James Smith Zachary Seymour Han-Pang Chiu OOD CLL AI4CE 34 4 0 19 May 2022
A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities Daniel Cummings Anthony Sarah S. N. Sridhar Maciej Szankin J. P. Muñoz Sairam Sundaresan 28 8 0 19 May 2022
Warm-starting DARTS using meta-learning Matej Grobelnik Joaquin Vanschoren AI4CE 19 1 0 12 May 2022
Birds of A Feather Flock Together: Category-Divergence Guidance for Domain Adaptive Segmentation Bo Yuan Danpei Zhao Shuai Shao Zehuan Yuan Changhu Wang 57 14 0 05 Apr 2022
A Comprehensive Survey on Automated Machine Learning for Recommendations Bo Chen Xiangyu Zhao Yejing Wang Wenqi Fan Huifeng Guo Ruiming Tang AI4TS 18 6 0 04 Apr 2022
A Semi-Decoupled Approach to Fast and Optimal Hardware-Software Co-Design of Neural Accelerators Bingqian Lu Zheyu Yan Yiyu Shi Shaolei Ren 21 2 0 25 Mar 2022
An Intelligent End-to-End Neural Architecture Search Framework for Electricity Forecasting Model Development Jin Yang Guangxin Jiang Ying-Fan Huang Ying Chen AI4TS 22 0 0 25 Mar 2022
Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey Giorgos Armeniakos Georgios Zervakis Dimitrios Soudris J. Henkel 196 93 0 16 Mar 2022
Less is More: Proxy Datasets in NAS approaches Brian B. Moser Federico Raue Jörn Hees Andreas Dengel DD 6 6 0 14 Mar 2022
Towards Less Constrained Macro-Neural Architecture Search Vasco Lopes L. A. Alexandre 28 5 0 10 Mar 2022
Accelerating Neural Architecture Exploration Across Modalities Using Genetic Algorithms Daniel Cummings S. N. Sridhar Anthony Sarah Maciej Szankin AI4CE 25 0 0 25 Feb 2022
Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters Mingbao Lin Liujuan Cao Yu-xin Zhang Ling Shao Chia-Wen Lin Rongrong Ji 14 51 0 15 Feb 2022
Mold into a Graph: Efficient Bayesian Optimization over Mixed-Spaces Jaeyeon Ahn Taehyeon Kim Seyoung Yun 24 0 0 02 Feb 2022
FRAMED: An AutoML Approach for Structural Performance Prediction of Bicycle Frames Lyle Regenwetter Colin Weaver Faez Ahmed AI4CE 24 17 0 25 Jan 2022
DARTS without a Validation Set: Optimizing the Marginal Likelihood M. Fil Binxin Ru Clare Lyle Y. Gal 19 2 0 24 Dec 2021
Integrating Physics-Based Modeling with Machine Learning for Lithium-Ion Batteries H. Tu S. Moura Yebin Wang H. Fang 11 84 0 24 Dec 2021