Geometry-Aware Gradient Algorithms for Neural Architecture Search

Geometry-Aware Gradient Algorithms for Neural Architecture Search

16 April 2020

Maria-Florina Balcan

Ameet Talwalkar

Papers citing "Geometry-Aware Gradient Algorithms for Neural Architecture Search"

17 / 17 papers shown

Title
MoRe Fine-Tuning with 10x Fewer Parameters Wenxuan Tan Nicholas Roberts Tzu-Heng Huang Jitian Zhao John Cooper Samuel Guo Chengyu Duan Frederic Sala 29 0 0 30 Aug 2024
CSCO: Connectivity Search of Convolutional Operators Tunhou Zhang Shiyu Li Hsin-Pai Cheng Feng Yan Hai Helen Li Yiran Chen 34 0 0 26 Apr 2024
Balanced Mixture of SuperNets for Learning the CNN Pooling Architecture Mehraveh Javan Matthew Toews M. Pedersoli 31 1 0 21 Jun 2023
Robustifying DARTS by Eliminating Information Bypass Leakage via Explicit Sparse Regularization Jiuling Zhang Zhiming Ding AAML 21 3 0 12 Jun 2023
Rethink DARTS Search Space and Renovate a New Benchmark Jiuling Zhang Zhiming Ding 33 1 0 12 Jun 2023
Federated Hypergradient Descent A. K. Kan FedML 37 3 0 03 Nov 2022
AANG: Automating Auxiliary Learning Lucio Dery Paul Michel M. Khodak Graham Neubig Ameet Talwalkar 36 9 0 27 May 2022
Generalizing Few-Shot NAS with Gradient Matching Shou-Yong Hu Ruochen Wang Lanqing Hong Zhenguo Li Cho-Jui Hsieh Jiashi Feng 25 23 0 29 Mar 2022
Delve into the Performance Degradation of Differentiable Architecture Search Jiuling Zhang Zhiming Ding 33 1 0 28 Sep 2021
$L$^{2}$NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning$ L $^{2}$ NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning Keith G. Mills Fred X. Han Mohammad Salameh Seyed Saeed Changiz Rezaei Linglong Kong Wei Lu Shuo Lian Shangling Jui Di Niu 19 10 0 25 Sep 2021
Neural Architecture Search in operational context: a remote sensing case-study Anthony Cazasnoves Pierre-Antoine Ganaye Kévin Sanchis Tugdual Ceillier 27 0 0 15 Sep 2021
DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecture Kaichen Zhou Lanqing Hong Shuailiang Hu Fengwei Zhou Binxin Ru Jiashi Feng Zhenguo Li 54 10 0 13 Sep 2021
Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing M. Khodak Renbo Tu Tian Li Liam Li Maria-Florina Balcan Virginia Smith Ameet Talwalkar FedML 35 78 0 08 Jun 2021
Generalization Guarantees for Neural Architecture Search with Train-Validation Split Samet Oymak Mingchen Li Mahdi Soltanolkotabi AI4CE OOD 36 13 0 29 Apr 2021
Rethinking Neural Operations for Diverse Tasks Nicholas Roberts M. Khodak Tri Dao Liam Li Christopher Ré Ameet Talwalkar AI4CE 36 22 0 29 Mar 2021
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Arber Zela Julien N. Siems Frank Hutter 88 147 0 28 Jan 2020
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 110 716 0 13 Jun 2018