Deeper Insights into Weight Sharing in Neural Architecture Search

6 January 2020

Yujing Wang

Papers citing "Deeper Insights into Weight Sharing in Neural Architecture Search"

32 / 32 papers shown

Title
Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuning Haobo Song Hao Zhao Soumajit Majumder Tao Lin 114 7 0 01 Jul 2024
Revisiting Implicit Models: Sparsity Trade-offs Capability in Weight-tied Model for Vision Tasks Haobo Song Soumajit Majumder Tao Lin VLM 168 0 0 16 Jul 2023
Robustifying DARTS by Eliminating Information Bypass Leakage via Explicit Sparse RegularizationIndustrial Conference on Data Mining (IDM), 2021 Jiuling Zhang Zhiming Ding AAML 135 4 0 12 Jun 2023
Rethink DARTS Search Space and Renovate a New BenchmarkInternational Conference on Machine Learning (ICML), 2023 Jiuling Zhang Zhiming Ding 114 3 0 12 Jun 2023
Neural Architecture Search: Insights from 1000 Papers Colin White Mahmoud Safari R. Sukthanker Binxin Ru T. Elsken Arber Zela Debadeepta Dey Katharina Eggensperger 3DV AI4CE 225 172 0 20 Jan 2023
HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural NetworksAAAI Conference on Artificial Intelligence (AAAI), 2023 Jinqi Xiao Chengming Zhang Yu Gong Miao Yin Yang Sui Lizhi Xiang Dingwen Tao Bo Yuan 166 26 0 20 Jan 2023
Improve Ranking Correlation of Super-net through Training Scheme from One-shot NAS to Few-shot NAS Jia-Wen Liu Kai Zhang Weitai Hu Qing Yang 126 2 0 13 Jun 2022
Automatic Relation-aware Graph Network ProliferationComputer Vision and Pattern Recognition (CVPR), 2022 Shaofei Cai Liang Li Xinzhe Han Jiebo Luo Zhengjun Zha Qingming Huang GNN 97 8 0 31 May 2022
Generalizing Few-Shot NAS with Gradient MatchingInternational Conference on Learning Representations (ICLR), 2022 Shou-Yong Hu Ruochen Wang Lanqing Hong Zhenguo Li Cho-Jui Hsieh Jiashi Feng 141 26 0 29 Mar 2022
Neural Architecture Search for Dense Prediction Tasks in Computer VisionInternational Journal of Computer Vision (IJCV), 2022 T. Elsken Arber Zela J. H. Metzen B. Staffler Thomas Brox Abhinav Valada Katharina Eggensperger OOD 128 22 0 15 Feb 2022
AutoHEnsGNN: Winning Solution to AutoGraph Challenge for KDD Cup 2020 Jin Xu Mingjian Chen Jianqiang Huang Xingyuan Tang Ke Hu Jian Li Jia Cheng Jun Lei 99 2 0 25 Nov 2021
NAS-Bench-x11 and the Power of Learning Curves Shen Yan Colin White Yash Savani Katharina Eggensperger 131 31 0 05 Nov 2021
Speeding up Deep Model Training by Sharing Weights and Then Unsharing Shuo Yang Le Hou Xiaodan Song Qiang Liu Denny Zhou 225 9 0 08 Oct 2021
Delve into the Performance Degradation of Differentiable Architecture Search Jiuling Zhang Zhiming Ding 90 1 0 28 Sep 2021
Analyzing and Mitigating Interference in Neural Architecture SearchInternational Conference on Machine Learning (ICML), 2021 Jin Xu Xu Tan Kaitao Song Renqian Luo Yichong Leng Tao Qin Tie-Yan Liu Jian Li MoMe 148 30 0 29 Aug 2021
RANK-NOSH: Efficient Predictor-Based Architecture Search via Non-Uniform Successive Halving Ruochen Wang Xiangning Chen Minhao Cheng Xiaocheng Tang Cho-Jui Hsieh 192 13 0 18 Aug 2021
Learning to Rank Ace Neural Architectures via Normalized Discounted Cumulative Gain Yuge Zhang Quan Zhang Li Zhang Yaming Yang Chenqian Yan Xiaotian Gao Yuqing Yang 188 1 0 06 Aug 2021
Initialization and Regularization of Factorized Neural LayersInternational Conference on Learning Representations (ICLR), 2021 M. Khodak Neil A. Tenenholtz Lester W. Mackey Nicolò Fusi 254 64 0 03 May 2021
Conditional super-network weights Kevin Laube A. Zell 107 0 0 23 Apr 2021
QuickLoc: Adaptive Deep-Learning for Fast Indoor Localization with Mobile Devices Saideep Tiku Prathmesh Kale S. Pasricha HAI 63 20 0 15 Apr 2021
How Powerful are Performance Predictors in Neural Architecture Search?Neural Information Processing Systems (NeurIPS), 2021 Colin White Arber Zela Binxin Ru Yang Liu Katharina Eggensperger 135 145 0 02 Apr 2021
AutoSpace: Neural Architecture Search with Less Human InterferenceIEEE International Conference on Computer Vision (ICCV), 2021 Daquan Zhou Xiaojie Jin Xiaochen Lian Linjie Yang Yujing Xue Qibin Hou Jiashi Feng 91 10 0 22 Mar 2021
How Does Supernet Help in Neural Architecture Search? Yuge Zhang Quanlu Zhang Yaming Yang 144 10 0 16 Oct 2020
Disentangling Neural Architectures and Weights: A Case Study in Supervised Classification Nicolo Colombo Yang Gao 95 2 0 11 Sep 2020
A Novel Training Protocol for Performance Predictors of Evolutionary Neural Architecture Search AlgorithmsIEEE Transactions on Evolutionary Computation (TEVC), 2020 Yizhou Sun Xian Sun Yuhan Fang Gary G. Yen 149 46 0 30 Aug 2020
Evaluating Efficient Performance Estimators of Neural ArchitecturesNeural Information Processing Systems (NeurIPS), 2020 Xuefei Ning Changcheng Tang Wenshuo Li Zixuan Zhou Shuang Liang Huazhong Yang Yu Wang 377 85 0 07 Aug 2020
Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap Lingxi Xie Xin Chen Kaifeng Bi Longhui Wei Yuhui Xu ... Lanfei Wang Anxiang Xiao Jianlong Chang Xiaopeng Zhang Qi Tian ViT 211 116 0 04 Aug 2020
Powering One-shot Topological NAS with Stabilized Share-parameter Proxy Ronghao Guo Chen Lin Chuming Li Keyu Tian Ming Sun Lu Sheng Junjie Yan BDL 123 17 0 21 May 2020
Angle-based Search Space Shrinking for Neural Architecture SearchEuropean Conference on Computer Vision (ECCV), 2020 Yiming Hu Yuding Liang Zichao Guo Ruosi Wan Xinming Zhang Yichen Wei Qingyi Gu Jian Sun 143 67 0 28 Apr 2020
Geometry-Aware Gradient Algorithms for Neural Architecture SearchInternational Conference on Learning Representations (ICLR), 2020 Liam Li M. Khodak Maria-Florina Balcan Ameet Talwalkar 207 70 0 16 Apr 2020
To Share or Not To Share: A Comprehensive Appraisal of Weight-Sharing Aloïs Pourchot Alexis Ducarouge Olivier Sigaud 122 22 0 11 Feb 2020
When NAS Meets Robustness: In Search of Robust Architectures against Adversarial AttacksComputer Vision and Pattern Recognition (CVPR), 2019 Minghao Guo Yuzhe Yang Rui Xu Ziwei Liu Dahua Lin AAML OOD 269 164 0 25 Nov 2019