DSNAS: Direct Neural Architecture Search without Parameter Retraining

21 February 2020

Papers citing "DSNAS: Direct Neural Architecture Search without Parameter Retraining"

50 / 89 papers shown

Title
Federated Neural Architecture Search with Model-Agnostic Meta Learning Xinyuan Huang Jiechao Gao FedML AI4CE 41 0 0 08 Apr 2025
SEKI: Self-Evolution and Knowledge Inspiration based Neural Architecture Search via Large Language Models Zicheng Cai Yaohua Tang Yutao Lai Hua Wang Z. Chen Hao Chen LLMAG VLM LRM 45 0 0 27 Feb 2025
GAIS: A Novel Approach to Instance Selection with Graph Attention Networks Zahiriddin Rustamov Ayham Zaitouny Rafat Damseh Nazar Zaki 30 0 0 26 Dec 2024
OStr-DARTS: Differentiable Neural Architecture Search based on Operation Strength Le Yang Ziwei Zheng Yizeng Han Shiji Song Gao Huang Fan Li 21 1 0 22 Sep 2024
Fair Differentiable Neural Network Architecture Search for Long-Tailed Data with Self-Supervised Learning Jiaming Yan 53 0 0 19 Jun 2024
ApproxDARTS: Differentiable Neural Architecture Search with Approximate Multipliers Michal Pinos Lukás Sekanina Vojtěch Mrázek MQ 24 1 0 08 Apr 2024
LeMo-NADe: Multi-Parameter Neural Architecture Discovery with LLMs Md Hafizur Rahman Prabuddha Chakraborty 22 4 0 28 Feb 2024
Efficient Architecture Search via Bi-level Data Pruning Chongjun Tu Peng Ye Weihao Lin Hancheng Ye Chong Yu Tao Chen Baopu Li Wanli Ouyang 40 2 0 21 Dec 2023
IS-DARTS: Stabilizing DARTS through Precise Measurement on Candidate Importance Hongyi He Longjun Liu Haonan Zhang Nanning Zheng 25 8 0 19 Dec 2023
Weight-Entanglement Meets Gradient-Based Neural Architecture Search R. Sukthanker Arjun Krishnakumar Mahmoud Safari Frank Hutter 37 3 0 16 Dec 2023
MetaMix: Meta-state Precision Searcher for Mixed-precision Activation Quantization Han-Byul Kim Joo Hyung Lee Sungjoo Yoo Hong-Seok Kim MQ 24 3 0 12 Nov 2023
MathNAS: If Blocks Have a Role in Mathematical Architecture Design Qinsi Wang Jinghan Ke Zhi Liang Sihai Zhang 23 0 0 08 Nov 2023
DBsurf: A Discrepancy Based Method for Discrete Stochastic Gradient Estimation Pau Mulet Arabí Alec Flowers Lukas Mauch Fabien Cardinaux BDL 24 0 0 07 Sep 2023
Shrink-Perturb Improves Architecture Mixing during Population Based Training for Neural Architecture Search A. Chebykin A. Dushatskiy T. Alderliesten Peter A. N. Bosman 31 0 0 28 Jul 2023
ShiftNAS: Improving One-shot NAS via Probability Shift Mingyang Zhang Xinyi Yu Haodong Zhao Linlin Ou 27 5 0 17 Jul 2023
Hyper-parameter Adaptation of Conformer ASR Systems for Elderly and Dysarthric Speech Recognition Tianzi Wang Shoukang Hu Jiajun Deng Zengrui Jin Mengzhe Geng Yi Wang Helen M. Meng Xunying Liu 20 5 0 27 Jun 2023
Artificial intelligence to advance Earth observation: a perspective D. Tuia Konrad Schindler Begum Demir Gustau Camps-Valls Xiao Xiang Zhu ... Mihai Datcu Jorge-Arnulfo Quiané-Ruiz Volker Markl Bertrand Le Saux Rochelle Schneider 31 10 0 15 May 2023
Can GPT-4 Perform Neural Architecture Search? Mingkai Zheng Xiu Su Shan You Fei Wang Chao Qian Chang Xu Samuel Albanie ELM 39 59 0 21 Apr 2023
Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search Alexandre Heuillet A. Nasser Hichem Arioui Hedi Tabia AI4CE 22 11 0 11 Apr 2023
Improving Differentiable Architecture Search via Self-Distillation Xunyu Zhu Jian Li Yong Liu Weiping Wang 19 7 0 11 Feb 2023
RD-NAS: Enhancing One-shot Supernet Ranking Ability via Ranking Distillation from Zero-cost Proxies Peijie Dong Xin-Yi Niu Lujun Li Zhiliang Tian Xiaodong Wang Zimian Wei H. Pan Dongsheng Li 74 15 0 24 Jan 2023
Neural Architecture Search: Insights from 1000 Papers Colin White Mahmoud Safari R. Sukthanker Binxin Ru T. Elsken Arber Zela Debadeepta Dey Frank Hutter 3DV AI4CE 34 130 0 20 Jan 2023
$β$ -DARTS++: Bi-level Regularization for Proxy-robust Differentiable Architecture Search Peng Ye Tong He Baopu Li Tao Chen Lei Bai Wanli Ouyang OOD 24 7 0 16 Jan 2023
NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension Xin He Jiangchao Yao Yuxin Wang Zhenheng Tang Ka Chu Cheung Simon See Bo Han X. Chu 19 9 0 23 Nov 2022
$α$ DARTS Once More: Enhancing Differentiable Architecture Search by Masked Image Modeling Bicheng Guo Shuxuan Guo Miaojing Shi Peng Cheng Shibo He Jiming Chen Kaicheng Yu 11 2 0 18 Nov 2022
Automated Dominative Subspace Mining for Efficient Neural Architecture Search Yaofo Chen Yong Guo Daihai Liao Fanbing Lv Hengjie Song James Tin-Yau Kwok Mingkui Tan 31 4 0 31 Oct 2022
FAQS: Communication-efficient Federate DNN Architecture and Quantization Co-Search for personalized Hardware-aware Preferences Hongjiang Chen Yang Wang Leibo Liu Shaojun Wei Shouyi Yin FedML MQ 14 0 0 16 Oct 2022
$Λ$ -DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells Sajad Movahedi Melika Adabinejad Ayyoob Imani Arezou Keshavarz Mostafa Dehghani A. Shakery Babak Nadjar Araabi 23 17 0 14 Oct 2022
EZNAS: Evolving Zero Cost Proxies For Neural Architecture Scoring Yash Akhauri J. P. Muñoz Nilesh Jain Ravi Iyer 46 13 0 15 Sep 2022
Sequential Cross Attention Based Multi-task Learning Sunkyung Kim Hyesong Choi Dongbo Min 24 5 0 06 Sep 2022
Bayesian Neural Network Language Modeling for Speech Recognition Boyang Xue Shoukang Hu Junhao Xu Mengzhe Geng Xunying Liu Helen M. Meng UQCV BDL 31 14 0 28 Aug 2022
Towards Green ASR: Lossless 4-bit Quantization of a Hybrid TDNN System on the 300-hr Switchboard Corpus Junhao Xu Shoukang Hu Xunying Liu Helen M. Meng MQ 12 5 0 23 Jun 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks Y. Fu Haichuan Yang Jiayi Yuan Meng Li Cheng Wan Raghuraman Krishnamoorthi Vikas Chandra Yingyan Lin 28 18 0 02 Jun 2022
Does Interference Exist When Training a Once-For-All Network? Jordan Shipard Arnold Wiliem Clinton Fookes 16 0 0 20 Apr 2022
Efficient Re-parameterization Operations Search for Easy-to-Deploy Network Based on Directional Evolutionary Strategy Xinyi Yu Xiaowei Wang Jintao Rong Mingyang Zhang Linlin Ou 23 1 0 13 Apr 2022
Generalizing Few-Shot NAS with Gradient Matching Shou-Yong Hu Ruochen Wang Lanqing Hong Zhenguo Li Cho-Jui Hsieh Jiashi Feng 23 23 0 29 Mar 2022
$β$ -DARTS: Beta-Decay Regularization for Differentiable Architecture Search Peng Ye Baopu Li Yikang Li Tao Chen Jiayuan Fan Wanli Ouyang 10 101 0 03 Mar 2022
Neural Architecture Search for Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Priyadarshini Panda 18 88 0 23 Jan 2022
Recent Progress in the CUHK Dysarthric Speech Recognition System Shansong Liu Mengzhe Geng Shoukang Hu Xurong Xie Mingyu Cui Jianwei Yu Xunying Liu H. Meng 9 58 0 15 Jan 2022
UDC: Unified DNAS for Compressible TinyML Models Igor Fedorov Ramon Matas Hokchhay Tann Chu Zhou Matthew Mattina P. Whatmough AI4CE 21 13 0 15 Jan 2022
Neural Architecture Search For LF-MMI Trained Time Delay Neural Networks Shou-Yong Hu Xurong Xie Mingyu Cui Jiajun Deng Shansong Liu Jianwei Yu Mengzhe Geng Xunying Liu H. Meng 26 26 0 08 Jan 2022
Automatic Mixed-Precision Quantization Search of BERT Changsheng Zhao Ting Hua Yilin Shen Qian Lou Hongxia Jin MQ 17 19 0 30 Dec 2021
SPIDER: Searching Personalized Neural Architecture for Federated Learning Erum Mushtaq Chaoyang He Jie Ding A. Avestimehr FedML 16 20 0 27 Dec 2021
Learning from Mistakes based on Class Weighting with Application to Neural Architecture Search Jay P. Gala P. Xie 29 1 0 01 Dec 2021
Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition Junhao Xu Jianwei Yu Shoukang Hu Xunying Liu H. Meng MQ 17 13 0 29 Nov 2021
Mixed Precision DNN Qunatization for Overlapped Speech Separation and Recognition Junhao Xu Jianwei Yu Xunying Liu H. Meng MQ 20 10 0 29 Nov 2021
Searching for TrioNet: Combining Convolution with Local and Global Self-Attention Huaijin Pi Huiyu Wang Yingwei Li Zizhang Li Alan Yuille ViT 21 3 0 15 Nov 2021
Linear, or Non-Linear, That is the Question! Taeyong Kong Taeri Kim Jinsung Jeon Jeongwhan Choi Yeon-Chang Lee Noseong Park Sang-Wook Kim 38 57 0 14 Nov 2021
Learning from Mistakes -- A Framework for Neural Architecture Search Bhanu Garg Li Lyna Zhang Pradyumna Sridhara Ramtin Hosseini Eric P. Xing P. Xie 17 9 0 11 Nov 2021
RT-RCG: Neural Network and Accelerator Search Towards Effective and Real-time ECG Reconstruction from Intracardiac Electrograms Yongan Zhang Anton Banta Yonggan Fu M. John A. Post M. Razavi Joseph R. Cavallaro B. Aazhang Yingyan Lin 18 4 0 04 Nov 2021