ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients

26 January 2023

Papers citing "ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients"

42 / 42 papers shown

Title
L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision Transformers S. Casarin Sergio Escalera O. Lanz 22 0 0 12 May 2025
RBFleX-NAS: Training-Free Neural Architecture Search Using Radial Basis Function Kernel and Hyperparameter Detection Tomomasa Yamasaki Zhehui Wang Tao Luo Niangjun Chen Bo Wang 32 0 0 26 Mar 2025
Subnet-Aware Dynamic Supernet Training for Neural Architecture Search Jeimin Jeon Youngmin Oh J. Lee Donghyeon Baek Dohyung Kim Chanho Eom Bumsub Ham 41 0 0 13 Mar 2025
Variation Matters: from Mitigating to Embracing Zero-Shot NAS Ranking Function Variation P. Rumiantsev Mark Coates 45 0 0 27 Feb 2025
NEAR: A Training-Free Pre-Estimator of Machine Learning Model Performance Raphael T. Husistein Markus Reiher Marco Eckhoff 85 1 0 20 Feb 2025
FedTLU: Federated Learning with Targeted Layer Updates Jong-Ik Park Carlee Joe-Wong FedML 82 0 0 28 Jan 2025
No More Adam: Learning Rate Scaling at Initialization is All You Need Minghao Xu Lichuan Xiang Xu Cai Hongkai Wen 73 2 0 16 Dec 2024
HEP-NAS: Towards Efficient Few-shot Neural Architecture Search via Hierarchical Edge Partitioning J. Li Jiawen Zhang Feng Wang Lianbo Ma 69 0 0 14 Dec 2024
GreenMachine: Automatic Design of Zero-Cost Proxies for Energy-Efficient NAS Gabriel Cortes Nuno Lourenço Penousal Machado 59 0 0 22 Nov 2024
ActNAS : Generating Efficient YOLO Models using Activation NAS Sudhakar Sah Ravish Kumar Darshan C. Ganji Ehsan Saboori 18 0 0 11 Oct 2024
LPZero: Language Model Zero-cost Proxy Search from Zero Peijie Dong Lujun Li Xiang Liu Zhenheng Tang Xuebo Liu Qiang Wang Xiaowen Chu 31 2 0 07 Oct 2024
ADEPT-Z: Zero-Shot Automated Circuit Topology Search for Pareto-Optimal Photonic Tensor Cores Ziyang Jiang Pingchuan Ma Meng Zhang Rena Huang Jiaqi Gu 19 0 0 02 Oct 2024
FastTalker: Jointly Generating Speech and Conversational Gestures from Text Zixin Guo Jian Zhang 24 1 0 24 Sep 2024
Efficient Training of Large Vision Models via Advanced Automated Progressive Learning Changlin Li Jiawei Zhang Sihao Lin Zongxin Yang Junwei Liang Xiaodan Liang Xiaojun Chang VLM 16 0 0 06 Sep 2024
MONAS: Efficient Zero-Shot Neural Architecture Search for MCUs Ye Qiao Haocheng Xu Yifan Zhang Sitao Huang 33 0 0 26 Aug 2024
HyTAS: A Hyperspectral Image Transformer Architecture Search Benchmark and Analysis Fangqin Zhou Mert Kilickaya Joaquin Vanschoren Ran Piao 16 1 0 23 Jul 2024
Federated Learning with Flexible Architectures Jong-Ik Park Carlee Joe-Wong FedML 26 3 0 14 Jun 2024
Differentiable Model Scaling using Differentiable Topk Kai Liu Ruohui Wang Jianfei Gao Kai Chen MedIm VLM 25 1 0 12 May 2024
Graph is all you need? Lightweight data-agnostic neural architecture search without training Zhenhan Huang Tejaswini Pedapati Pin-Yu Chen Chunheng Jiang Jianxi Gao GNN 18 1 0 02 May 2024
TG-NAS: Leveraging Zero-Cost Proxies with Transformer and Graph Convolution Networks for Efficient Neural Architecture Search Ye Qiao Haocheng Xu Sitao Huang 19 0 0 30 Mar 2024
AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search Junghyup Lee Bumsub Ham 16 1 0 28 Mar 2024
Anytime Neural Architecture Search on Tabular Data Naili Xing Shaofeng Cai Zhaojing Luo Bengchin Ooi Jian Pei 24 1 0 15 Mar 2024
SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAS Yameng Peng Andy Song Haytham M. Fayek Victor Ciesielski Xiaojun Chang 24 4 0 07 Mar 2024
OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators Tianyi Chen Tianyu Ding Zhihui Zhu Zeyu Chen HsiangTao Wu Ilya Zharkov Luming Liang 11 3 0 15 Dec 2023
SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape Hua Zheng Kuang-Hung Liu Igor Fedorov Xin Zhang Wen-Yen Chen Wei Wen 25 1 0 22 Nov 2023
ZiCo-BC: A Bias Corrected Zero-Shot NAS for Vision Tasks Kartikeya Bhardwaj Hsin-Pai Cheng Sweta Priyadarshi Zhuojing Li 19 1 0 26 Sep 2023
YOLOBench: Benchmarking Efficient Object Detectors on Embedded Systems Ivan Lazarevich Matteo Grimaldi Ravi Kumar Saptarshi Mitra Shahrukh Khan Sudhakar Sah ObjD FedML ELM 25 10 0 26 Jul 2023
Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities Guihong Li Duc-Tuong Hoang Kartikeya Bhardwaj Ming Lin Zhangyang Wang R. Marculescu 25 10 0 05 Jul 2023
Automated Search-Space Generation Neural Architecture Search Tianyi Chen Luming Liang Tian Ding Ilya Zharkov AI4CE 11 1 0 25 May 2023
Learning Activation Functions for Sparse Neural Networks Mohammad Loni Aditya Mohan Mehdi Asadi Marius Lindauer 13 4 0 18 May 2023
TIPS: Topologically Important Path Sampling for Anytime Neural Networks Guihong Li Kartikeya Bhardwaj Yuedong Yang R. Marculescu AAML 21 0 0 13 May 2023
DCLP: Neural Architecture Predictor with Curriculum Contrastive Learning Shenghe Zheng Hongzhi Wang Tianyu Mu 20 1 0 25 Feb 2023
Efficient Evaluation Methods for Neural Architecture Search: A Survey Xiangning Xie Xiaotian Song Zeqiong Lv Gary G. Yen Weiping Ding Y. Sun 11 12 0 14 Jan 2023
Automated Dominative Subspace Mining for Efficient Neural Architecture Search Yaofo Chen Yong Guo Daihai Liao Fanbing Lv Hengjie Song James Tin-Yau Kwok Mingkui Tan 18 4 0 31 Oct 2022
On skip connections and normalisation layers in deep optimisation L. MacDonald Jack Valmadre Hemanth Saratchandran Simon Lucey ODL 11 1 0 10 Oct 2022
Unifying and Boosting Gradient-Based Training-Free Neural Architecture Search Yao Shu Zhongxiang Dai Zhaoxuan Wu K. H. Low AI4CE 39 26 0 24 Jan 2022
Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces Bert Moons Parham Noorzad Andrii Skliar G. Mariani Dushyant Mehta Chris Lott Tijmen Blankevoort 137 43 0 16 Dec 2020
The large learning rate phase of deep learning: the catapult mechanism Aitor Lewkowycz Yasaman Bahri Ethan Dyer Jascha Narain Sohl-Dickstein Guy Gur-Ari ODL 150 232 0 04 Mar 2020
Understanding and Robustifying Differentiable Architecture Search Arber Zela T. Elsken Tonmoy Saikia Yassine Marrakchi Thomas Brox Frank Hutter OOD AAML 66 365 0 20 Sep 2019
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,290 0 05 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,878 0 15 Sep 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu L. V. D. van der Maaten Kilian Q. Weinberger PINN 3DV 244 35,884 0 25 Aug 2016