BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models

24 March 2020

Pieter-Jan Kindermans

Mingxing Tan

Thomas Huang

Papers citing "BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models"

50 / 54 papers shown

Title
EfficientLLM: Scalable Pruning-Aware Pretraining for Architecture-Agnostic Edge Language Models Xingrun Xing Zheng Liu Shitao Xiao Boyan Gao Yiming Liang Wanpeng Zhang Haokun Lin Guoqi Li Jiajun Zhang LRM 61 1 0 10 Feb 2025
NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models Yang Xu Huihong Shi Zhongfeng Wang 37 0 0 07 Sep 2024
DεpS: Delayed ε-Shrinking for Faster Once-For-All Training Aditya Annavajjala Alind Khare Animesh Agrawal Igor Fedorov Hugo Latapie Myungjin Lee Alexey Tumanov CLL 37 0 0 08 Jul 2024
MatchNAS: Optimizing Edge AI in Sparse-Label Data Contexts via Automating Deep Neural Network Porting for Mobile Deployment Hongtao Huang Xiaojun Chang Wen Hu Lina Yao 30 0 0 21 Feb 2024
Perception-Distortion Balanced Super-Resolution: A Multi-Objective Optimization Perspective Lingchen Sun Jiejing Liang Shuai Liu Hongwei Yong Lei Zhang 25 6 0 24 Dec 2023
Evolutionary Neural Architecture Search for Transformer in Knowledge Tracing Shangshang Yang Xiaoshan Yu Ye Tian Xueming Yan Haiping Ma Xingyi Zhang ViT KELM AI4Ed 16 2 0 02 Oct 2023
UGC: Unified GAN Compression for Efficient Image-to-Image Translation Yuxi Ren Jie Wu Peng Zhang Manlin Zhang Xuefeng Xiao Qian He Rui Wang Min Zheng Xin Pan 24 2 0 17 Sep 2023
Rethink DARTS Search Space and Renovate a New Benchmark Jiuling Zhang Zhiming Ding 33 1 0 12 Jun 2023
MBQuant: A Novel Multi-Branch Topology Method for Arbitrary Bit-width Network Quantization Yunshan Zhong Yuyao Zhou Fei Chao Rongrong Ji MQ 26 1 0 14 May 2023
Auto-CARD: Efficient and Robust Codec Avatar Driving for Real-time Mobile Telepresence Y. Fu Yuecheng Li Chenghui Li Jason M. Saragih Peizhao Zhang Xiaoliang Dai Yingyan Lin 3DH 37 2 0 24 Apr 2023
DetOFA: Efficient Training of Once-for-All Networks for Object Detection Using Path Filter Yuiko Sakuma Masato Ishii T. Narihira 28 2 0 23 Mar 2023
ERSAM: Neural Architecture Search For Energy-Efficient and Real-Time Social Ambiance Measurement Chaojian Li Wenwan Chen Jiayi Yuan Yingyan Lin Ashutosh Sabharwal 23 0 0 19 Mar 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 36 60 0 26 Jan 2023
OVO: One-shot Vision Transformer Search with Online distillation Zimian Wei H. Pan Xin-Yi Niu Dongsheng Li ViT 29 1 0 28 Dec 2022
PredNAS: A Universal and Sample Efficient Neural Architecture Search Framework Liuchun Yuan Zehao Huang Naiyan Wang 29 0 0 26 Oct 2022
NASA: Neural Architecture Search and Acceleration for Hardware Inspired Hybrid Networks Huihong Shi Haoran You Yang Katie Zhao Zhongfeng Wang Yingyan Lin 56 7 0 24 Oct 2022
Pareto-aware Neural Architecture Generation for Diverse Computational Budgets Yong Guo Yaofo Chen Yin Zheng Qi Chen P. Zhao Jian Chen Junzhou Huang Mingkui Tan 28 5 0 14 Oct 2022
Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing Peng Ye Shengji Tang Baopu Li Tao Chen Wanli Ouyang 29 13 0 09 Oct 2022
Slimmable Networks for Contrastive Self-supervised Learning Shuai Zhao Xiaohan Wang Linchao Zhu Yi Yang 22 1 0 30 Sep 2022
Towards Regression-Free Neural Networks for Diverse Compute Platforms Rahul Duggal Hao Zhou Shuo Yang Jun Fang Yuanjun Xiong Wei Xia UQCV 31 1 0 27 Sep 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 43 3 0 22 Aug 2022
Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing? Keshigeyan Chandrasegaran Ngoc-Trung Tran Yunqing Zhao Ngai-man Cheung 83 41 0 29 Jun 2022
When NAS Meets Trees: An Efficient Algorithm for Neural Architecture Search Guocheng Qian Xuanyang Zhang G. Li Chen Zhao Yukang Chen X. Zhang Bernard Ghanem Jian-jun Sun 37 4 0 11 Apr 2022
SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems Xin Dong B. D. Salvo Meng Li Chiao Liu Zhongnan Qu H. T. Kung Ziyun Li 3DGS 21 20 0 10 Apr 2022
SepViT: Separable Vision Transformer Wei Li Xing Wang Xin Xia Jie Wu Jiashi Li Xuefeng Xiao Min Zheng Shiping Wen ViT 26 39 0 29 Mar 2022
Generalizing Few-Shot NAS with Gradient Matching Shou-Yong Hu Ruochen Wang Lanqing Hong Zhenguo Li Cho-Jui Hsieh Jiashi Feng 23 23 0 29 Mar 2022
Automated Progressive Learning for Efficient Training of Vision Transformers Changlin Li Bohan Zhuang Guangrun Wang Xiaodan Liang Xiaojun Chang Yi Yang 23 46 0 28 Mar 2022
ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Coding Dailan He Zi Yang Weikun Peng Rui Ma Hongwei Qin Yan Wang 26 317 0 21 Mar 2022
Enabling NAS with Automated Super-Network Generation J. P. Muñoz N. Lyalyushkin Yash Akhauri A. Senina Alexander Kozlov Nilesh Jain 14 17 0 20 Dec 2021
Automated Deep Learning: Neural Architecture Search Is Not the End Xuanyi Dong D. Kedziora Katarzyna Musial Bogdan Gabrys 25 26 0 16 Dec 2021
Auto-X3D: Ultra-Efficient Video Understanding via Finer-Grained Neural Architecture Search Yifan Jiang Xinyu Gong Junru Wu Humphrey Shi Zhicheng Yan Zhangyang Wang VGen 47 1 0 09 Dec 2021
FBNetV5: Neural Architecture Search for Multiple Tasks in One Run Bichen Wu Chaojian Li Hang Zhang Xiaoliang Dai Peizhao Zhang Matthew Yu Jialiang Wang Yingyan Lin Peter Vajda ViT 27 23 0 19 Nov 2021
Searching for TrioNet: Combining Convolution with Local and Global Self-Attention Huaijin Pi Huiyu Wang Yingwei Li Zizhang Li Alan Yuille ViT 21 3 0 15 Nov 2021
Prioritized Subnet Sampling for Resource-Adaptive Supernet Training Bohong Chen Mingbao Lin Rongrong Ji Liujuan Cao 19 2 0 12 Sep 2021
FLASH: Fast Neural Architecture Search with Hardware Optimization Guihong Li Sumit K. Mandal Ümit Y. Ogras R. Marculescu 25 20 0 01 Aug 2021
AutoFormer: Searching Transformers for Visual Recognition Minghao Chen Houwen Peng Jianlong Fu Haibin Ling ViT 36 259 0 01 Jul 2021
GAIA: A Transfer Learning System of Object Detection that Fits Your Needs Xingyuan Bu Junran Peng Junjie Yan T. Tan Zhaoxiang Zhang ObjD VLM 28 53 0 21 Jun 2021
HELP: Hardware-Adaptive Efficient Latency Prediction for NAS via Meta-Learning Hayeon Lee Sewoong Lee Song Chong S. Hwang 13 26 0 16 Jun 2021
Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators Yonggan Fu Yongan Zhang Yang Zhang David D. Cox Yingyan Lin MQ 50 17 0 11 Jun 2021
MutualNet: Adaptive ConvNet via Mutual Learning from Different Model Configurations Taojiannan Yang Sijie Zhu Matías Mendieta Pu Wang Ravikumar Balakrishnan Minwoo Lee T. Han M. Shah C. L. P. Chen 3DH OOD 28 22 0 14 May 2021
CompOFA: Compound Once-For-All Networks for Faster Multi-Platform Deployment Manas Sahni S. Varshini Alind Khare Alexey Tumanov 15 31 0 26 Apr 2021
Scaling Local Self-Attention for Parameter Efficient Visual Backbones Ashish Vaswani Prajit Ramachandran A. Srinivas Niki Parmar Blake A. Hechtman Jonathon Shlens 16 395 0 23 Mar 2021
Teachers Do More Than Teach: Compressing Image-to-Image Models Qing Jin Jian Ren Oliver J. Woodford Jiazhuo Wang Geng Yuan Yanzhi Wang Sergey Tulyakov 31 54 0 05 Mar 2021
AlphaNet: Improved Training of Supernets with Alpha-Divergence Dilin Wang Chengyue Gong Meng Li Qiang Liu Vikas Chandra 149 44 0 16 Feb 2021
FP-NAS: Fast Probabilistic Neural Architecture Search Zhicheng Yan Xiaoliang Dai Peizhao Zhang Yuandong Tian Bichen Wu Matt Feiszli 19 23 0 22 Nov 2020
Once Quantization-Aware Training: High Performance Extremely Low-bit Architecture Search Mingzhu Shen Feng Liang Ruihao Gong Yuhang Li Chuming Li Chen Lin F. Yu Junjie Yan Wanli Ouyang MQ 25 36 0 09 Oct 2020
Cyclic Differentiable Architecture Search Hongyuan Yu Houwen Peng Yan Huang Jianlong Fu Hao Du Liang Wang Haibin Ling 3DPC 25 48 0 18 Jun 2020
AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System Pengyu Zhao Kecheng Xiao Yuanxing Zhang Kaigui Bian Wei Yan 16 16 0 10 Jun 2020
MixPath: A Unified Approach for One-shot Neural Architecture Search Xiangxiang Chu Shun Lu Xudong Li Bo-Wen Zhang 21 21 0 16 Jan 2020
AtomNAS: Fine-Grained End-to-End Neural Architecture Search Jieru Mei Yingwei Li Xiaochen Lian Xiaojie Jin Linjie Yang Alan Yuille Jianchao Yang 14 107 0 20 Dec 2019