Once-for-All: Train One Network and Specialize it for Efficient Deployment

26 August 2019

Chuang Gan

Song Han

Papers citing "Once-for-All: Train One Network and Specialize it for Efficient Deployment"

50 / 240 papers shown

Title
TIPS: Topologically Important Path Sampling for Anytime Neural Networks Guihong Li Kartikeya Bhardwaj Yuedong Yang R. Marculescu AAML 36 0 0 13 May 2023
Explainable Knowledge Distillation for On-device Chest X-Ray Classification C. Termritthikun Ayaz Umer Suwichaya Suwanwimolkul Feng Xia Ivan Lee 21 13 0 10 May 2023
Auto-CARD: Efficient and Robust Codec Avatar Driving for Real-time Mobile Telepresence Y. Fu Yuecheng Li Chenghui Li Jason M. Saragih Peizhao Zhang Xiaoliang Dai Yingyan Lin 3DH 44 2 0 24 Apr 2023
SSS3D: Fast Neural Architecture Search For Efficient Three-Dimensional Semantic Segmentation O. Therrien Marihan Amein Zhuoran Xiong W. Gross B. Meyer 3DPC 31 0 0 21 Apr 2023
Small-footprint slimmable networks for keyword spotting Zuhaib Akhtar Mohammad Omar Khursheed Dongsu Du Yuzong Liu 30 2 0 21 Apr 2023
Open-TransMind: A New Baseline and Benchmark for 1st Foundation Model Challenge of Intelligent Transportation Yifeng Shi Feng Lv Xinliang Wang Chunlong Xia Shaojie Li Shu-Zhen Yang Teng Xi Gang Zhang VLM 38 13 0 12 Apr 2023
MemeFier: Dual-stage Modality Fusion for Image Meme Classification C. Koutlis Manos Schinas Symeon Papadopoulos 11 12 0 06 Apr 2023
SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer Xuanyao Chen Zhijian Liu Haotian Tang Li Yi Hang Zhao Song Han ViT 23 46 0 30 Mar 2023
System-status-aware Adaptive Network for Online Streaming Video Understanding Lin Geng Foo Jia Gong Zhipeng Fan J. Liu AI4TS 32 15 0 28 Mar 2023
DetOFA: Efficient Training of Once-for-All Networks for Object Detection Using Path Filter Yuiko Sakuma Masato Ishii T. Narihira 30 2 0 23 Mar 2023
ERSAM: Neural Architecture Search For Energy-Efficient and Real-Time Social Ambiance Measurement Chaojian Li Wenwan Chen Jiayi Yuan Yingyan Lin Ashutosh Sabharwal 23 0 0 19 Mar 2023
DC-CCL: Device-Cloud Collaborative Controlled Learning for Large Vision Models Yucheng Ding Chaoyue Niu Fan Wu Shaojie Tang Chengfei Lyu Guihai Chen 20 6 0 18 Mar 2023
Efficient Transformer-based 3D Object Detection with Dynamic Token Halting Mao Ye Gregory P. Meyer Yuning Chai Qiang Liu 32 8 0 09 Mar 2023
Learning a Consensus Sub-Network with Polarization Regularization and One Pass Training Xiaoying Zhi Varun Babbar P. Sun Fran Silavong Ruibo Shi Sean J. Moran Sean Moran 39 1 0 17 Feb 2023
XploreNAS: Explore Adversarially Robust & Hardware-efficient Neural Architectures for Non-ideal Xbars Abhiroop Bhattacharjee Abhishek Moitra Priyadarshini Panda AAML 18 1 0 15 Feb 2023
Q-Diffusion: Quantizing Diffusion Models Xiuyu Li Yijia Liu Long Lian Hua Yang Zhen Dong Daniel Kang Shanghang Zhang Kurt Keutzer DiffM MQ 34 152 0 08 Feb 2023
Enhancing Once-For-All: A Study on Parallel Blocks, Skip Connections and Early Exits Simone Sarti Eugenio Lomurno Andrea Falanti Matteo Matteucci 21 3 0 03 Feb 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 36 60 0 26 Jan 2023
High-Throughput, High-Performance Deep Learning-Driven Light Guide Plate Surface Visual Quality Inspection Tailored for Real-World Manufacturing Environments Carol Xu M. Famouri Gautam Bathla M. Shafiee Alexander Wong 16 2 0 20 Dec 2022
A Study on the Intersection of GPU Utilization and CNN Inference J. Kosaian Amar Phanishayee 21 3 0 15 Dec 2022
Vertical Layering of Quantized Neural Networks for Heterogeneous Inference Hai Wu Ruifei He Hao Hao Tan Xiaojuan Qi Kaibin Huang MQ 21 2 0 10 Dec 2022
Vision Transformer Computation and Resilience for Dynamic Inference Kavya Sreedhar Jason Clemons Rangharajan Venkatesan S. Keckler M. Horowitz 24 2 0 06 Dec 2022
GENNAPE: Towards Generalized Neural Architecture Performance Estimators Keith G. Mills Fred X. Han Jialin Zhang Fabián A. Chudak A. Mamaghani Mohammad Salameh Wei Lu Shangling Jui Di Niu 19 4 0 30 Nov 2022
HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression Jiaqi Gu Ben Keller Jean Kossaifi Anima Anandkumar Brucek Khailany D. Pan ViT 30 8 0 30 Nov 2022
SteppingNet: A Stepping Neural Network with Incremental Accuracy Enhancement Wenhao Sun Grace Li Zhang Xunzhao Yin Cheng Zhuo Huaxi Gu Bing Li Ulf Schlichtmann 15 1 0 27 Nov 2022
GhostNetV2: Enhance Cheap Operation with Long-Range Attention Yehui Tang Kai Han Jianyuan Guo Chang Xu Chaoting Xu Yunhe Wang 18 270 0 23 Nov 2022
NAR-Former: Neural Architecture Representation Learning towards Holistic Attributes Prediction Yun Yi Haokui Zhang Wenze Hu Nannan Wang Xiaoyu Wang AI4TS AI4CE 29 8 0 15 Nov 2022
Multi-Objective Evolutionary for Object Detection Mobile Architectures Search Haichao Zhang Jiashi Li Xin Xia K. Hao Xuefeng Xiao 39 2 0 05 Nov 2022
Once-for-All Sequence Compression for Self-Supervised Speech Models Hsuan-Jui Chen Yen Meng Hung-yi Lee 20 4 0 04 Nov 2022
QuaLA-MiniLM: a Quantized Length Adaptive MiniLM Shira Guskin Moshe Wasserblat Chang Wang Haihao Shen MQ 11 2 0 31 Oct 2022
PredNAS: A Universal and Sample Efficient Neural Architecture Search Framework Liuchun Yuan Zehao Huang Naiyan Wang 29 0 0 26 Oct 2022
Efficiently Controlling Multiple Risks with Pareto Testing Bracha Laufer-Goldshtein Adam Fisch Regina Barzilay Tommi Jaakkola 36 16 0 14 Oct 2022
Pareto-aware Neural Architecture Generation for Diverse Computational Budgets Yong Guo Yaofo Chen Yin Zheng Qi Chen P. Zhao Jian Chen Junzhou Huang Mingkui Tan 28 5 0 14 Oct 2022
Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing Peng Ye Shengji Tang Baopu Li Tao Chen Wanli Ouyang 29 13 0 09 Oct 2022
Demystifying Map Space Exploration for NPUs Sheng-Chun Kao A. Parashar Po-An Tsai T. Krishna 35 11 0 07 Oct 2022
In-situ Model Downloading to Realize Versatile Edge AI in 6G Mobile Networks Kaibin Huang Hai Wu Zhiyan Liu Xiaojuan Qi 11 9 0 07 Oct 2022
Designing and Training of Lightweight Neural Networks on Edge Devices using Early Halting in Knowledge Distillation Rahul Mishra Hari Prabhat Gupta 27 8 0 30 Sep 2022
Slimmable Networks for Contrastive Self-supervised Learning Shuai Zhao Xiaohan Wang Linchao Zhu Yi Yang 27 1 0 30 Sep 2022
Towards Regression-Free Neural Networks for Diverse Compute Platforms Rahul Duggal Hao Zhou Shuo Yang Jun Fang Yuanjun Xiong Wei Xia UQCV 31 1 0 27 Sep 2022
Searching a High-Performance Feature Extractor for Text Recognition Network Hui Zhang Quanming Yao James T. Kwok X. Bai 28 7 0 27 Sep 2022
Tiered Pruning for Efficient Differentialble Inference-Aware Neural Architecture Search Slawomir Kierat Mateusz Sieniawski Denys Fridman Chendi Yu Szymon Migacz Pawel M. Morkisz A. Fit-Florea 3DPC 19 0 0 23 Sep 2022
EZNAS: Evolving Zero Cost Proxies For Neural Architecture Scoring Yash Akhauri J. P. Muñoz Nilesh Jain Ravi Iyer 46 13 0 15 Sep 2022
You Only Search Once: On Lightweight Differentiable Architecture Search for Resource-Constrained Embedded Platforms Xiangzhong Luo Di Liu Hao Kong Shuo Huai Hui Chen Weichen Liu 33 9 0 30 Aug 2022
Hardware-aware mobile building block evaluation for computer vision Maxim Bonnaerens Matthias Anton Freiberger Marian Verhelst J. Dambre 20 1 0 26 Aug 2022
SONAR: Joint Architecture and System Optimization Search Elias Jääsaari Michelle Ma Ameet Talwalkar Tianqi Chen 36 1 0 25 Aug 2022
DeepPicarMicro: Applying TinyML to Autonomous Cyber Physical Systems Michael Bechtel QiTao Weng H. Yun BDL 23 7 0 23 Aug 2022
SVD-NAS: Coupling Low-Rank Approximation and Neural Architecture Search Zhewen Yu C. Bouganis 22 4 0 22 Aug 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 43 3 0 22 Aug 2022
Accelerating Vision Transformer Training via a Patch Sampling Schedule Bradley McDanel C. Huynh ViT 25 1 0 19 Aug 2022
Surrogate-assisted Multi-objective Neural Architecture Search for Real-time Semantic Segmentation Zhichao Lu Ran Cheng Shihua Huang Haotong Zhang Changxiao Qiu Fan Yang SSeg 22 22 0 14 Aug 2022