AlphaNet: Improved Training of Supernets with Alpha-Divergence

AlphaNet: Improved Training of Supernets with Alpha-Divergence

16 February 2021

Papers citing "AlphaNet: Improved Training of Supernets with Alpha-Divergence"

14 / 14 papers shown

Title
ABKD: Pursuing a Proper Allocation of the Probability Mass in Knowledge Distillation via $α$ - $β$ -Divergence Guanghui Wang Zhiyong Yang Z. Wang Shi Wang Qianqian Xu Q. Huang 28 0 0 07 May 2025
Transfer Learning with Pre-trained Conditional Generative Models Shinýa Yamaguchi Sekitoshi Kanai Atsutoshi Kumagai Daiki Chijiwa H. Kashima VLM CLL BDL DiffM 127 5 0 21 Feb 2025
NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models Yang Xu Huihong Shi Zhongfeng Wang 35 0 0 07 Sep 2024
P $^2$ -ViT: Power-of-Two Post-Training Quantization and Acceleration for Fully Quantized Vision Transformer Huihong Shi Xin Cheng Wendong Mao Zhongfeng Wang MQ 33 3 0 30 May 2024
Adaptive Depth Networks with Skippable Sub-Paths Woochul Kang 20 1 0 27 Dec 2023
LISSNAS: Locality-based Iterative Search Space Shrinkage for Neural Architecture Search Bhavna Gopal Arjun Sridhar Tunhou Zhang Yiran Chen 6 3 0 06 Jul 2023
ObfuNAS: A Neural Architecture Search-based DNN Obfuscation Approach Tong Zhou Shaolei Ren Xiaolin Xu AAML 14 13 0 17 Aug 2022
Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing? Keshigeyan Chandrasegaran Ngoc-Trung Tran Yunqing Zhao Ngai-man Cheung 75 41 0 29 Jun 2022
A Semi-Decoupled Approach to Fast and Optimal Hardware-Software Co-Design of Neural Accelerators Bingqian Lu Zheyu Yan Yiyu Shi Shaolei Ren 11 2 0 25 Mar 2022
FBNetV5: Neural Architecture Search for Multiple Tasks in One Run Bichen Wu Chaojian Li Hang Zhang Xiaoliang Dai Peizhao Zhang Matthew Yu Jialiang Wang Yingyan Lin Peter Vajda ViT 14 23 0 19 Nov 2021
UniNet: Unified Architecture Search with Convolution, Transformer, and MLP Jihao Liu Hongsheng Li Guanglu Song Xin Huang Yu Liu ViT 18 35 0 08 Oct 2021
Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces Bert Moons Parham Noorzad Andrii Skliar G. Mariani Dushyant Mehta Chris Lott Tijmen Blankevoort 121 43 0 16 Dec 2020
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 948 20,214 0 17 Apr 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,290 0 05 Nov 2016