Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces

16 December 2020

Papers citing "Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces"

7 / 7 papers shown

Title
Puzzle: Distillation-Based NAS for Inference-Optimized LLMs Akhiad Bercovich Tomer Ronen Talor Abramovich Nir Ailon Nave Assaf ... Ido Shahaf Oren Tropp Omer Ullman Argov Ran Zilberstein Ran El-Yaniv 75 1 0 28 Nov 2024
DONNAv2 -- Lightweight Neural Architecture Search for Vision tasks Sweta Priyadarshi Tianyu Jiang Hsin-Pai Cheng S. Rama Krishna Viswanath Ganapathy C. Patel 24 0 0 26 Sep 2023
ZiCo-BC: A Bias Corrected Zero-Shot NAS for Vision Tasks Kartikeya Bhardwaj Hsin-Pai Cheng Sweta Priyadarshi Zhuojing Li 19 1 0 26 Sep 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 16 59 0 26 Jan 2023
X-Distill: Improving Self-Supervised Monocular Depth via Cross-Task Distillation H. Cai J. Matai Shubhankar Borse Yizhe Zhang Amin Ansari Fatih Porikli FedML VLM MDE 39 21 0 24 Oct 2021
AlphaNet: Improved Training of Supernets with Alpha-Divergence Dilin Wang Chengyue Gong Meng Li Qiang Liu Vikas Chandra 144 44 0 16 Feb 2021
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,290 0 05 Nov 2016