Multi-Task Zipping via Layer-wise Neuron Sharing

v1v2 (latest)

Multi-Task Zipping via Layer-wise Neuron Sharing

24 May 2018

ArXiv (abs)PDF HTML

Papers citing "Multi-Task Zipping via Layer-wise Neuron Sharing"

19 / 19 papers shown

Title
Smooth Model Compression without Fine-Tuning Christina Runkel Natacha Kuete Meli Jovita Lukasik A. Biguri Carola-Bibiane Schönlieb Michael Moeller 113 0 0 30 May 2025
Forget the Data and Fine-Tuning! Just Fold the Network to Compress Dong Wang Haris Šikić Lothar Thiele O. Saukh 218 3 0 14 Feb 2025
PLeaS -- Merging Models with Permutations and Least Squares Anshul Nasery J. Hayase Pang Wei Koh Sewoong Oh MoMe 186 6 0 02 Jul 2024
SCOPE: Stochastic Cartographic Occupancy Prediction Engine for Uncertainty-Aware Dynamic Navigation Zhanteng Xie P. Dames 239 2 0 28 Jun 2024
Robot Fleet Learning via Policy Merging Lirui Wang Kaiqing Zhang Allan Zhou Max Simchowitz Russ Tedrake 204 5 0 02 Oct 2023
RT-LM: Uncertainty-Aware Resource Management for Real-Time Inference of Language Models Yufei Li Zexin Li Wei Yang Cong Liu 97 14 0 12 Sep 2023
Computation-efficient Deep Learning for Computer Vision: A Survey Yulin Wang Yizeng Han Chaofei Wang Shiji Song Qi Tian Gao Huang VLM 186 26 0 27 Aug 2023
Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation Chuanguang Yang Xinqiang Yu Zhulin An Yongjun Xu VLM OffRL 360 29 0 19 Jun 2023
REPAIR: REnormalizing Permuted Activations for Interpolation Repair Keller Jordan Hanie Sedghi O. Saukh R. Entezari Behnam Neyshabur MoMe 274 107 0 15 Nov 2022
DiSparse: Disentangled Sparsification for Multitask Model Compression Xing Sun Ali Hassani Zhangyang Wang Gao Huang Humphrey Shi 152 21 0 09 Jun 2022
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 216 252 0 12 Oct 2021
Collaborative Intelligence: Challenges and Opportunities Ivan V. Bajić Weisi Lin Yonghong Tian 67 54 0 13 Feb 2021
A Survey on Deep Neural Network Compression: Challenges, Overview, and Solutions Rahul Mishra Hari Prabhat Gupta Tanima Dutta 92 96 0 05 Oct 2020
Passive Batch Injection Training Technique: Boosting Network Performance by Injecting Mini-Batches from a different Data DistributionIEEE International Joint Conference on Neural Network (IJCNN), 2023 Pravendra Singh Pratik Mazumder Vinay P. Namboodiri 82 0 0 08 Jun 2020
Distilling Knowledge from Graph Convolutional Networks Yiding Yang Jiayan Qiu Xiuming Zhang Dacheng Tao Xinchao Wang 385 248 0 23 Mar 2020
Deep Elastic Networks with Model Selection for Multi-Task LearningIEEE International Conference on Computer Vision (ICCV), 2023 Chanho Ahn Eunwoo Kim Songhwai Oh 135 53 0 11 Sep 2019
Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge AmalgamationIEEE International Conference on Computer Vision (ICCV), 2023 Chengchao Shen Mengqi Xue Xinchao Wang Mingli Song Li Sun Xiuming Zhang MoMe 105 60 0 20 Aug 2019
Feature Partitioning for Efficient Multi-Task Architectures Alejandro Newell Lu Jiang Chong-Jun Wang Li Li Jia Deng 108 17 0 12 Aug 2019
Pruning-Aware Merging for Efficient Multitask Inference Xiaoxi He Dawei Gao Zimu Zhou Yongxin Tong Lothar Thiele MoMe 116 9 0 23 May 2019