Compression of Fully-Connected Layer in Neural Network by Kronecker
Product

Compression of Fully-Connected Layer in Neural Network by Kronecker Product

21 July 2015

Shuchang Zhou

Papers citing "Compression of Fully-Connected Layer in Neural Network by Kronecker Product"

14 / 14 papers shown

Title
Krony-PT: GPT2 compressed with Kronecker Products M. Ayoub Ben Ayad Jelena Mitrović Michael Granitzer 68 0 0 16 Dec 2024
Layer-Specific Optimization: Sensitivity Based Convolution Layers Basis Search V. Alekseev Ilya Lukashevich Ilia Zharikov Ilya Vasiliev 27 0 0 12 Aug 2024
Fully invertible hyperbolic neural networks for segmenting large-scale surface and sub-surface data B. Peters Eldad Haber Keegan Lensink 20 0 0 30 Jun 2024
TQCompressor: improving tensor decomposition methods in neural networks via permutations V. Abronin A. Naumov D. Mazur D. Bystrov K. Tsarova Ar. Melnikov Ivan V. Oseledets S. Dolgov R. Brasher M. Perelshtein 28 6 0 29 Jan 2024
Kronecker Decomposition for Knowledge Graph Embeddings Caglar Demir Julian Lienen A. N. Ngomo 14 3 0 13 May 2022
Learning Robust and Lightweight Model through Separable Structured Transformations Xian Wei Yanhui Huang Yang Xu Mingsong Chen Hai Lan Yuanxiang Li Zhongfeng Wang Xuan Tang OOD 8 0 0 27 Dec 2021
Kronecker Decomposition for GPT Compression Ali Edalati Marzieh S. Tahaei Ahmad Rashid V. Nia J. Clark Mehdi Rezagholizadeh 34 33 0 15 Oct 2021
KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation Marzieh S. Tahaei Ella Charlaix V. Nia A. Ghodsi Mehdi Rezagholizadeh 41 22 0 13 Sep 2021
Pushing the limits of RNN Compression Urmish Thakker Igor Fedorov Jesse G. Beu Dibakar Gope Chu Zhou Ganesh S. Dasika Matthew Mattina 14 13 0 04 Oct 2019
Deep Graph-Convolutional Image Denoising D. Valsesia Giulia Fracastoro E. Magli GNN SSL 11 144 0 19 Jul 2019
Compressing RNNs for IoT devices by 15-38x using Kronecker Products Urmish Thakker Jesse G. Beu Dibakar Gope Chu Zhou Igor Fedorov Ganesh S. Dasika Matthew Mattina 14 36 0 07 Jun 2019
Image Denoising with Graph-Convolutional Neural Networks D. Valsesia Giulia Fracastoro E. Magli 6 44 0 29 May 2019
Quantized Convolutional Neural Networks for Mobile Devices Jiaxiang Wu Cong Leng Yuhang Wang Qinghao Hu Jian Cheng MQ 10 1,155 0 21 Dec 2015
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 243 7,633 0 03 Jul 2012