Compression of Neural Machine Translation Models via Pruning

29 June 2016

A. See

Minh-Thang Luong

Christopher D. Manning

MedIm

VLM

ArXiv PDF HTML

Papers citing "Compression of Neural Machine Translation Models via Pruning"

29 / 29 papers shown

Title
The Unreasonable Ineffectiveness of the Deeper Layers Andrey Gromov Kushal Tirumala Hassan Shapourian Paolo Glorioso Daniel A. Roberts 41 79 0 26 Mar 2024
RobWE: Robust Watermark Embedding for Personalized Federated Learning Model Ownership Protection Yang Xu Yunlin Tan Cheng Zhang Kai Chi Peng Sun Wenyuan Yang Ju Ren Hongbo Jiang Yaoxue Zhang FedML 48 2 0 29 Feb 2024
Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models Mohammadreza Banaei Klaudia Bałazy Artur Kasymov R. Lebret Jacek Tabor Karl Aberer OffRL 14 0 0 08 Feb 2023
Compressing Transformer-based self-supervised models for speech processing Tzu-Quan Lin Tsung-Huan Yang Chun-Yao Chang Kuang-Ming Chen Tzu-hsun Feng Hung-yi Lee Hao Tang 32 6 0 17 Nov 2022
Continual Learning of Neural Machine Translation within Low Forgetting Risk Regions Shuhao Gu Bojie Hu Yang Feng CLL 28 11 0 03 Nov 2022
Don't Complete It! Preventing Unhelpful Code Completion for Productive and Sustainable Neural Code Completion Systems Zhensu Sun Xiaoning Du Fu Song Shangwen Wang Mingze Ni Li Li 21 10 0 13 Sep 2022
LCS: Learning Compressible Subspaces for Adaptive Network Compression at Inference Time Elvis Nunez Maxwell Horton Anish K. Prabhu Anurag Ranjan Ali Farhadi Mohammad Rastegari 15 4 0 08 Oct 2021
End-to-End Supermask Pruning: Learning to Prune Image Captioning Models J. Tan C. Chan Joon Huang Chuah VLM 49 16 0 07 Oct 2021
Layer-wise Model Pruning based on Mutual Information Chun Fan Jiwei Li Xiang Ao Fei Wu Yuxian Meng Xiaofei Sun 35 19 0 28 Aug 2021
Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation Shuhao Gu Yang Feng Wanying Xie CLL AI4CE 25 27 0 25 Mar 2021
Baseline Pruning-Based Approach to Trojan Detection in Neural Networks P. Bajcsy Michael Majurski AAML 17 8 0 22 Jan 2021
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade Jiatao Gu X. Kong 15 135 0 31 Dec 2020
Towards Zero-Shot Knowledge Distillation for Natural Language Processing Ahmad Rashid Vasileios Lioutas Abbas Ghaddar Mehdi Rezagholizadeh 13 27 0 31 Dec 2020
Softmax Tempering for Training Neural Machine Translation Models Raj Dabre Atsushi Fujita 23 10 0 20 Sep 2020
Self-Supervised GAN Compression Chong Yu Jeff Pool 7 9 0 03 Jul 2020
schuBERT: Optimizing Elements of BERT A. Khetan Zohar S. Karnin 18 30 0 09 May 2020
On the Decision Boundaries of Neural Networks: A Tropical Geometry Perspective Motasem Alfarra Adel Bibi Hasan Hammoud M. Gaafar Bernard Ghanem 9 26 0 20 Feb 2020
Embedding Compression with Isotropic Iterative Quantization Siyu Liao Jie Chen Yanzhi Wang Qinru Qiu Bo Yuan MQ 18 11 0 11 Jan 2020
Fully Quantized Transformer for Machine Translation Gabriele Prato Ella Charlaix Mehdi Rezagholizadeh MQ 8 68 0 17 Oct 2019
Serving Recurrent Neural Networks Efficiently with a Spatial Accelerator Tian Zhao Yaqi Zhang K. Olukotun 8 16 0 26 Sep 2019
Reducing Transformer Depth on Demand with Structured Dropout Angela Fan Edouard Grave Armand Joulin 17 584 0 25 Sep 2019
On the Effectiveness of Low-Rank Matrix Factorization for LSTM Model Compression Genta Indra Winata Andrea Madotto Jamin Shin Elham J. Barezi Pascale Fung 11 28 0 27 Aug 2019
Implicit Deep Learning L. Ghaoui Fangda Gu Bertrand Travacca Armin Askari Alicia Y. Tsai AI4CE 34 176 0 17 Aug 2019
Knowledge Distillation For Recurrent Neural Network Language Modeling With Trust Regularization Yangyang Shi M. Hwang X. Lei Haoyu Sheng 18 25 0 08 Apr 2019
Dynamic Sentence Sampling for Efficient Training of Neural Machine Translation Rui Wang Masao Utiyama Eiichiro Sumita 27 27 0 01 May 2018
The Description Length of Deep Learning Models Léonard Blier Yann Ollivier 24 95 0 20 Feb 2018
Boosting Neural Machine Translation Dakun Zhang Jungi Kim Josep Crego Jean Senellart AI4CE 13 26 0 19 Dec 2016
SYSTRAN's Pure Neural Machine Translation Systems Josep Crego Jungi Kim Guillaume Klein Anabel Rebollo Kathy Yang ... Bo Wang Jin Yang Dakun Zhang Jing Zhou Peter Zoldan 28 125 0 18 Oct 2016
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 214 7,923 0 17 Aug 2015