Learning Intrinsic Sparse Structures within Long Short-Term Memory

Learning Intrinsic Sparse Structures within Long Short-Term Memory

15 September 2017

Yuxiong He

Samyam Rajbhandari

Yiran Chen

Papers citing "Learning Intrinsic Sparse Structures within Long Short-Term Memory"

19 / 19 papers shown

Title
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity Lu Yin You Wu Zhenyu (Allen) Zhang Cheng-Yu Hsieh Yaqing Wang ... Mykola Pechenizkiy Yi Liang Michael Bendersky Zhangyang Wang Shiwei Liu 28 78 0 08 Oct 2023
Inference skipping for more efficient real-time speech enhancement with parallel RNNs Xiaohuai Le Tong Lei Kai-Jyun Chen Jing Lu 30 20 0 22 Jul 2022
Accelerating Attention through Gradient-Based Learned Runtime Pruning Zheng Li Soroush Ghodrati Amir Yazdanbakhsh H. Esmaeilzadeh Mingu Kang 19 16 0 07 Apr 2022
DNN Training Acceleration via Exploring GPGPU Friendly Sparsity Zhuoran Song Yihong Xu Han Li Naifeng Jing Xiaoyao Liang Li Jiang 27 3 0 11 Mar 2022
ACORT: A Compact Object Relation Transformer for Parameter Efficient Image Captioning J. Tan Y. Tan C. Chan Joon Huang Chuah VLM ViT 18 15 0 11 Feb 2022
bert2BERT: Towards Reusable Pretrained Language Models Cheng Chen Yichun Yin Lifeng Shang Xin Jiang Yujia Qin Fengyu Wang Zhi Wang Xiao Chen Zhiyuan Liu Qun Liu VLM 22 59 0 14 Oct 2021
End-to-End Supermask Pruning: Learning to Prune Image Captioning Models J. Tan C. Chan Joon Huang Chuah VLM 49 16 0 07 Oct 2021
Spartus: A 9.4 TOp/s FPGA-based LSTM Accelerator Exploiting Spatio-Temporal Sparsity Chang Gao T. Delbruck Shih-Chii Liu 14 44 0 04 Aug 2021
Spectral Pruning for Recurrent Neural Networks Takashi Furuya Kazuma Suetake K. Taniguchi Hiroyuki Kusumoto Ryuji Saiin Tomohiro Daimon 22 4 0 23 May 2021
Pruning Convolutional Filters using Batch Bridgeout Najeeb Khan Ian Stavness 19 3 0 23 Sep 2020
Self-Supervised GAN Compression Chong Yu Jeff Pool 7 9 0 03 Jul 2020
CSB-RNN: A Faster-than-Realtime RNN Acceleration Framework with Compressed Structured Blocks Runbin Shi Peiyan Dong Tong Geng Yuhao Ding Xiaolong Ma Hayden Kwok-Hay So Martin C. Herbordt Ang Li Yanzhi Wang MQ 10 13 0 11 May 2020
Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsification Huanrui Yang Minxue Tang W. Wen Feng Yan Daniel Hu Ang Li H. Li Yiran Chen 31 62 0 20 Apr 2020
Fully Quantized Transformer for Machine Translation Gabriele Prato Ella Charlaix Mehdi Rezagholizadeh MQ 13 68 0 17 Oct 2019
DiabDeep: Pervasive Diabetes Diagnosis based on Wearable Medical Sensors and Efficient Neural Networks Hongxu Yin Bilal Mukadam Xiaoliang Dai N. Jha 20 47 0 11 Oct 2019
On the Effectiveness of Low-Rank Matrix Factorization for LSTM Model Compression Genta Indra Winata Andrea Madotto Jamin Shin Elham J. Barezi Pascale Fung 19 28 0 27 Aug 2019
Hardware-Guided Symbiotic Training for Compact, Accurate, yet Execution-Efficient LSTM Hongxu Yin Guoyang Chen Yingmin Li Shuai Che Weifeng Zhang N. Jha 20 10 0 30 Jan 2019
Intrinsically Sparse Long Short-Term Memory Networks Shiwei Liu D. Mocanu Mykola Pechenizkiy 14 9 0 26 Jan 2019
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,326 0 05 Nov 2016