HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression

30 November 2022

Papers citing "HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression"

7 / 7 papers shown

Title
ESPACE: Dimensionality Reduction of Activations for Model Compression Charbel Sakr Brucek Khailany 23 3 0 07 Oct 2024
CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization Zi Yang Samridhi Choudhary Xinfeng Xie Cao Gao Siegfried Kunzmann Zheng-Wei Zhang VLM 33 6 0 23 May 2024
Partial Tensorized Transformers for Natural Language Processing Subhadra Vadlamannati Ryan Solgi 22 0 0 30 Oct 2023
Transformers in Speech Processing: A Survey S. Latif Aun Zaidi Heriberto Cuayáhuitl Fahad Shamshad Moazzam Shoukat Junaid Qadir 40 46 0 21 Mar 2023
Gradient-Free Structured Pruning with Unlabeled Data Azade Nova H. Dai Dale Schuurmans SyDa 19 20 0 07 Mar 2023
Quantum-inspired tensor network for Earth science Soronzonbold Otgonbaatar Dieter Kranzlmüller PINN AI4CE 19 4 0 15 Jan 2023
Tensor Decomposition for Signal Processing and Machine Learning N. Sidiropoulos L. De Lathauwer Xiao Fu Kejun Huang Evangelos E. Papalexakis Christos Faloutsos 92 1,342 0 06 Jul 2016