Towards Compact Neural Networks via End-to-End Training: A Bayesian
Tensor Approach with Automatic Rank Determination

v1v2v3 (latest)

Towards Compact Neural Networks via End-to-End Training: A Bayesian Tensor Approach with Automatic Rank Determination

17 October 2020

ArXiv (abs)PDF HTML

Papers citing "Towards Compact Neural Networks via End-to-End Training: A Bayesian Tensor Approach with Automatic Rank Determination"

15 / 15 papers shown

Title
Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks Yequan Zhao Xinling Yu Xian Xiao Zhe Chen Ziyue Liu G. Kurczveil R. Beausoleil Shixuan Liu Zheng Zhang 126 0 0 17 Feb 2025
Bayesian Estimation and Tuning-Free Rank Detection for Probability Mass Function Tensors Joseph K. Chege Arie Yeredor Martin Haardt 47 0 0 08 Oct 2024
CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization Zi Yang Samridhi Choudhary Xinfeng Xie Cao Gao Siegfried Kunzmann Zheng Zhang VLM 131 10 0 23 May 2024
Structure-Preserving Network Compression Via Low-Rank Induced Training Through Linear Layers Composition Xitong Zhang Ismail Alkhouri Rongrong Wang 96 0 0 06 May 2024
LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models Yifan Yang Jiajun Zhou Ngai Wong Zheng Zhang 73 8 0 18 Feb 2024
ELRT: Efficient Low-Rank Training for Compact Convolutional Neural Networks Yang Sui Miao Yin Yu Gong Jinqi Xiao Huy Phan Bo Yuan 97 6 0 18 Jan 2024
Tensor-Compressed Back-Propagation-Free Training for (Physics-Informed) Neural Networks Yequan Zhao Xinling Yu Zhixiong Chen Ziyue Liu Sijia Liu Zheng Zhang PINN 78 11 0 18 Aug 2023
Quantization-Aware and Tensor-Compressed Training of Transformers for Natural Language Understanding Ziao Yang Samridhi Choudhary Siegfried Kunzmann Zheng Zhang MQ 79 3 0 01 Jun 2023
How Informative is the Approximation Error from Tensor Decomposition for Neural Network Compression? Jetze T. Schuurmans Kim Batselier Julian F. P. Kooij 30 1 0 09 May 2023
HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression Jiaqi Gu Ben Keller Jean Kossaifi Anima Anandkumar Brucek Khailany David Z. Pan ViT 66 9 0 30 Nov 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 118 3 0 22 Aug 2022
TT-PINN: A Tensor-Compressed Neural PDE Solver for Edge Computing Ziyue Liu Xinling Yu Zheng Zhang PINN 69 7 0 04 Jul 2022
Tensor Shape Search for Optimum Data Compression Ryan Solgi Zichang He William Liang Zheng Zhang 46 2 0 21 May 2022
Low-Rank+Sparse Tensor Compression for Neural Networks Cole Hawkins Haichuan Yang Meng Li Liangzhen Lai Vikas Chandra 60 3 0 02 Nov 2021
3U-EdgeAI: Ultra-Low Memory Training, Ultra-Low BitwidthQuantization, and Ultra-Low Latency Acceleration Yao Chen Cole Hawkins Kaiqi Zhang Zheng Zhang Cong Hao 67 8 0 11 May 2021