Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessing

25 November 2022

Papers citing "Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessing"

26 / 26 papers shown

Title
When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time? Chenyang Li Yingyu Liang Zhenmei Shi Zhao-quan Song 36 3 0 24 Feb 2025
Video Latent Flow Matching: Optimal Polynomial Projections for Video Interpolation and Extrapolation Yang Cao Zhao-quan Song Chiwun Yang VGen 44 2 0 01 Feb 2025
Fast Gradient Computation for RoPE Attention in Almost Linear Time Yifang Chen Jiayan Huo Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao-quan Song 57 11 0 03 Jan 2025
Advancing the Understanding of Fixed Point Iterations in Deep Neural Networks: A Detailed Analytical Study Yekun Ke Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao-quan Song 53 3 0 15 Oct 2024
The Fine-Grained Complexity of Gradient Computation for Training Large Language Models Josh Alman Zhao-quan Song 11 5 0 07 Feb 2024
Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time Zichang Liu Jue Wang Tri Dao Tianyi Zhou Binhang Yuan ... Anshumali Shrivastava Ce Zhang Yuandong Tian Christopher Ré Beidi Chen BDL 11 189 0 26 Oct 2023
An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent Zhao-quan Song Chiwun Yang 19 9 0 17 Oct 2023
Is Solving Graph Neural Tangent Kernel Equivalent to Training Graph Neural Network? Lianke Qin Zhao-quan Song Baocheng Sun 10 6 0 14 Sep 2023
A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time Yeqi Gao Zhao-quan Song Weixin Wang Junze Yin 15 25 0 14 Sep 2023
Solving Attention Kernel Regression Problem via Pre-conditioner Zhao-quan Song Junze Yin Licheng Zhang 28 9 0 28 Aug 2023
How to Protect Copyright Data in Optimization of Large Language Models? T. Chu Zhao-quan Song Chiwun Yang 28 29 0 23 Aug 2023
GradientCoin: A Peer-to-Peer Decentralized Large Language Models Yeqi Gao Zhao-quan Song Junze Yin 18 18 0 21 Aug 2023
Convergence of Two-Layer Regression with Nonlinear Units Yichuan Deng Zhao-quan Song Shenghao Xie 13 7 0 16 Aug 2023
Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification Lianke Qin Zhao-quan Song Yuanyuan Yang 20 9 0 13 Jul 2023
Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation Zhao-quan Song Mingquan Ye Junze Yin Licheng Zhang 18 7 0 07 Jun 2023
Federated Empirical Risk Minimization via Second-Order Method S. Bian Zhao-quan Song Junze Yin FedML 23 8 0 27 May 2023
Fast Submodular Function Maximization Lianke Qin Zhao-quan Song Yitan Wang 11 10 0 15 May 2023
Fast and Efficient Matching Algorithm with Deadline Instances Zhao-quan Song Weixin Wang Chenbo Yin Junze Yin 8 7 0 15 May 2023
Efficient Asynchronize Stochastic Gradient Algorithm with Structured Data Zhao-quan Song Mingquan Ye 14 4 0 13 May 2023
An Iterative Algorithm for Rescaled Hyperbolic Functions Regression Yeqi Gao Zhao-quan Song Junze Yin 23 33 0 01 May 2023
Attention Scheme Inspired Softmax Regression Yichuan Deng Zhihang Li Zhao-quan Song 20 42 0 20 Apr 2023
An Over-parameterized Exponential Regression Yeqi Gao Sridhar Mahadevan Zhao-quan Song 10 35 0 29 Mar 2023
Adaptive and Dynamic Multi-Resolution Hashing for Pairwise Summations Lianke Qin Aravind Reddy Zhao-quan Song Zhaozhuo Xu Danyang Zhuo 17 13 0 21 Dec 2022
A Faster $k$ -means++ Algorithm Jiehao Liang Somdeb Sarkhel Zhao-quan Song Chenbo Yin Junze Yin Danyang Zhuo 17 5 0 28 Nov 2022
Federated Adversarial Learning: A Framework with Convergence Analysis Xiaoxiao Li Zhao-quan Song Jiaming Yang FedML 14 19 0 07 Aug 2022
Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time Zhao-quan Song Licheng Zhang Ruizhe Zhang 10 63 0 14 Dec 2021