Fine-grained Attention I/O Complexity: Comprehensive Analysis for Backward Passes

12 October 2024

Papers citing "Fine-grained Attention I/O Complexity: Comprehensive Analysis for Backward Passes"

3 / 3 papers shown

Title
Fast Gradient Computation for RoPE Attention in Almost Linear Time Yifang Chen Jiayan Huo Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao-quan Song 54 11 0 03 Jan 2025
Beyond Linear Approximations: A Novel Pruning Approach for Attention Matrix Yingyu Liang Jiangxuan Long Zhenmei Shi Zhao-quan Song Yufa Zhou 56 5 0 15 Oct 2024
HSR-Enhanced Sparse Attention Acceleration Bo Chen Yingyu Liang Zhizhou Sha Zhenmei Shi Zhao-quan Song 79 17 0 14 Oct 2024