Sparsing Law: Towards Large Language Models with Greater Activation Sparsity

4 November 2024

Papers citing "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity"

2 / 2 papers shown

Title
The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs Piotr Nawrot Robert Li Renjie Huang Sebastian Ruder Kelly Marchisio E. Ponti 18 0 0 24 Apr 2025
CATS: Contextually-Aware Thresholding for Sparsity in Large Language Models Je-Yong Lee Donghyun Lee Genghan Zhang Mo Tiwari Azalia Mirhoseini 25 11 0 12 Apr 2024