Energon: Towards Efficient Acceleration of Transformers Using Dynamic
Sparse Attention

v1v2 (latest)

Energon: Towards Efficient Acceleration of Transformers Using Dynamic Sparse Attention

18 October 2021

ArXiv (abs)PDF HTML

Papers citing "Energon: Towards Efficient Acceleration of Transformers Using Dynamic Sparse Attention"

10 / 10 papers shown

Title
GS-TG: 3D Gaussian Splatting Accelerator with Tile Grouping for Reducing Redundant Sorting while Preserving Rasterization Efficiency Joongho Jo Jongsun Park 3DGS 24 0 0 31 Aug 2025
Energy-Efficient Wireless LLM Inference via Uncertainty and Importance-Aware Speculative Decoding Jihoon Park Seungeun Oh Seong-Lyun Kim 20 0 0 18 Aug 2025
Top-Theta Attention: Sparsifying Transformers by Compensated Thresholding Konstantin Berestizshevsky Renzo Andri Lukas Cavigelli 172 2 0 12 Feb 2025
Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies Xubin Wang Weijia Jia 210 14 0 08 Jan 2025
LATTE: Low-Precision Approximate Attention with Head-wise Trainable Threshold for Efficient Transformer Jiing-Ping Wang Ming-Guang Lin An-Yeu Wu Wu 79 2 0 11 Apr 2024
Identifying Unnecessary 3D Gaussians using Clustering for Fast Rendering of 3D Gaussian Splatting Joongho Jo Hyeongwon Kim Jongsun Park 3DGS 82 5 0 21 Feb 2024
EdgeTran: Co-designing Transformers for Efficient Inference on Mobile Edge Platforms Shikhar Tuli N. Jha 108 3 0 24 Mar 2023
Full Stack Optimization of Transformer Inference: a Survey Sehoon Kim Coleman Hooper Thanakul Wattanawong Minwoo Kang Ruohan Yan ... Qijing Huang Kurt Keutzer Michael W. Mahoney Y. Shao A. Gholami MQ 199 118 0 27 Feb 2023
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation Ningxin Zheng Huiqiang Jiang Quan Zhang Zhenhua Han Yuqing Yang ... Fan Yang Chengruidong Zhang Lili Qiu Mao Yang Lidong Zhou 131 31 0 26 Jan 2023
Adaptable Butterfly Accelerator for Attention-based NNs via Hardware and Algorithm Co-design Hongxiang Fan Thomas C. P. Chau Stylianos I. Venieris Royson Lee Alexandros Kouris Wayne Luk Nicholas D. Lane Mohamed S. Abdelfattah 99 68 0 20 Sep 2022

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.