Papers citing 'Multiplication-Free Transformer Training via Piecewise Affine Operations'

Title
Shrinking the Giant : Quasi-Weightless Transformers for Low Energy Inference Shashank Nag Alan T. L. Bacellar Zachary Susskind Anshul Jha Logan Liberty ... Krishnan Kailas P. Lima Neeraja J. Yadwadkar F. M. G. França L. John 191 0 0 04 Nov 2024
BitQ: Tailoring Block Floating Point Precision for Improved DNN Efficiency on Resource-Constrained Devices Yongqi Xu Yujian Lee Gao Yi Bosheng Liu Yucong Chen Peng Liu Jigang Wu Xiaoming Chen Yinhe Han MQ 189 3 0 25 Sep 2024
Scalable MatMul-free Language Modeling Rui-Jie Zhu Yu Zhang Ethan Sifferman Tyler Sheaves Yiqiao Wang Dustin Richmond P. Zhou Nhan Duy Truong 389 30 0 04 Jun 2024
On the Relationship between Self-Attention and Convolutional LayersInternational Conference on Learning Representations (ICLR), 2019 Jean-Baptiste Cordonnier Andreas Loukas Martin Jaggi 403 592 0 08 Nov 2019