The Hardware Lottery

14 September 2020

Papers citing "The Hardware Lottery"

23 / 23 papers shown

Title
GPU Performance Portability needs Autotuning Burkhard Ringlein Thomas Parnell Radu Stoica 41 0 0 30 Apr 2025
Artificial Kuramoto Oscillatory Neurons Takeru Miyato Sindy Lowe Andreas Geiger Max Welling AI4CE 65 6 0 17 Feb 2025
Evolution and The Knightian Blindspot of Machine Learning Joel Lehman Elliot Meyerson Tarek El-Gaaly Kenneth O. Stanley Tarin Ziyaee 78 1 0 22 Jan 2025
Solving Sparse Finite Element Problems on Neuromorphic Hardware Bradley H. Theilman J. Aimone 34 0 0 17 Jan 2025
Towards Scalable and Stable Parallelization of Nonlinear RNNs Xavier Gonzalez Andrew Warrington Jimmy T.H. Smith Scott W. Linderman 83 8 0 17 Jan 2025
Efficient Sparse Training with Structured Dropout Andy Lo BDL 23 0 0 02 Nov 2024
SpiNNaker2: A Large-Scale Neuromorphic System for Event-Based and Asynchronous Machine Learning Hector A. Gonzalez Jiaxin Huang Florian Kelber Khaleelulla Khan Nazeer Tim Langer ... Bernhard Vogginger Timo C. Wunderlich Yexin Yan Mahmoud Akl Christian Mayr 19 15 0 09 Jan 2024
Photorealistic Video Generation with Diffusion Models Agrim Gupta Lijun Yu Kihyuk Sohn Xiuye Gu Meera Hahn Fei-Fei Li Irfan Essa Lu Jiang José Lezama VGen 20 172 0 11 Dec 2023
DropCompute: simple and more robust distributed synchronous training via compute variance reduction Niv Giladi Shahar Gottlieb Moran Shkolnik A. Karnieli Ron Banner Elad Hoffer Kfir Y. Levy Daniel Soudry 15 2 0 18 Jun 2023
Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency Vithursan Thangarasa Shreyas Saxena Abhay Gupta Sean Lie 21 3 0 21 Mar 2023
The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment Jared Fernandez Jacob Kahn Clara Na Yonatan Bisk Emma Strubell FedML 8 10 0 13 Feb 2023
Hungry Hungry Hippos: Towards Language Modeling with State Space Models Daniel Y. Fu Tri Dao Khaled Kamal Saab A. Thomas Atri Rudra Christopher Ré 22 367 0 28 Dec 2022
Making Intelligence: Ethical Values in IQ and ML Benchmarks Borhane Blili-Hamelin Leif Hancox-Li 17 15 0 01 Sep 2022
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness Tri Dao Daniel Y. Fu Stefano Ermon Atri Rudra Christopher Ré VLM 48 2,004 0 27 May 2022
Federated Self-supervised Speech Representations: Are We There Yet? Yan Gao Javier Fernandez-Marques Titouan Parcollet Abhinav Mehrotra Nicholas D. Lane 14 13 0 06 Apr 2022
Monarch: Expressive Structured Matrices for Efficient and Accurate Training Tri Dao Beidi Chen N. Sohoni Arjun D Desai Michael Poli Jessica Grogan Alexander Liu Aniruddh Rao Atri Rudra Christopher Ré 11 87 0 01 Apr 2022
CFU Playground: Full-Stack Open-Source Framework for Tiny Machine Learning (tinyML) Acceleration on FPGAs Shvetank Prakash Tim Callahan Joseph R. Bushagour Colby R. Banbury Alan V. Green Pete Warden Tim Ansell Vijay Janapa Reddi 19 30 0 05 Jan 2022
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models Tri Dao Beidi Chen Kaizhao Liang Jiaming Yang Zhao-quan Song Atri Rudra Christopher Ré 14 75 0 30 Nov 2021
The Efficiency Misnomer Daoyuan Chen Liuyi Yao Dawei Gao Ashish Vaswani Yaliang Li 17 96 0 25 Oct 2021
Beyond Desktop Computation: Challenges in Scaling a GPU Infrastructure M. Uray E. Hirsch Gerold Katzinger M. Gadermayr 11 1 0 11 Oct 2021
The five Is: Key principles for interpretable and safe conversational AI M. Wahde M. Virgolin 26 5 0 31 Aug 2021
Declarative Machine Learning Systems Piero Molino Christopher Ré AI4TS 9 19 0 16 Jul 2021
$All-Optical Machine Learning Using Diffractive Deep Neural Networks$ All-Optical Machine Learning Using Diffractive Deep Neural Networks Xing Lin Y. Rivenson N. Yardimci Muhammed Veli Mona Jarrahi Aydogan Ozcan 56 1,596 0 14 Apr 2018