v1v2 (latest)

Analysis of DAWNBench, a Time-to-Accuracy Machine Learning Performance Benchmark

4 June 2018

Cody Coleman

Deepak Narayanan

Peter Bailis

Papers citing "Analysis of DAWNBench, a Time-to-Accuracy Machine Learning Performance Benchmark"

45 / 45 papers shown

Title
SharpZO: Hybrid Sharpness-Aware Vision Language Model Prompt Tuning via Forward-Only Passes Yifan Yang Zhen-ying Zhang Rupak Vignesh Swaminathan Jing Liu Nathan Susanj Zheng Zhang VLM 178 1 0 26 Jun 2025
On the Performance and Memory Footprint of Distributed Training: An Empirical Study on Transformers Zhengxian Lu Fangyu Wang Zhiwei Xu Fei Yang Tao Li 193 3 0 02 Jul 2024
Neural Loss Function Evolution for Large-Scale Image Classifier Convolutional Neural Networks Brandon Morgan Dean Frederick Hougen 106 4 0 30 Jan 2024
APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and InferenceInternational Conference on Machine Learning (ICML), 2024 Bowen Zhao Hannaneh Hajishirzi Qingqing Cao 300 26 0 22 Jan 2024
FFCV: Accelerating Training by Removing Data BottlenecksComputer Vision and Pattern Recognition (CVPR), 2023 Guillaume Leclerc Andrew Ilyas Logan Engstrom Sung Min Park Hadi Salman Aleksander Madry 183 78 0 21 Jun 2023
Chasing Low-Carbon Electricity for Practical and Sustainable DNN Training Zhenning Yang Luoxi Meng Jae-Won Chung Mosharaf Chowdhury AI4CE 208 3 0 04 Mar 2023
Deep Learning Inference Frameworks Benchmark Pierrick Pochelu BDL 105 3 0 09 Oct 2022
An Overview of the Data-Loader Landscape: Comparative Performance AnalysisBigData Congress [Services Society] (BSS), 2022 Iason Ofeidis Diego Kiedanski Leandros Tassiulas 178 7 0 27 Sep 2022
Zeus: Understanding and Optimizing GPU Energy Consumption of DNN TrainingSymposium on Networked Systems Design and Implementation (NSDI), 2022 Jie You Jaehoon Chung Mosharaf Chowdhury 268 117 0 12 Aug 2022
FedAdapter: Efficient Federated Learning for Modern NLP Dongqi Cai Yaozong Wu Shangguang Wang F. Lin Mengwei Xu FedML AI4CE 200 34 0 20 May 2022
MiCS: Near-linear Scaling for Training Gigantic Model on Public CloudProceedings of the VLDB Endowment (PVLDB), 2022 Zhen Zhang Shuai Zheng Yida Wang Justin Chiu George Karypis Trishul Chilimbi Mu Li Xin Jin 406 46 0 30 Apr 2022
Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNsSymposium on Networked Systems Design and Implementation (NSDI), 2022 John Thorpe Pengzhan Zhao Jon Eyolfson Yifan Qiao Zhihao Jia Minjia Zhang Ravi Netravali Guoqing Harry Xu 174 87 0 26 Apr 2022
Knowledge Graph Embedding Methods for Entity Alignment: An Experimental ReviewData mining and knowledge discovery (DMKD), 2022 N. Fanourakis Vasilis Efthymiou D. Kotzinos V. Christophides 151 51 0 17 Mar 2022
Bioinspired Cortex-based Fast Codebook Generation Meric Yucel S. Bagis A. Sertbas M. Sarikaya B. Üstündağ 60 1 0 28 Jan 2022
Codabench: Flexible, Easy-to-Use and Reproducible Benchmarking Platform Zhen Xu Sergio Escalera Isabelle M Guyon Adrien Pavao M. Richard Wei-Wei Tu Quanming Yao Huan Zhao 262 91 0 12 Oct 2021
Torch.manual_seed(3407) is all you need: On the influence of random seeds in deep learning architectures for computer vision David Picard 3DV VLM 198 116 0 16 Sep 2021
Informed Machine Learning for Improved Similarity Assessment in Process-Oriented Case-Based Reasoning Maximilian Hoffmann Ralph Bergmann 93 5 0 30 Jun 2021
Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless ThreadsUSENIX Symposium on Operating Systems Design and Implementation (OSDI), 2021 John Thorpe Yifan Qiao Jon Eyolfson Shen Teng Guanzhou Hu ... Jinliang Wei Keval Vora Ravi Netravali Yang Wang G. Xu GNN 260 161 0 24 May 2021
Sync-Switch: Hybrid Parameter Synchronization for Distributed Deep LearningIEEE International Conference on Distributed Computing Systems (ICDCS), 2021 Shijian Li Oren Mangoubi Lijie Xu Tian Guo 222 22 0 16 Apr 2021
On the Utility of Gradient Compression in Distributed Training SystemsConference on Machine Learning and Systems (MLSys), 2021 Saurabh Agarwal Hongyi Wang Shivaram Venkataraman Dimitris Papailiopoulos 265 53 0 28 Feb 2021
IMAGO: A family photo album dataset for a socio-historical analysis of the twentieth century L. Stacchio Alessia Angeli G. Lisanti Daniela Calanca Gustavo Marfia 142 3 0 03 Dec 2020
Machine Learning (In) Security: A Stream of Problems Fabrício Ceschin Marcus Botacin Nikolaos Perrakis Bernhard Pfahringer Luiz Eduardo Soares de Oliveira Heitor Murilo Gomes André Grégio AAML 258 41 0 30 Oct 2020
Exathlon: A Benchmark for Explainable Anomaly Detection over Time SeriesProceedings of the VLDB Endowment (PVLDB), 2020 Vincent Jacob Fei Song Arnaud Stiegler Bijan Rad Y. Diao Nesime Tatbul AI4TS 241 87 0 10 Oct 2020
Neural Model-based Optimization with Right-Censored Observations Katharina Eggensperger Kai Haase Philip Muller Marius Lindauer Katharina Eggensperger 156 9 0 29 Sep 2020
Bosch Deep Learning Hardware Benchmark Armin Runge Thomas Wenzel Dimitrios Bariamis B. Staffler Lucas Drumond Michael Pfeiffer 103 0 0 24 Aug 2020
Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads Deepak Narayanan Keshav Santhanam Fiodar Kazhamiaka Amar Phanishayee Matei A. Zaharia 134 251 0 20 Aug 2020
Jointly Optimizing Preprocessing and Inference for DNN-based Visual AnalyticsProceedings of the VLDB Endowment (PVLDB), 2020 Daniel Kang A. Mathur Teja Veeramacheneni Peter Bailis Matei A. Zaharia 150 49 0 25 Jul 2020
Multi-Precision Policy Enforced Training (MuPPET): A precision-switching strategy for quantised fixed-point training of CNNs A. Rajagopal D. A. Vink Stylianos I. Venieris C. Bouganis MQ 162 15 0 16 Jun 2020
Training for Speech Recognition on Coprocessors Sebastian Baunsgaard S. Wrede Pınar Tözün 96 6 0 22 Mar 2020
Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning Peter Henderson Jie Hu Joshua Romoff Emma Brunskill Dan Jurafsky Joelle Pineau 266 565 0 31 Jan 2020
EAST: Encoding-Aware Sparse Training for Deep Memory Compression of ConvNetsInternational Conference on Artificial Intelligence Circuits and Systems (AICAS), 2019 Matteo Grimaldi Valentino Peluso A. Calimera MQ 83 2 0 20 Dec 2019
The Design and Implementation of a Scalable DL Benchmarking PlatformIEEE International Conference on Cloud Computing (CLOUD), 2019 Cheng-rong Li Abdul Dakkak Jinjun Xiong Wen-mei W. Hwu ALM ELM 94 4 0 19 Nov 2019
DLBricks: Composable Benchmark Generation to Reduce Deep Learning Benchmarking Effort on CPUs (Extended)International Conference on Performance Engineering (ICPE), 2019 Cheng-rong Li Abdul Dakkak Jinjun Xiong Wen-mei W. Hwu 199 0 0 18 Nov 2019
Benanza: Automatic $μ$ Benchmark Generation to Compute "Lower-bound" Latency and Inform Optimizations of Deep Learning Models on GPUsIEEE International Parallel and Distributed Processing Symposium (IPDPS), 2019 Cheng-rong Li Abdul Dakkak Jinjun Xiong Wen-mei W. Hwu 195 11 0 16 Nov 2019
Farkas layers: don't shift the data, fix the geometry Aram-Alexandre Pooladian Chris Finlay Adam M. Oberman AI4CE 116 2 0 04 Oct 2019
MLPerf Training BenchmarkConference on Machine Learning and Systems (MLSys), 2019 Arya D. McCarthy Christine Cheng Cody Coleman Greg Diamos Paulius Micikevicius ... Carole-Jean Wu Lingjie Xu Masafumi Yamazaki C. Young Matei A. Zaharia 455 346 0 02 Oct 2019
Wield: Systematic Reinforcement Learning With Progressive Randomization Michael Schaarschmidt Kai Fricke Eiko Yoneki 130 2 0 15 Sep 2019
Best Practices for Scientific Research on Neural Architecture Search Marius Lindauer Katharina Eggensperger 220 152 0 05 Sep 2019
A principled approach for generating adversarial images under non-smooth dissimilarity metricsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2019 Aram-Alexandre Pooladian Chris Finlay Tim Hoheisel Adam M. Oberman AAML 150 3 0 05 Aug 2019
Scaleable input gradient regularization for adversarial robustnessMachine Learning with Applications (MLWA), 2019 Chris Finlay Adam M. Oberman AAML 245 84 0 27 May 2019
Memory-Efficient Adaptive OptimizationNeural Information Processing Systems (NeurIPS), 2019 Rohan Anil Vineet Gupta Tomer Koren Y. Singer ODL 163 49 0 30 Jan 2019
Frustrated with Replicating Claims of a Shared Model? A Solution Abdul Dakkak Cheng-rong Li Jinjun Xiong Wen-mei W. Hwu 118 7 0 24 Nov 2018
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism Yanping Huang Yonglong Cheng Ankur Bapna Orhan Firat Mia Xu Chen ... HyoukJoong Lee Jiquan Ngiam Quoc V. Le Yonghui Wu Zhifeng Chen GNN MoE 174 7 0 16 Nov 2018
A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation Akhilesh Deepak Gotmare N. Keskar Caiming Xiong R. Socher ODL 226 301 0 29 Oct 2018
Regularized Evolution for Image Classifier Architecture Search Esteban Real A. Aggarwal Yanping Huang Quoc V. Le 902 3,201 0 05 Feb 2018