Predicting the Computational Cost of Deep Learning Models

28 November 2018

Papers citing "Predicting the Computational Cost of Deep Learning Models"

50 / 61 papers shown

Title
ScaleDL: Towards Scalable and Efficient Runtime Prediction for Distributed Deep Learning Workloads Xiaokai Wang Shaoyuan Huang Yuting Li Xiaofei Wang GNN AI4CE 256 0 0 06 Nov 2025
Efficient Fine-Grained GPU Performance Modeling for Distributed Deep Learning of LLM Biyao Zhang Mingkai Zheng Debargha Ganguly Xuecen Zhang Vikash Singh Vipin Chaudhary Zhao Zhang 66 0 0 26 Sep 2025
Phantora: Maximizing Code Reuse in Simulation-based Machine Learning System Performance Estimation Jianxing Qin Jingrong Chen Xinhao Kong Yongji Wu Liang Luo ... Ying Zhang Ying Zhang Tingjun Chen Alvin R. Lebeck Danyang Zhuo 595 0 0 02 May 2025
Language modelling techniques for analysing the impact of human genetic variationBioinformatics and Biology Insights (BBI), 2025 Megha Hegde Jean-Christophe Nebel Farzana Rahman 119 2 0 07 Mar 2025
PreNeT: Leveraging Computational Features to Predict Deep Neural Network Training TimeInternational Conference on Performance Engineering (ICPE), 2024 Alireza Pourali Arian Boukani Hamzeh Khazaei 237 0 0 20 Dec 2024
Inducing Semi-Structured Sparsity by Masking for Efficient Model Inference in Convolutional Networks David A. Danhofer 180 0 0 01 Nov 2024
LLM-Pilot: Characterize and Optimize Performance of your LLM Inference ServicesInternational Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2024 Małgorzata Łazuka Andreea Anghel Thomas Parnell 220 18 0 03 Oct 2024
MicroFlow: An Efficient Rust-Based Inference Engine for TinyMLInternet of Things (IoT), 2024 Matteo Carnelos Francesco Pasti Nicola Bellotto 234 5 0 28 Sep 2024
A Model Generalization Study in Localizing Indoor Cows with COw LOcalization (COLO) dataset Mautushi Das Gonzalo Ferreira James Chen 130 1 0 29 Jul 2024
Pretraining Decision Transformers with Reward Prediction for In-Context Multi-task Structured Bandit Learning Subhojyoti Mukherjee Josiah P. Hanna Qiaomin Xie Robert D. Nowak 584 5 0 07 Jun 2024
Off-the-Shelf Neural Network Architectures for Forex Time Series Prediction come at a CostHellenic Conference on Artificial Intelligence (HCAI), 2024 Theodoros Zafeiriou Dimitris Kalles AI4TS 136 0 0 17 May 2024
Train Faster, Perform Better: Modular Adaptive Training in Over-Parameterized Models Yubin Shi Yixuan Chen Mingzhi Dong Xiaochen Yang Dongsheng Li ... Yingying Zhao Fan Yang Tun Lu Ning Gu L. Shang MoMe 207 4 0 13 May 2024
On Replacing Cryptopuzzles with Useful Computation in Blockchain Proof-of-Work Protocols Andrea Merlina Thiago Garrett Roman Vitenberg 136 0 0 24 Apr 2024
Towards Universal Performance Modeling for Machine Learning Training on Multi-GPU Platforms Zhongyi Lin Ning Sun Pallab Bhattacharya Xizhou Feng Louis Feng John Douglas Owens 229 4 0 19 Apr 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 328 24 0 27 Mar 2024
Cloud-based XAI Services for Assessing Open Repository Models Under Adversarial Attacks Zerui Wang Yan Liu AAML 207 7 0 22 Jan 2024
Green Edge AI: A Contemporary SurveyProceedings of the IEEE (Proc. IEEE), 2023 Yuyi Mao X. Yu Kaibin Huang Ying-Jun Angela Zhang Jun Zhang 374 51 0 01 Dec 2023
Using Cooperative Game Theory to Prune Neural Networks M. Diaz-Ortiz Benjamin Kempinski Daphne Cornelisse Yoram Bachrach Tal Kachman 297 2 0 17 Nov 2023
InvKA: Gait Recognition via Invertible Koopman Autoencoder Fan Li Dong Liang Jing Lian Qidong Liu Hegui Zhu Jizhao Liu CVBM 214 2 0 26 Sep 2023
$All-optical image denoising using a diffractive visual processor$ All-optical image denoising using a diffractive visual processorLight: Science & Applications (Light Sci. Appl.), 2023 Çaǧatay Işıl Tianyi Gan F. O. Ardic Koray Mentesoglu Jagrit Digani ... Jingxi Li Deniz Mengu Mona Jarrahi Duygu Ceylan Aydogan Ozcan DiffM 144 37 0 17 Sep 2023
FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs Zhenheng Tang Yuxin Wang Xin He Longteng Zhang Xinglin Pan ... Rongfei Zeng Kaiyong Zhao Shaoshuai Shi Bingsheng He Xiaowen Chu 203 35 0 03 Sep 2023
Lie-Poisson Neural Networks (LPNets): Data-Based Computing of Hamiltonian Systems with SymmetriesNeural Networks (Neural Netw.), 2023 Christopher Eldred François Gay-Balmaz Sofiia Huraka V. Putkaradze 156 12 0 29 Aug 2023
MOFA: A Model Simplification Roadmap for Image Restoration on Mobile Devices Xiangyu Chen Ruiwen Zhen Shuai Li Xiaotian Li Guanghui Wang 189 2 0 24 Aug 2023
PruMUX: Augmenting Data Multiplexing with Model CompressionAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yushan Su Vishvak Murahari Karthik Narasimhan Keqin Li 214 3 0 24 May 2023
DIPPM: a Deep Learning Inference Performance Predictive Model using Graph Neural NetworksEuropean Conference on Parallel Processing (Euro-Par), 2023 Karthick Panner Selvam M. Brorsson GNN BDL 93 7 0 21 Mar 2023
Predicting the Performance of a Computing System with Deep NetworksInternational Conference on Performance Engineering (ICPE), 2023 M. Cengiz M. Forshaw Amir Atapour-Abarghouei A. Mcgough 82 10 0 27 Feb 2023
CarbonScaler: Leveraging Cloud Workload Elasticity for Optimizing Carbon-EfficiencyProceedings of the ACM on Measurement and Analysis of Computing Systems (POMACS), 2023 Walid A. Hanafy Qianlin Liang Noman Bashir David Irwin Prashant J. Shenoy 195 71 0 17 Feb 2023
Mystique: Enabling Accurate and Scalable Generation of Production AI BenchmarksInternational Symposium on Computer Architecture (ISCA), 2022 Mingyu Liang Wenyin Fu Louis Feng Zhongyi Lin P. Panakanti Shengbao Zheng Srinivas Sridharan Christina Delimitrou 179 15 0 16 Dec 2022
AI Model Utilization Measurements For Finding Class Encoding Patterns P. Bajcsy Antonio Cardone Chenyi Ling Philippe Dessauw Michael Majurski Timothy Blattner D. Juba Walid Keyrouz 118 0 0 12 Dec 2022
CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual LearningComputer Vision and Pattern Recognition (CVPR), 2022 James Smith Leonid Karlinsky V. Gutta Paola Cascante-Bonilla Donghyun Kim Assaf Arbelle Yikang Shen Rogerio Feris Z. Kira CLL VPVLM VLM 328 433 0 23 Nov 2022
Rethinking the transfer learning for FCN based polyp segmentation in colonoscopyIEEE Access (IEEE Access), 2022 Yan-mao Wen Lei Zhang Xiangli Meng Xujiong Ye 116 19 0 04 Nov 2022
Low-latency Federated Learning with DNN Partition in Distributed Industrial IoT NetworksIEEE Journal on Selected Areas in Communications (JSAC), 2022 Xiumei Deng Jun Li Chuan Ma Kang Wei Long Shi Ming Ding Wen Chen FedML 157 44 0 26 Oct 2022
Inference Latency Prediction at the Edge Zhuojin Li Marco Paolieri L. Golubchik 129 6 0 06 Oct 2022
PROFET: Profiling-based CNN Training Latency Prophet for GPU Cloud Instances Sungjae Lee Y. Hur Subin Park Kyungyong Lee 165 2 0 10 Aug 2022
DNNAbacus: Toward Accurate Computational Cost Prediction for Deep Neural Networks Lu Bai Weixing Ji Qinyuan Li Xi Yao Wei Xin Wanyi Zhu 117 7 0 24 May 2022
Towards Optimal VPU Compiler Cost Modeling by using Neural Networks to Infer Hardware Performances Ian Frederick Vigogne Goodbody Hunter Alessandro Palla Sebastian Eusebiu Nagy R. Richmond Kyle McAdoo 98 2 0 09 May 2022
A Closer Look at Rehearsal-Free Continual Learning James Smith Junjiao Tian Shaunak Halbe Yen-Chang Hsu Z. Kira VLM CLL 297 81 0 31 Mar 2022
Perception Over Time: Temporal Dynamics for Robust Image Understanding Maryam Daniali Edward J. Kim AI4TS 141 7 0 11 Mar 2022
Benchmarking Resource Usage for Efficient Distributed Deep LearningIEEE Conference on High Performance Extreme Computing (HPEC), 2022 Nathan C. Frey Baolin Li Joseph McDonald Dan Zhao Michael Jones David Bestor Devesh Tiwari V. Gadepally S. Samsi 186 13 0 28 Jan 2022
Building a Performance Model for Deep Learning Recommendation Model Training on GPUsInternational Conference on High Performance Computing (HiPC), 2022 Zhongyi Lin Louis Feng E. K. Ardestani Jaewon Lee J. Lundell Changkyu Kim A. Kejariwal John Douglas Owens 138 19 0 19 Jan 2022
Quantitative reconstruction of defects in multi-layered bonded composites using fully convolutional network-based ultrasonic inversion J. Rao Fangshu Yang H. Mo Stefan Kollmannsberger E. Rank 93 27 0 11 Sep 2021
A Clustering-aided Ensemble Method for Predicting Ridesourcing Demand in Chicago Xiaojian Zhang Xilei Zhao 94 0 0 08 Sep 2021
Visual Sensation and Perception Computational Models for Deep Learning: State of the art, Challenges and Prospects Bing Wei Yudi Zhao K. Hao Lei Gao 206 6 0 08 Sep 2021
Multirate Training of Neural NetworksInternational Conference on Machine Learning (ICML), 2021 Tiffany J. Vlaar Benedict Leimkuhler 203 5 0 20 Jun 2021
Regular Polytope NetworksIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2021 F. Pernici Matteo Bruni C. Baecchi Marco Bertini 149 30 0 29 Mar 2021
A Runtime-Based Computational Performance Predictor for Deep Neural Network TrainingUSENIX Annual Technical Conference (USENIX ATC), 2021 Geoffrey X. Yu Yubo Gao P. Golikov Gennady Pekhimenko 3DH 137 79 0 31 Jan 2021
A Neophyte With AutoML: Evaluating the Promises of Automatic Machine Learning Tools Oleg Bezrukavnikov Rhema Linder 103 13 0 14 Jan 2021
ResPerfNet: Deep Residual Learning for Regressional Performance Modeling of Deep Neural Networks Chuan-Chi Wang Ying-Chiao Liao Chia-Heng Tu Ming-Chang Kao Wen-Yew Liang Shih-Hao Hung 70 0 0 03 Dec 2020
Toward Accurate Platform-Aware Performance Modeling for Deep Neural NetworksACM SIGAPP Applied Computing Review (ACR), 2020 Chuan-Chi Wang Ying-Chiao Liao Ming-Chang Kao Wen-Yew Liang Shih-Hao Hung 134 13 0 01 Dec 2020
Srifty: Swift and Thrifty Distributed Training on the CloudConference on Machine Learning and Systems (MLSys), 2020 Liangchen Luo Peter West Arvind Krishnamurthy Luis Ceze 185 13 0 29 Nov 2020