A Survey of Multi-Tenant Deep Learning Inference on GPU

17 March 2022

Papers citing "A Survey of Multi-Tenant Deep Learning Inference on GPU"

2 / 2 papers shown

Title
FlexLLM: A System for Co-Serving Large Language Model Inference and Parameter-Efficient Finetuning Xupeng Miao Gabriele Oliaro Xinhao Cheng Vineeth Kada Ruohan Gao ... April Yang Yingcheng Wang Mengdi Wu Colin Unger Zhihao Jia MoE 94 9 0 29 Feb 2024
Equality Saturation for Tensor Graph Superoptimization Yichen Yang Mangpo Phitchaya Phothilimtha Y. Wang Max Willsey Sudip Roy Jacques Pienaar 38 80 0 05 Jan 2021