Aladdin: Joint Placement and Scaling for SLO-Aware LLM Serving

11 May 2024

Papers citing "Aladdin: Joint Placement and Scaling for SLO-Aware LLM Serving"

1 / 1 papers shown

Title
Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction Haoran Qiu Weichao Mao Archit Patke Shengkun Cui Saurabh Jha Chen Wang Hubertus Franke Zbigniew T. Kalbarczyk Tamer Basar Ravishankar K. Iyer 14 23 0 12 Apr 2024