Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2411.16102
Cited By
BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching
25 November 2024
Yilong Zhao
Shuo Yang
Kan Zhu
Lianmin Zheng
Baris Kasikci
Yang Zhou
Jiarong Xing
Ion Stoica
Re-assign community
ArXiv
PDF
HTML
Papers citing
"BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching"
1 / 1 papers shown
Title
HyGen: Efficient LLM Serving via Elastic Online-Offline Request Co-location
Ting Sun
Penghan Wang
Fan Lai
36
1
0
15 Jan 2025
1
