Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction

Re-assign community