Efficiency Unleashed: Inference Acceleration for LLM-based Recommender Systems with Speculative Decoding

11 August 2024

Papers citing "Efficiency Unleashed: Inference Acceleration for LLM-based Recommender Systems with Speculative Decoding"

2 / 2 papers shown

Title
Speculative Decoding and Beyond: An In-Depth Survey of Techniques Y. Hu Zining Liu Zhenyuan Dong Tianfan Peng Bradley McDanel S. Zhang 53 0 0 27 Feb 2025
Efficient Inference for Large Language Model-based Generative Recommendation Xinyu Lin Chaoqun Yang Wenjie Wang Yongqi Li Cunxiao Du Fuli Feng See-Kiong Ng Tat-Seng Chua 34 1 0 07 Oct 2024