Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling

16 August 2024

Yixuan Wang

Qing Yang

Papers citing "Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling"

2 / 2 papers shown

Title
DReSD: Dense Retrieval for Speculative Decoding Milan Gritta Huiyin Xue Gerasimos Lampouras RALM 90 0 0 24 Feb 2025
Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training Yixuan Wang Xianzhen Luo Fuxuan Wei Yijun Liu Qingfu Zhu Xuanyu Zhang Qing Yang Dongliang Xu Wanxiang Che 35 3 0 25 Jun 2024