Judge Decoding: Faster Speculative Sampling Requires Going Beyond Model Alignment

31 January 2025

Papers citing "Judge Decoding: Faster Speculative Sampling Requires Going Beyond Model Alignment"

2 / 2 papers shown

Title
Fuzzy Speculative Decoding for a Tunable Accuracy-Runtime Tradeoff Maximilian Holsman Yukun Huang Bhuwan Dhingra 44 0 0 28 Feb 2025
Speculative Decoding and Beyond: An In-Depth Survey of Techniques Y. Hu Zining Liu Zhenyuan Dong Tianfan Peng Bradley McDanel S. Zhang 93 0 0 27 Feb 2025