Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity

1 October 2024

Boxing Chen

Mehdi Rezagholizadeh

Papers citing "Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity"

2 / 2 papers shown

Title
DEL: Context-Aware Dynamic Exit Layer for Efficient Self-Speculative Decoding Hossein Entezari Zarch Lei Gao Chaoyi Jiang Murali Annavaram LRM 26 0 0 08 Apr 2025
Speculative Decoding and Beyond: An In-Depth Survey of Techniques Y. Hu Zining Liu Zhenyuan Dong Tianfan Peng Bradley McDanel S. Zhang 85 0 0 27 Feb 2025