ResearchTrend.AI

DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting

Kai Lv
Honglin Guo
Qipeng Guo
Xipeng Qiu
ArXivPDFHTML

Papers citing "DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting"

Title
No papers