OmniDraft: A Cross-vocabulary, Online Adaptive Drafter for On-device Speculative Decoding
Ramchalam Kinattinkara Ramakrishnan
Zhaocong Yuan
Shaojie Zhuo
Chen Feng
Yicheng Lin
Chenzheng Su
Xiaopeng Zhang
Papers citing "OmniDraft: A Cross-vocabulary, Online Adaptive Drafter for On-device Speculative Decoding"
Title | |||
|---|---|---|---|
| No papers | |||