Make Some Noise: Unlocking Language Model Parallel Inference Capability
through Noisy Training

Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training

25 June 2024

Yixuan Wang

Yijun Liu

Qing Yang

Papers citing "Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training"

5 / 5 papers shown

Title
Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction Vaishnavh Nagarajan Chen Henry Wu Charles Ding Aditi Raghunathan 26 0 0 21 Apr 2025
From Hours to Minutes: Lossless Acceleration of Ultra Long Sequence Generation up to 100K Tokens Tong Wu Junzhe Shen Zixia Jia Y. Wang Zilong Zheng 72 0 0 26 Feb 2025
Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling Xianzhen Luo Yixuan Wang Qingfu Zhu Zhiming Zhang Xuanyu Zhang Qing Yang Dongliang Xu Wanxiang Che 18 3 0 16 Aug 2024
Break the Sequential Dependency of LLM Inference Using Lookahead Decoding Yichao Fu Peter Bailis Ion Stoica Hao Zhang 120 134 0 03 Feb 2024
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Jiawei Liu Chun Xia Yuyao Wang Lingming Zhang ELM ALM 163 388 0 02 May 2023