BATON: Enhancing Batch-wise Inference Efficiency for Large Language Models via Dynamic Re-batching

24 October 2024

Papers citing "BATON: Enhancing Batch-wise Inference Efficiency for Large Language Models via Dynamic Re-batching"

1 / 1 papers shown

Title
Make Every Penny Count: Difficulty-Adaptive Self-Consistency for Cost-Efficient Reasoning Xinglin Wang Shaoxiong Feng Yiwei Li Peiwen Yuan Y. Zhang Boyuan Pan Heda Wang Yao Hu Kan Li LRM 37 16 0 24 Aug 2024