v1v2 (latest)

Consistent Accelerated Inference via Confident Adaptive Transformers

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021

18 April 2021

Papers citing "Consistent Accelerated Inference via Confident Adaptive Transformers"

50 / 64 papers shown

Temporal Zoom Networks: Distance Regression and Continuous Depth for Efficient Action Localization

Ibne Farabi Shihab

Sanjeda Akter

Anuj Sharma

192

06 Nov 2025

Spec-LLaVA: Accelerating Vision-Language Models with Dynamic Tree-Based Speculative Decoding

142

15 Sep 2025

Statistical Methods in Generative AI

Edgar Dobriban

289

08 Sep 2025

ODE$_t$(ODE$_l$): Shortcutting the Time and the Length in Diffusion and Flow Models for Faster Sampling

ODE

_t

(ODE

_l

): Shortcutting the Time and the Length in Diffusion and Flow Models for Faster Sampling

215

26 Jun 2025

HELIOS: Adaptive Model And Early-Exit Selection for Efficient LLM Inference Serving

460

14 Apr 2025

Language Models Can Predict Their Own Behavior

Dhananjay Ashok

Jonathan May

AI4TS ReLM LRM

426

18 Feb 2025

Uncertainty Guarantees on Automated Precision Weeding using Conformal Prediction

203

13 Jan 2025

A novel framework for MCDM based on Z numbers and soft likelihood function

Yuanpeng He

220

26 Dec 2024

Deploying Foundation Model Powered Agent Services: A Survey

...

475

18 Dec 2024

Dynamic Self-Distillation via Previous Mini-batches for Fine-tuning Small Language Models

389

25 Nov 2024

CE-CoLLM: Efficient and Adaptive Large Language Models Through Cloud-Edge Collaboration

Hongpeng Jin

Yanzhao Wu

531

05 Nov 2024

Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRAInternational Conference on Learning Representations (ICLR), 2024

389

28 Oct 2024

Presto! Distilling Steps and Layers for Accelerating Music GenerationInternational Conference on Learning Representations (ICLR), 2024

Cheng-i Wang

Ge Zhu

Jonah Casebeer

Julian McAuley

Taylor Berg-Kirkpatrick

Nicholas J. Bryan

430

07 Oct 2024

A Simple Early Exiting Framework for Accelerated Sampling in Diffusion ModelsInternational Conference on Machine Learning (ICML), 2024

Moonseok Choi

Juho Lee

235

12 Aug 2024

An Efficient Inference Framework for Early-exit Large Language Models

185

25 Jul 2024

Answer, Assemble, Ace: Understanding How LMs Answer Multiple Choice Questions

Oyvind Tafjord

218

21 Jul 2024

Fast yet Safe: Early-Exiting with Risk Control

271

31 May 2024

Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMs

Fuzheng Zhang

...

167

24 May 2024

CEEBERT: Cross-Domain Inference in Early Exit BERT

Divya J. Bajpai

M. Hanawal

LRM

189

23 May 2024

Distributed Speculative Inference (DSI): Speculation Parallelism for Provably Faster Lossless Language Model InferenceInternational Conference on Learning Representations (ICLR), 2024

245

23 May 2024

Conformal Prediction for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL), 2024

Margarida M. Campos

António Farinhas

Chrysoula Zerva

Mário A. T. Figueiredo

André F. T. Martins

AI4CE

425

03 May 2024

SpaceByte: Towards Deleting Tokenization from Large Language Modeling

Kevin Slagle

215

22 Apr 2024

Cutting Off the Head Ends the Conflict: A Mechanism for Interpreting and Mitigating Knowledge Conflicts in Language Models

Kang Liu

Jun Zhao

677

28 Feb 2024

LLM Inference Unveiled: Survey and Roofline Model Insights

Zhihang Yuan

Yuzhang Shang

Yang Zhou

Zhen Dong

Zhe Zhou

...

Yong Jae Lee

Yan Yan

Beidi Chen

Guangyu Sun

Kurt Keutzer

619

148

26 Feb 2024

A Survey on Transformer Compression

460

05 Feb 2024

Investigating Recurrent Transformers with Dynamic Halt

Jishnu Ray Chowdhury

Cornelia Caragea

535

01 Feb 2024

Early Time Classification with Accumulated Accuracy Gap Control

189

01 Feb 2024

Non-Exchangeable Conformal Language Generation with Nearest Neighbors

Dennis Ulmer

Chrysoula Zerva

André F. T. Martins

374

01 Feb 2024

EE-Tuning: An Economical yet Scalable Solution for Tuning Early-Exit Large Language Models

Jingren Zhou

245

01 Feb 2024

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems

394

119

23 Dec 2023

ConsistentEE: A Consistent and Hardness-Guided Early Exiting Method for Accelerating Language Models Inference

277

19 Dec 2023

EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D ParallelismInternational Conference on Machine Learning (ICML), 2023

Jingren Zhou

482

08 Dec 2023

A Study on the Calibration of In-context Learning

558

07 Dec 2023

Early-Exit Neural Networks with Nested Prediction SetsConference on Uncertainty in Artificial Intelligence (UAI), 2023

192

10 Nov 2023

AutoMix: Automatically Mixing Language Models

Pranjal Aggarwal

Aman Madaan

Ankit Anand

Srividya Pranavi Potharaju

...

621

19 Oct 2023

Predictive Pipelined Decoding: A Compute-Latency Trade-off for Exact LLM Decoding

Seongjun Yang

Gibbeum Lee

Jaewoong Cho

Dimitris Papailiopoulos

Kangwook Lee

224

12 Jul 2023

Robots That Ask For Help: Uncertainty Alignment for Large Language Model PlannersConference on Robot Learning (CoRL), 2023

Allen Z. Ren

Anushri Dixit

Alexandra Bodrova

Sumeet Singh

Stephen Tu

...

Dorsa Sadigh

Anirudha Majumdar

480

308

04 Jul 2023

Conformal Language ModelingInternational Conference on Learning Representations (ICLR), 2023

554

16 Jun 2023

On the Expected Size of Conformal Prediction SetsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023

Guneet Singh Dhillon

George Deligiannidis

Tom Rainforth

198

12 Jun 2023

Towards Anytime Classification in Early-Exit Architectures by Enforcing Conditional MonotonicityNeural Information Processing Systems (NeurIPS), 2023

206

05 Jun 2023

Uncertainty in Natural Language Processing: Sources, Quantification, and Applications

262

05 Jun 2023

Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource SettingsAnnual Meeting of the Association for Computational Linguistics (ACL), 2023

196

04 Jun 2023

F-PABEE: Flexible-patience-based Early Exiting for Single-label and Multi-label text Classification TasksIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023

371

21 May 2023

Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023

344

19 May 2023

Jump to Conclusions: Short-Cutting Transformers With Linear TransformationsInternational Conference on Language Resources and Evaluation (LREC), 2023

200

16 Mar 2023

Full Stack Optimization of Transformer Inference: a Survey

Sehoon Kim

Coleman Hooper

...

288

150

27 Feb 2023

Adaptive Computation with Elastic Input SequenceInternational Conference on Machine Learning (ICML), 2023

Fuzhao Xue

Valerii Likhosherstov

Anurag Arnab

N. Houlsby

Mostafa Dehghani

Yang You

241

30 Jan 2023

FlexiViT: One Model for All Patch SizesComputer Vision and Pattern Recognition (CVPR), 2022

Ibrahim Alabdulmohsin

Filip Pavetić

VLM

422

136

15 Dec 2022

Fast Inference from Transformers via Speculative DecodingInternational Conference on Machine Learning (ICML), 2022

Yaniv Leviathan

Matan Kalman

Yossi Matias

LRM

597

1,133

30 Nov 2022

You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language ModelComputer Vision and Pattern Recognition (CVPR), 2022

Yaqing Wang

Caiwen Ding

Dongkuan Xu

212

21 Nov 2022