Online Cascade Learning for Efficient Inference over Streams

Online Cascade Learning for Efficient Inference over Streams

7 February 2024

Christopher M. Jermaine

Swarat Chaudhuri

Papers citing "Online Cascade Learning for Efficient Inference over Streams"

7 / 7 papers shown

Title
Bi-directional Model Cascading with Proxy Confidence David Warren Mark Dras 41 0 0 27 Apr 2025
Resource-efficient Inference with Foundation Model Programs Lunyiu Nie Zhimin Ding Kevin Yu Marco Cheung C. Jermaine S. Chaudhuri 14 0 0 09 Apr 2025
RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Models Shuhao Chen Weisen Jiang Baijiong Lin James T. Kwok Yu Zhang RALM MQ 35 5 0 30 Sep 2024
MODL: Multilearner Online Deep Learning Antonios Valkanas Boris N. Oreshkin Mark J. Coates 34 1 0 28 May 2024
Cache & Distil: Optimising API Calls to Large Language Models Guillem Ramírez Matthias Lindemann Alexandra Birch Ivan Titov 19 3 0 20 Oct 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes Lokesh Nagalapatti Chun-Liang Li Chih-Kuan Yeh Hootan Nakhost Yasuhisa Fujii Alexander Ratner Ranjay Krishna Chen-Yu Lee Tomas Pfister ALM 198 283 0 03 May 2023
BabyBear: Cheap inference triage for expensive language models Leila Khalili Yao You John Bohannon 21 9 0 24 May 2022