MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models

21 August 2024

Papers citing "MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models"

3 / 3 papers shown

Title
Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space Models Hung-Yueh Chiang Chi-chih Chang N. Frumkin Kai-Chiang Wu Mohamed S. Abdelfattah Diana Marculescu MQ 84 0 0 28 Mar 2025
iServe: An Intent-based Serving System for LLMs Dimitrios Liakopoulos Tianrui Hu Prasoon Sinha N. Yadwadkar VLM 92 0 0 08 Jan 2025
CursorCore: Assist Programming through Aligning Anything Hao Jiang Qi Liu Rui Li Shengyu Ye Shijin Wang 48 1 0 09 Oct 2024