SinkLoRA: Enhanced Efficiency and Chat Capabilities for Long-Context
Large Language Models

SinkLoRA: Enhanced Efficiency and Chat Capabilities for Long-Context Large Language Models

9 June 2024

Hengyu Zhang

Papers citing "SinkLoRA: Enhanced Efficiency and Chat Capabilities for Long-Context Large Language Models"

5 / 5 papers shown

Title
Tensor Product Attention Is All You Need Yifan Zhang Yifeng Liu Huizhuo Yuan Zhen Qin Yang Yuan Q. Gu Andrew Chi-Chih Yao 75 9 0 11 Jan 2025
LOGO -- Long cOntext aliGnment via efficient preference Optimization Zecheng Tang Zechen Sun Juntao Li Qiaoming Zhu Min Zhang 27 0 0 24 Oct 2024
Instruction Tuning with GPT-4 Baolin Peng Chunyuan Li Pengcheng He Michel Galley Jianfeng Gao SyDa ALM LM&MA 157 579 0 06 Apr 2023
LSG Attention: Extrapolation of pretrained Transformers to long sequences Charles Condevaux S. Harispe 25 24 0 13 Oct 2022
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 249 2,009 0 28 Jul 2020