CItruS: Chunked Instruction-aware State Eviction for Long Sequence
Modeling

CItruS: Chunked Instruction-aware State Eviction for Long Sequence Modeling

17 June 2024

Marc-Antoine Rondeau

Yang Gao

Jackie Chi Kit Cheung

Papers citing "CItruS: Chunked Instruction-aware State Eviction for Long Sequence Modeling"

8 / 8 papers shown

Title
Cognitive Memory in Large Language Models Lianlei Shan Shixian Luo Zezhou Zhu Yu Yuan Yong Wu LLMAG KELM 63 1 0 03 Apr 2025
Focus on the Core: Efficient Attention via Pruned Token Compression for Document Classification Jungmin Yun Mihyeon Kim Youngbin Kim 60 9 0 03 Jun 2024
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention Tsendsuren Munkhdalai Manaal Faruqui Siddharth Gopal LRM LLMAG CLL 79 101 0 10 Apr 2024
Retrieval-Augmented Generation for AI-Generated Content: A Survey Penghao Zhao Hailin Zhang Qinhan Yu Zhengren Wang Yunteng Geng Fangcheng Fu Ling Yang Wentao Zhang Jie Jiang Bin Cui 3DV 101 215 0 29 Feb 2024
LongHeads: Multi-Head Attention is Secretly a Long Context Processor Yi Lu Xin Zhou Wei He Jun Zhao Tao Ji Tao Gui Qi Zhang Xuanjing Huang LLMAG 33 11 0 16 Feb 2024
A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts Kuang-Huei Lee Xinyun Chen Hiroki Furuta John F. Canny Ian S. Fischer RALM 44 29 0 15 Feb 2024
Unlimiformer: Long-Range Transformers with Unlimited Length Input Amanda Bertsch Uri Alon Graham Neubig Matthew R. Gormley RALM 94 122 0 02 May 2023
RoR: Read-over-Read for Long Document Machine Reading Comprehension Jing Zhao Junwei Bao Yifan Wang Yongwei Zhou Youzheng Wu Xiaodong He Bowen Zhou AIMat 61 24 0 10 Sep 2021