A Survey on Long Text Modeling with Transformers

A Survey on Long Text Modeling with Transformers

28 February 2023

Papers citing "A Survey on Long Text Modeling with Transformers"

16 / 16 papers shown

Title
CrossFormer: Cross-Segment Semantic Fusion for Document Segmentation Tongke Ni Yang Fan Junru Zhou Xiangping Wu Qingcai Chen 41 0 0 31 Mar 2025
Large Language Models for Automatic Milestone Detection in Group Discussions Zhuoxu Duan Zhengye Yang Samuel Westby Christoph Riedl B. F. Welles Richard J. Radke 21 0 0 16 Jun 2024
Identifying Narrative Patterns and Outliers in Holocaust Testimonies Using Topic Modeling Maxim Ifergan Renana Keydar Omri Abend Amit Pinchevski 21 0 0 04 May 2024
Apollonion: Profile-centric Dialog Agent Shangyu Chen Zibo Zhao Yuanyuan Zhao Xiang Li LLMAG 32 1 0 10 Apr 2024
NovelQA: Benchmarking Question Answering on Documents Exceeding 200K Tokens Cunxiang Wang Ruoxi Ning Boqi Pan Tonghui Wu Qipeng Guo ... Guangsheng Bao Xiangkun Hu Zheng Zhang Qian Wang Yue Zhang RALM 69 3 0 18 Mar 2024
Action-Item-Driven Summarization of Long Meeting Transcripts Logan Golia Jugal Kalita 11 1 0 29 Dec 2023
MemGPT: Towards LLMs as Operating Systems Charles Packer Sarah Wooders Kevin Lin Vivian Fang Shishir G. Patil Ion Stoica Joseph E. Gonzalez RALM 15 126 0 12 Oct 2023
An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification Ilias Chalkidis Xiang Dai Manos Fergadiotis Prodromos Malakasiotis Desmond Elliott 30 33 0 11 Oct 2022
An Empirical Survey on Long Document Summarization: Datasets, Models and Metrics Huan Yee Koh Jiaxin Ju Ming Liu Shirui Pan 73 120 0 03 Jul 2022
HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarization Shuyang Cao Lu Wang 64 36 0 21 Mar 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
RoR: Read-over-Read for Long Document Machine Reading Comprehension Jing Zhao Junwei Bao Yifan Wang Yongwei Zhou Youzheng Wu Xiaodong He Bowen Zhou AIMat 69 24 0 10 Sep 2021
Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems Potsawee Manakul Mark J. F. Gales 11 5 0 08 Sep 2021
ERNIE-Doc: A Retrospective Long-Document Modeling Transformer Siyu Ding Junyuan Shang Shuohuan Wang Yu Sun Hao Tian Hua-Hong Wu Haifeng Wang 60 52 0 31 Dec 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 249 1,982 0 28 Jul 2020
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models Sandeep Subramanian Raymond Li Jonathan Pilault C. Pal 223 212 0 07 Sep 2019