HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization

Annual Meeting of the Association for Computational Linguistics (ACL), 2019

16 May 2019

Papers citing "HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization"

50 / 167 papers shown

Title
Exploration of Summarization by Generative Language Models for Automated Scoring of Long Essays Haowei Hua Hong Jiao Xinyi Wang 134 0 0 26 Oct 2025
Document Intelligence in the Era of Large Language Models: A Survey Weishi Wang Hengchang Hu Zhijie Zhang Zhaochen Li Hongxin Shao Daniel Dahlmeier AI4TS 144 0 0 15 Oct 2025
Context-Aware Language Models for Forecasting Market Impact from Sequences of Financial News Ross Koval Nicholas Andrews Xifeng Yan AIFin 124 0 0 15 Sep 2025
Low-Resource Language Processing: An OCR-Driven Summarization and Translation Pipeline Hrishit Madhavi Jacob Cherian Yuvraj Khamkar Dhananjay Bhagat VLM 239 1 0 16 May 2025
Bidirectional Linear Recurrent Models for Sequence-Level Multisource Fusion Qisai Liu Zhanhong Jiang Joshua R. Waite Chao Liu Aditya Balu Soumik Sarkar AI4TS 216 0 0 11 Apr 2025
Rethinking Lanes and Points in Complex Scenarios for Monocular 3D Lane DetectionComputer Vision and Pattern Recognition (CVPR), 2025 Yifan Chang Junjie Huang Xiaofeng Wang Yun Ye Zhujin Liang Yi Shan Dalong Du Xingang Wang 3DPC 294 1 0 08 Mar 2025
CoPERLex: Content Planning with Event-based Representations for Legal Case SummarizationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025 T. Y. S. S. Santosh Youssef Farag Matthias Grabmair AILaw ELM 196 2 0 23 Jan 2025
Time Series Language Model for Descriptive Caption GenerationEngineering applications of artificial intelligence (EAAI), 2025 M. Trabelsi Aidan Boyd Jin Cao H. Uzunalioglu AI4TS 154 8 0 03 Jan 2025
Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applications Aditi Godbole Jabin Geevarghese George Smita Shandilya 219 10 0 27 Sep 2024
TempoFormer: A Transformer for Temporally-aware Representations in Change DetectionConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Talia Tseriotou Adam Tsakalidis Maria Liakata 149 1 0 28 Aug 2024
ThinK: Thinner Key Cache by Query-Driven PruningInternational Conference on Learning Representations (ICLR), 2024 Yuhui Xu Zhanming Jie Hanze Dong Lei Wang Xudong Lu Aojun Zhou Amrita Saha Caiming Xiong Doyen Sahoo 428 38 0 30 Jul 2024
A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models Haopeng Zhang Philip S. Yu Jiawei Zhang 256 85 0 17 Jun 2024
Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal DocumentsEuropean Conference on Information Retrieval (ECIR), 2024 Nishchal Prasad M. Boughanem T. Dkaki AILaw ELM 145 10 0 11 Mar 2024
A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods Hanlei Jin Yang Zhang Dan Meng Jun Wang Jinghua Tan 587 164 0 05 Mar 2024
Local and Global Contexts for Conversation Zuoquan Lin Xinyi Shen 129 1 0 31 Jan 2024
Linear Log-Normal Attention with Unbiased ConcentrationInternational Conference on Learning Representations (ICLR), 2023 Yury Nahshan Dor-Joseph Kampeas E. Haleva 214 9 0 22 Nov 2023
Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey Yunpeng Huang Jingwei Xu Junyu Lai Zixu Jiang Taolue Chen ... Xiaoxing Ma Lijuan Yang Zhou Xin Shupeng Li Penghao Zhao LLMAG KELM 298 97 0 21 Nov 2023
HiCL: Hierarchical Contrastive Learning of Unsupervised Sentence Embeddings Zhuofeng Wu Chaowei Xiao V. Vydiswaran 249 3 0 15 Oct 2023
Surveying the Landscape of Text Summarization with Deep Learning: A Comprehensive Review Guanghua Wang Weili Wu AI4TS AILaw 208 8 0 13 Oct 2023
A Hierarchical Neural Framework for Classification and its Explanation in Large Unstructured Legal Documents Nishchal Prasad M. Boughanem Taoufik Dkaki ELM AILaw 182 1 0 19 Sep 2023
RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Shuai Liu Hyundong Justin Cho Marjorie Freedman Xuezhe Ma Jonathan May 129 34 0 12 Jun 2023
MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of VideosComputer Vision and Pattern Recognition (CVPR), 2023 Jielin Qiu Jiacheng Zhu William Jongwon Han Aditesh Kumar Karthik Mittal ... Linjie Li Jianfeng Wang Ding Zhao Bo Li Lijuan Wang VGen 157 12 0 07 Jun 2023
Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought MethodAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yiming Wang Zhuosheng Zhang Rui Wang 210 111 0 22 May 2023
Recent Trends in Unsupervised Summarization Mohammad Khosravani Amine Trabelsi 156 0 0 18 May 2023
A General-Purpose Multilingual Document Encoder Onur Galoglu Robert Litschko Goran Glavaš 167 2 0 11 May 2023
DiffuSum: Generation Enhanced Extractive Summarization with DiffusionAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Haopeng Zhang Xiao Liu Jiawei Zhang DiffM 200 50 0 02 May 2023
Block-wise Bit-Compression of Transformer-based Models Gaochen Dong W. Chen 206 0 0 16 Mar 2023
A Survey on Long Text Modeling with Transformers Zican Dong Tianyi Tang Lunyi Li Wayne Xin Zhao VLM 347 67 0 28 Feb 2023
Modelling Temporal Document Sequences for Clinical ICD CodingConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Clarence Boon Liang Ng Diogo Santos Marek Rei 143 10 0 24 Feb 2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense RetrievalInternational Conference on Learning Representations (ICLR), 2023 Shunyu Zhang Yaobo Liang Ming Gong Daxin Jiang Nan Duan 327 8 0 03 Feb 2023
Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural NetworksConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Antoine Louis Gijs van Dijck Gerasimos Spanakis AILaw 264 11 0 30 Jan 2023
Semi-Structured Object Sequence EncodersConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 V. Rudramurthy Riyaz Ahmad Bhat Chulaka Gunasekara Siva Sankalp Patel H. Wan Tejas I. Dhamecha Danish Contractor Marina Danilevsky 401 0 0 03 Jan 2023
Towards Proactively Forecasting Sentence-Specific Information Popularity within Online News DocumentsACM Conference on Hypertext & Social Media (HT), 2022 Sayar Ghosh Roy Anshul Padhi Risubh Jain Manish Gupta Vasudeva Varma AI4TS 137 2 0 31 Dec 2022
NEEDED: Introducing Hierarchical Transformer to Eye Diseases DiagnosisSDM (SDM), 2022 Xuesong Ye Meng Xiao Zhiyuan Ning Weiwei Dai Wenjuan Cui Yi Du Yuanchun Zhou 227 10 0 27 Dec 2022
HiTSKT: A Hierarchical Transformer Model for Session-Aware Knowledge TracingKnowledge-Based Systems (KBS), 2022 Fucai Ke Weiqing Wang Weicong Tan Lan Du Yuan Jin Yujin Huang Hongzhi Yin AI4Ed 138 36 0 23 Dec 2022
Mortality Prediction Models with Clinical Notes Using Sparse Attention at the Word and Sentence Levels Miguel Rios A. Abu-Hanna 82 1 0 12 Dec 2022
Toward Unifying Text Segmentation and Long Document SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Sangwoo Cho Kaiqiang Song Xiaoyang Wang Fei Liu Dong Yu 181 39 0 28 Oct 2022
Universal Evasion Attacks on Summarization ScoringBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2022 Wenchuan Mu Kwan Hui Lim AAML 203 1 0 25 Oct 2022
TLDW: Extreme Multimodal Summarisation of News Videos Peggy Tang Kun Hu Lei Zhang Jiebo Luo Zhiyong Wang 161 11 0 16 Oct 2022
LSG Attention: Extrapolation of pretrained Transformers to long sequencesPacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2022 Charles Condevaux S. Harispe 156 29 0 13 Oct 2022
EDU-level Extractive Summarization with Varying Summary LengthsFindings (Findings), 2022 Yuping Wu Ching-Hsun Tseng Jia-Yu Shang Shengzhong Mao Goran Nenadic Xiaojun Zeng 194 5 0 08 Oct 2022
Understanding Prior Bias and Choice Paralysis in Transformer-based Language Representation Models through Four Experimental Probes Ke Shen Mayank Kejriwal 167 4 0 03 Oct 2022
Survey of Query-based Text Summarization Hang Yu 118 4 0 17 Sep 2022
Hierarchical Interdisciplinary Topic Detection Model for Research Proposal ClassificationIEEE Transactions on Knowledge and Data Engineering (TKDE), 2022 Meng Xiao Ziyue Qiao Yanjie Fu Hao Dong Yi Du Pengyang Wang Hui Xiong Yuanchun Zhou 360 16 0 16 Sep 2022
Enhancing Semantic Understanding with Self-supervised Methods for Abstractive Dialogue SummarizationInterspeech (Interspeech), 2021 Hyun-Yong Lee Jaewoong Yun Hyunjin Choi Seongho Joe Youngjune Gwon 234 3 0 01 Sep 2022
Exploring Effective Information Utilization in Multi-Turn Topic-Driven Conversations Jiatong Li Bin He Fei Mi 196 4 0 01 Sep 2022
StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content EnhancingAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Xuekai Zhu Jian Guan Shiyu Huang Juan Liu DiffM 208 8 0 29 Aug 2022
GRETEL: Graph Contrastive Topic Enhanced Language Model for Long Document Extractive SummarizationInternational Conference on Computational Linguistics (COLING), 2022 Qianqian Xie Jimin Huang Tulika Saha Sophia Ananiadou 239 32 0 21 Aug 2022
Brand Celebrity Matching Model Based on Natural Language Processing Han Yang Kejian Yang Erhan Zhang 123 1 0 18 Aug 2022
An Efficient Coarse-to-Fine Facet-Aware Unsupervised Summarization Framework based on Semantic BlocksInternational Conference on Computational Linguistics (COLING), 2022 Xinnian Liang Jing Li Shuangzhi Wu Jiali Zeng Yufan Jiang Mu Li Zhoujun Li AI4TS 121 6 0 17 Aug 2022