HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization

16 May 2019

Papers citing "HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization"

50 / 162 papers shown

Title
Bidirectional Linear Recurrent Models for Sequence-Level Multisource Fusion Qisai Liu Zhanhong Jiang Joshua R. Waite Chao Liu Aditya Balu S. Sarkar AI4TS 24 0 0 11 Apr 2025
Rethinking Lanes and Points in Complex Scenarios for Monocular 3D Lane Detection Yifan Chang Junjie Huang Xiaofeng Wang Yun Ye Zhujin Liang Yi Shan Dalong Du Xingang Wang 3DPC 60 0 0 08 Mar 2025
Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applications Aditi Godbole Jabin Geevarghese George Smita Shandilya 17 2 0 27 Sep 2024
TempoFormer: A Transformer for Temporally-aware Representations in Change Detection Talia Tseriotou Adam Tsakalidis Maria Liakata 31 0 0 28 Aug 2024
ThinK: Thinner Key Cache by Query-Driven Pruning Yuhui Xu Zhanming Jie Hanze Dong Lei Wang Xudong Lu Aojun Zhou Amrita Saha Caiming Xiong Doyen Sahoo 67 14 0 30 Jul 2024
A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models Haopeng Zhang Philip S. Yu Jiawei Zhang 35 14 0 17 Jun 2024
Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal Documents Nishchal Prasad M. Boughanem T. Dkaki AILaw ELM 27 5 0 11 Mar 2024
A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods Hanlei Jin Yang Zhang Dan Meng Jun Wang Jinghua Tan 68 79 0 05 Mar 2024
Local and Global Contexts for Conversation Zuoquan Lin Xinyi Shen 11 1 0 31 Jan 2024
Linear Log-Normal Attention with Unbiased Concentration Yury Nahshan Dor-Joseph Kampeas E. Haleva 22 7 0 22 Nov 2023
Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey Yunpeng Huang Jingwei Xu Junyu Lai Zixu Jiang Taolue Chen ... Xiaoxing Ma Lijuan Yang Zhou Xin Shupeng Li Penghao Zhao LLMAG KELM 28 54 0 21 Nov 2023
HiCL: Hierarchical Contrastive Learning of Unsupervised Sentence Embeddings Zhuofeng Wu Chaowei Xiao V. Vydiswaran 15 2 0 15 Oct 2023
Surveying the Landscape of Text Summarization with Deep Learning: A Comprehensive Review Guanghua Wang Weili Wu AI4TS AILaw 33 3 0 13 Oct 2023
A Hierarchical Neural Framework for Classification and its Explanation in Large Unstructured Legal Documents Nishchal Prasad M. Boughanem Taoufik Dkaki ELM AILaw 26 0 0 19 Sep 2023
RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation Shuai Liu Hyundong Justin Cho Marjorie Freedman Xuezhe Ma Jonathan May 25 25 0 12 Jun 2023
MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos Jielin Qiu Jiacheng Zhu William Jongwon Han Aditesh Kumar Karthik Mittal ... Linjie Li Jianfeng Wang Ding Zhao Bo Li Lijuan Wang VGen 14 5 0 07 Jun 2023
Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method Yiming Wang Zhuosheng Zhang Rui Wang 33 78 0 22 May 2023
Recent Trends in Unsupervised Summarization Mohammad Khosravani Amine Trabelsi 29 0 0 18 May 2023
A General-Purpose Multilingual Document Encoder Onur Galoglu Robert Litschko Goran Glavas 29 2 0 11 May 2023
DiffuSum: Generation Enhanced Extractive Summarization with Diffusion Haopeng Zhang Xiao Liu Jiawei Zhang DiffM 63 40 0 02 May 2023
Block-wise Bit-Compression of Transformer-based Models Gaochen Dong W. Chen 10 0 0 16 Mar 2023
A Survey on Long Text Modeling with Transformers Zican Dong Tianyi Tang Lunyi Li Wayne Xin Zhao VLM 19 53 0 28 Feb 2023
Modelling Temporal Document Sequences for Clinical ICD Coding Clarence Boon Liang Ng Diogo Santos Marek Rei 20 8 0 24 Feb 2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval Shunyu Zhang Yaobo Liang Ming Gong Daxin Jiang Nan Duan 21 4 0 03 Feb 2023
Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networks Antoine Louis Gijs van Dijck Gerasimos Spanakis AILaw 21 9 0 30 Jan 2023
Semi-Structured Object Sequence Encoders V. Rudramurthy Riyaz Ahmad Bhat Chulaka Gunasekara Siva Sankalp Patel H. Wan Tejas I. Dhamecha Danish Contractor Marina Danilevsky 59 0 0 03 Jan 2023
Towards Proactively Forecasting Sentence-Specific Information Popularity within Online News Documents Sayar Ghosh Roy Anshul Padhi Risubh Jain Manish Gupta Vasudeva Varma AI4TS 20 2 0 31 Dec 2022
NEEDED: Introducing Hierarchical Transformer to Eye Diseases Diagnosis Xuesong Ye Meng Xiao Zhiyuan Ning Weiwei Dai Wenjuan Cui Yi Du Yuanchun Zhou 25 9 0 27 Dec 2022
HiTSKT: A Hierarchical Transformer Model for Session-Aware Knowledge Tracing Fucai Ke Weiqing Wang Weicong Tan Lan Du Yuan Jin Yujin Huang Hongzhi Yin AI4Ed 11 19 0 23 Dec 2022
Mortality Prediction Models with Clinical Notes Using Sparse Attention at the Word and Sentence Levels Miguel Rios A. Abu-Hanna 6 0 0 12 Dec 2022
Toward Unifying Text Segmentation and Long Document Summarization Sangwoo Cho Kaiqiang Song Xiaoyang Wang Fei Liu Dong Yu 22 33 0 28 Oct 2022
Universal Evasion Attacks on Summarization Scoring Wenchuan Mu Kwan Hui Lim AAML 28 1 0 25 Oct 2022
TLDW: Extreme Multimodal Summarisation of News Videos Peggy Tang Kun Hu Lei Zhang Jiebo Luo Zhiyong Wang 16 9 0 16 Oct 2022
LSG Attention: Extrapolation of pretrained Transformers to long sequences Charles Condevaux S. Harispe 25 24 0 13 Oct 2022
EDU-level Extractive Summarization with Varying Summary Lengths Yuping Wu Ching-Hsun Tseng Jia-Yu Shang Shengzhong Mao Goran Nenadic Xiaojun Zeng 17 4 0 08 Oct 2022
Understanding Prior Bias and Choice Paralysis in Transformer-based Language Representation Models through Four Experimental Probes Ke Shen M. Kejriwal 16 4 0 03 Oct 2022
Survey of Query-based Text Summarization Hang Yu 20 4 0 17 Sep 2022
Hierarchical Interdisciplinary Topic Detection Model for Research Proposal Classification Meng Xiao Ziyue Qiao Yanjie Fu Hao Dong Yi Du Pengyang Wang Hui Xiong Yuanchun Zhou 34 10 0 16 Sep 2022
Enhancing Semantic Understanding with Self-supervised Methods for Abstractive Dialogue Summarization Hyun-Yong Lee Jaewoong Yun Hyunjin Choi Seongho Joe Youngjune Gwon 16 3 0 01 Sep 2022
Exploring Effective Information Utilization in Multi-Turn Topic-Driven Conversations Jiatong Li Bin He Fei Mi 11 3 0 01 Sep 2022
StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancing Xuekai Zhu Jian-Yu Guan Minlie Huang Juan Liu DiffM 14 6 0 29 Aug 2022
GRETEL: Graph Contrastive Topic Enhanced Language Model for Long Document Extractive Summarization Qianqian Xie Jimin Huang Tulika Saha Sophia Ananiadou 27 25 0 21 Aug 2022
Brand Celebrity Matching Model Based on Natural Language Processing Han Yang Kejian Yang Erhan Zhang 23 1 0 18 Aug 2022
An Efficient Coarse-to-Fine Facet-Aware Unsupervised Summarization Framework based on Semantic Blocks Xinnian Liang Jing Li Shuangzhi Wu Jiali Zeng Yufan Jiang Mu Li Zhoujun Li AI4TS 14 6 0 17 Aug 2022
Parallel Hierarchical Transformer with Attention Alignment for Abstractive Multi-Document Summarization Ye Ma Lu Zong 18 0 0 16 Aug 2022
Generating Coherent Narratives by Learning Dynamic and Discrete Entity States with a Contrastive Framework Jian-Yu Guan Zhenyu Yang Rongsheng Zhang Zhipeng Hu Minlie Huang 13 9 0 08 Aug 2022
An Automatic and Efficient BERT Pruning for Edge AI Systems Shaoyi Huang Ning Liu Yueying Liang Hongwu Peng Hongjia Li Dongkuan Xu Mimi Xie Caiwen Ding 20 21 0 21 Jun 2022
RoSGAS: Adaptive Social Bot Detection with Reinforced Self-Supervised GNN Architecture Search Yingguang Yang Renyu Yang Yangyang Li Kai Cui Zhiqin Yang Yue Wang Jie Xu Haiyong Xie 22 45 0 14 Jun 2022
Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning Richard J. Chen Chengkuan Chen Yicong Li Tiffany Y. Chen A. Trister Rahul G. Krishnan Faisal Mahmood ViT MedIm 34 406 0 06 Jun 2022
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection Luca Di Liello Siddhant Garg Luca Soldaini Alessandro Moschitti 11 17 0 20 May 2022