HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization

16 May 2019

Papers citing "HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization"

50 / 162 papers shown

Title
Knowledge-aware Document Summarization: A Survey of Knowledge, Embedding Methods and Architectures Yutong Qu Wei Emma Zhang Jian Yang Lingfei Wu Jia Wu AI4TS 17 7 0 24 Apr 2022
OTExtSum: Extractive Text Summarisation with Optimal Transport Peggy Tang Kun Hu Rui Yan Lei Zhang Junbin Gao Zhiyong Wang OT 8 11 0 21 Apr 2022
Revisiting Transformer-based Models for Long Document Classification Xiang Dai Ilias Chalkidis S. Darkner Desmond Elliott VLM 13 68 0 14 Apr 2022
MHMS: Multimodal Hierarchical Multimedia Summarization Jielin Qiu Jiacheng Zhu Mengdi Xu Franck Dernoncourt Trung Bui Zhaowen Wang Bo-wen Li Ding Zhao Hailin Jin 17 12 0 07 Apr 2022
Discovering material information using hierarchical Reformer model on financial regulatory filings Francois Mercier Makesh Narsimhan AIFin AI4TS 11 0 0 28 Mar 2022
ERNIE-SPARSE: Learning Hierarchical Efficient Transformer Through Regularized Self-Attention Yang Liu Jiaxiang Liu L. Chen Yuxiang Lu Shi Feng Zhida Feng Yu Sun Hao Tian Huancheng Wu Hai-feng Wang 14 9 0 23 Mar 2022
HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarization Shuyang Cao Lu Wang 64 36 0 21 Mar 2022
Read Top News First: A Document Reordering Approach for Multi-Document News Summarization Chao Zhao Tenghao Huang Somnath Basu Roy Chowdhury Muthu Kumar Chandrasekaran Kathleen McKeown Snigdha Chaturvedi MoMe 11 16 0 19 Mar 2022
HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Information Qianqian Ruan Malte Ostendorff Georg Rehm AILaw 20 55 0 17 Mar 2022
Long Document Summarization with Top-down and Bottom-up Inference Bo Pang Erik Nijkamp Wojciech Kry'sciñski Silvio Savarese Yingbo Zhou Caiming Xiong RALM BDL 16 55 0 15 Mar 2022
Hierarchical BERT for Medical Document Understanding Ning Zhang Maciej Jankowski 19 10 0 11 Mar 2022
Who Should Review Your Proposal? Interdisciplinary Topic Path Detection for Research Proposals Meng Xiao Ziyue Qiao Yanjie Fu Hao Dong Yi Du Pengyang Wang Dong Li Yuan-Hong Zhou 37 3 0 07 Mar 2022
SciBERTSUM: Extractive Summarization for Scientific Documents Athar Sefid C. Lee Giles 8 9 0 21 Jan 2022
Pretrained Language Models for Text Generation: A Survey Junyi Li Tianyi Tang Wayne Xin Zhao J. Nie Ji-Rong Wen AI4CE 36 125 0 14 Jan 2022
Adaptive Beam Search to Enhance On-device Abstractive Summarization S. HarichandanaB.S. Sumit Kumar 17 1 0 22 Dec 2021
Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation Raymond Li Wen Xiao Linzi Xing Lanjun Wang Gabriel Murray Giuseppe Carenini ViT 25 7 0 10 Dec 2021
Recommending Multiple Positive Citations for Manuscript via Content-Dependent Modeling and Multi-Positive Triplet Yang Zhang Qiang Ma 12 1 0 25 Nov 2021
DeepHelp: Deep Learning for Shout Crisis Text Conversations D. Cahn AI4MH 11 1 0 25 Oct 2021
Topic-Guided Abstractive Multi-Document Summarization Peng Cui Le Hu 15 39 0 21 Oct 2021
HRKD: Hierarchical Relational Knowledge Distillation for Cross-domain Language Model Compression Chenhe Dong Yaliang Li Ying Shen Minghui Qiu VLM 28 7 0 16 Oct 2021
Modeling Endorsement for Multi-Document Abstractive Summarization Logan Lebanoff Bingqing Wang Z. Feng Fei Liu 108 4 0 15 Oct 2021
HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization Ye Liu Jianguo Zhang Yao Wan Congying Xia Lifang He Philip S. Yu 34 29 0 12 Oct 2021
Iterative Decoding for Compositional Generalization in Transformers Luana Ruiz Joshua Ainslie Santiago Ontañón 22 6 0 08 Oct 2021
Attention Augmented Convolutional Transformer for Tabular Time-series Sharath M. Shankaranarayana D. Runje LMTD AI4TS 58 8 0 05 Oct 2021
Leveraging Information Bottleneck for Scientific Document Summarization Jiaxin Ju Ming Liu Huan Yee Koh Yuan Jin Lan Du Shirui Pan 59 13 0 04 Oct 2021
LawSum: A weakly supervised approach for Indian Legal Document Summarization Vedant Vijay Parikh Vidit Mathur Parth Mehta Namita Mittal Prasenjit Majumder AILaw 25 22 0 04 Oct 2021
Recursively Summarizing Books with Human Feedback Jeff Wu Long Ouyang Daniel M. Ziegler Nissan Stiennon Ryan J. Lowe Jan Leike Paul Christiano ALM 21 294 0 22 Sep 2021
Enriching and Controlling Global Semantics for Text Summarization Thong Nguyen A. Luu Truc Lu Tho Quan 27 34 0 22 Sep 2021
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries Xiangru Tang Alexander R. Fabbri Haoran Li Ziming Mao Griffin Adams Borui Wang Asli Celikyilmaz Yashar Mehdad Dragomir R. Radev HILM 13 19 0 19 Sep 2021
MeLT: Message-Level Transformer with Masked Document Representations as Pre-Training for Stance Detection Matthew Matero Nikita Soni Niranjan Balasubramanian H. A. Schwartz 23 21 0 16 Sep 2021
Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization Junpeng Liu Yanyan Zou Hainan Zhang Hongshen Chen Zhuoye Ding Caixia Yuan Xiaojie Wang 6 64 0 10 Sep 2021
Low-Resource Dialogue Summarization with Domain-Agnostic Multi-Source Pretraining Yicheng Zou Bolin Zhu Xingwu Hu Tao Gui Qi Zhang 78 31 0 09 Sep 2021
Code-switched inspired losses for generic spoken dialog representations E. Chapuis Pierre Colombo Matthieu Labeau Chloe Clave 19 12 0 27 Aug 2021
Making Transformers Solve Compositional Tasks Santiago Ontañón Joshua Ainslie Vaclav Cvicek Zachary Kenneth Fisher 33 70 0 09 Aug 2021
MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processes Nianlong Gu Elliott Ash Richard H. R. Hahnloser RALM 18 33 0 19 Jul 2021
A Sentence-level Hierarchical BERT Model for Document Classification with Limited Labelled Data Jinghui Lu M. Henchion Ivan Bacher Brian Mac Namee VLM 14 22 0 12 Jun 2021
A Survey of Transformers Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 27 1,086 0 08 Jun 2021
Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling Chuhan Wu Fangzhao Wu Tao Qi Yongfeng Huang 8 65 0 02 Jun 2021
VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groups Zejiang Shen Kyle Lo Lucy Lu Wang Bailey Kuehl Daniel S. Weld Doug Downey VLM 16 34 0 01 Jun 2021
Iterative Hierarchical Attention for Answering Complex Questions over Long Documents Haitian Sun William W. Cohen Ruslan Salakhutdinov 19 12 0 01 Jun 2021
Controllable Abstractive Dialogue Summarization with Sketch Supervision C. Wu Linqing Liu Wenhao Liu Pontus Stenetorp Caiming Xiong 11 52 0 28 May 2021
Towards mental time travel: a hierarchical memory for reinforcement learning agents Andrew Kyle Lampinen Stephanie C. Y. Chan Andrea Banino Felix Hill 16 47 0 28 May 2021
Nested Hierarchical Transformer: Towards Accurate, Data-Efficient and Interpretable Visual Understanding Zizhao Zhang Han Zhang Long Zhao Ting Chen Sercan Ö. Arik Tomas Pfister ViT 17 169 0 26 May 2021
Pretrained Language Models for Text Generation: A Survey Junyi Li Tianyi Tang Wayne Xin Zhao Ji-Rong Wen LM&MA VLM SyDa 30 183 0 21 May 2021
Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence Jian-Yu Guan Xiaoxi Mao Changjie Fan Zitao Liu Wenbiao Ding Minlie Huang AuLLM 21 77 0 19 May 2021
EASE: Extractive-Abstractive Summarization with Explanations Haoran Li Arash Einolghozati Srini Iyer Bhargavi Paranjape Yashar Mehdad Sonal Gupta Marjan Ghazvininejad 21 9 0 14 May 2021
ReadTwice: Reading Very Large Documents with Memories Yury Zemlyanskiy Joshua Ainslie Michiel de Jong Philip Pham Ilya Eckstein Fei Sha AIMat RALM 14 17 0 10 May 2021
Long-Span Summarization via Local Attention and Content Selection Potsawee Manakul Mark J. F. Gales 13 42 0 08 May 2021
Three-level Hierarchical Transformer Networks for Long-sequence and Multiple Clinical Documents Classification Yuqi Si Kirk Roberts 11 9 0 17 Apr 2021
Predicting Discourse Trees from Transformer-based Neural Summarizers Wen Xiao Patrick Huber Giuseppe Carenini 21 14 0 14 Apr 2021