HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization

16 May 2019

Papers citing "HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization"

50 / 162 papers shown

Title
Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviews M. Hadi Fatemeh H. Fard 13 30 0 12 Apr 2021
Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers and Self-supervised Learning Amaia Salvador Erhan Gundogdu Loris Bazzani M. Donoser ViT 10 57 0 24 Mar 2021
Extractive Summarization of Call Transcripts Pratik K. Biswas Aleksandr Iakubovich 13 10 0 19 Mar 2021
Summaformers @ LaySumm 20, LongSumm 20 Sayar Ghosh Roy Nikhil Pinnaparaju Risubh Jain Manish Gupta Vasudeva Varma 11 14 0 10 Jan 2021
CDLM: Cross-Document Language Modeling Avi Caciularu Arman Cohan Iz Beltagy Matthew E. Peters Arie Cattan Ido Dagan VLM 21 32 0 02 Jan 2021
ERNIE-Doc: A Retrospective Long-Document Modeling Transformer Siyu Ding Junyuan Shang Shuohuan Wang Yu Sun Hao Tian Hua-Hong Wu Haifeng Wang 60 52 0 31 Dec 2020
Toward Transformer-Based Object Detection Josh Beal Eric Kim Eric Tzeng Dong Huk Park Andrew Zhai Dmitry Kislyuk ViT 14 209 0 17 Dec 2020
Open Problems in Cooperative AI Allan Dafoe Edward Hughes Yoram Bachrach Tantum Collins Kevin R. McKee Joel Z. Leibo Kate Larson T. Graepel 21 199 0 15 Dec 2020
Topic-Oriented Spoken Dialogue Summarization for Customer Service with Saliency-Aware Topic Modeling Yicheng Zou Lujun Zhao Yangyang Kang Jun Lin Minlong Peng Zhuoren Jiang Changlong Sun Qi Zhang Xuanjing Huang Xiaozhong Liu 8 51 0 14 Dec 2020
DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank Utterances X. Gu Kang Min Yoo Jung-Woo Ha 18 73 0 03 Dec 2020
FFCI: A Framework for Interpretable Automatic Evaluation of Summarization Fajri Koto Timothy Baldwin Jey Han Lau HILM 19 37 0 27 Nov 2020
AGenT Zero: Zero-shot Automatic Multiple-Choice Question Generation for Skill Assessments Eric Li Jingyi Su Hao Sheng Lawrence Wai 6 2 0 25 Nov 2020
Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT Ruifeng Yuan Zili Wang Wenjie Li 12 22 0 19 Nov 2020
Tabular Transformers for Modeling Multivariate Time Series Inkit Padhi Yair Schiff Igor Melnyk Mattia Rigotti Youssef Mroueh Pierre L. Dognin Jerret Ross Ravi Nair Erik Altman LMTD AI4TS 11 86 0 03 Nov 2020
SLM: Learning a Discourse Language Representation with Sentence Unshuffling Haejun Lee Drew A. Hudson Kangwook Lee Christopher D. Manning SSL 20 50 0 30 Oct 2020
Hierarchical Transformer for Task Oriented Dialog Systems Bishal Santra P. Anusha Pawan Goyal 9 27 0 24 Oct 2020
SciSummPip: An Unsupervised Scientific Paper Summarization Pipeline Jiaxin Ju Ming Liu Longxiang Gao Shirui Pan 58 13 0 19 Oct 2020
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models Xueliang Zhao Wei Yu Wu Can Xu Chongyang Tao Dongyan Zhao Rui Yan 183 191 0 17 Oct 2020
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers Shusheng Xu Xingxing Zhang Yi Wu Furu Wei Ming Zhou 57 44 0 16 Oct 2020
Semantic Label Smoothing for Sequence to Sequence Problems Michal Lukasik Himanshu Jain A. Menon Seungyeon Kim Srinadh Bhojanapalli Felix X. Yu Sanjiv Kumar AI4TS 12 18 0 15 Oct 2020
Re-evaluating Evaluation in Text Summarization Manik Bhandari Pranav Narayan Gour A. Ashfaq Pengfei Liu Graham Neubig 10 175 0 14 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 219 608 0 13 Oct 2020
Enhancing Extractive Text Summarization with Topic-Aware Graph Neural Networks Peng Cui Le Hu Yuanchao Liu 4 64 0 13 Oct 2020
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring Farjana Sultana Mim Naoya Inoue Paul Reisert Hiroki Ouchi Kentaro Inui 11 6 0 13 Oct 2020
Open-sourced Dataset Protection via Backdoor Watermarking Yiming Li Zi-Mou Zhang Jiawang Bai Baoyuan Wu Yong Jiang Shutao Xia 11 38 0 12 Oct 2020
Stepwise Extractive Summarization and Planning with Structured Transformers Shashi Narayan Joshua Maynez Jakub Adamek Daniele Pighin Blavz Bratanivc Ryan T. McDonald 14 30 0 06 Oct 2020
Hierarchical Pre-training for Sequence Labelling in Spoken Dialog E. Chapuis Pierre Colombo Matteo Manica Matthieu Labeau Chloé Clavel 14 57 0 23 Sep 2020
Adjusting for Confounders with Text: Challenges and an Empirical Evaluation Framework for Causal Inference Galen Cassebeer Weld Peter West M. Glenski David Arbour Ryan Rossi Tim Althoff CML 8 20 0 21 Sep 2020
Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models Jihyeon Roh Huiseong Gim Soo-Young Lee 13 1 0 18 Sep 2020
Multi-modal Summarization for Video-containing Documents Xiyan Fu Jun Wang Zhenglu Yang 20 23 0 17 Sep 2020
On Learning Universal Representations Across Languages Xiangpeng Wei Rongxiang Weng Yue Hu Luxi Xing Heng Yu Weihua Luo SSL VLM 25 85 0 31 Jul 2020
SummEval: Re-evaluating Summarization Evaluation Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 38 687 0 24 Jul 2020
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing Zihang Dai Guokun Lai Yiming Yang Quoc V. Le 26 229 0 05 Jun 2020
Deep Learning Models for Automatic Summarization Pirmin Lemberger VLM 8 1 0 25 May 2020
BlaBla: Linguistic Feature Extraction for Clinical Analysis in Multiple Languages Abhishek Shivkumar J. Weston R. Lenain E. Fristed 17 9 0 20 May 2020
From Standard Summarization to New Tasks and Beyond: Summarization with Manifold Information Shen Gao Xiuying Chen Z. Ren Dongyan Zhao Rui Yan 15 48 0 10 May 2020
Discourse-Aware Unsupervised Summarization of Long Scientific Documents Yue Dong Andrei Mircea Jackie C.K. Cheung 13 8 0 01 May 2020
Text Segmentation by Cross Segment Attention Michal Lukasik Boris Dadachev Gonçalo Simões Kishore Papineni VLM 12 81 0 30 Apr 2020
Multiscale Collaborative Deep Models for Neural Machine Translation Xiangpeng Wei Heng Yu Yue Hu Yue Zhang Rongxiang Weng Weihua Luo 19 28 0 29 Apr 2020
Beyond 512 Tokens: Siamese Multi-depth Transformer-based Hierarchical Encoder for Long-Form Document Matching Liu Yang Mingyang Zhang Cheng Li Michael Bendersky Marc Najork 21 86 0 26 Apr 2020
Exploring Explainable Selection to Control Abstractive Summarization Wang Haonan Gao Yang Bai Yu Mirella Lapata Huang Heyan 6 3 0 24 Apr 2020
Extractive Summarization as Text Matching Ming Zhong Pengfei Liu Yiran Chen Danqing Wang Xipeng Qiu Xuanjing Huang 20 458 0 19 Apr 2020
ETC: Encoding Long and Structured Inputs in Transformers Joshua Ainslie Santiago Ontanon Chris Alberti Vaclav Cvicek Zachary Kenneth Fisher Philip Pham Anirudh Ravula Sumit Sanghai Qifan Wang Li Yang 12 54 0 17 Apr 2020
AREDSUM: Adaptive Redundancy-Aware Iterative Sentence Ranking for Extractive Document Summarization Keping Bi Rahul Jha W. Bruce Croft Asli Celikyilmaz 15 21 0 13 Apr 2020
At Which Level Should We Extract? An Empirical Analysis on Extractive Document Summarization Qingyu Zhou Furu Wei Ming Zhou 10 21 0 06 Apr 2020
Pre-training for Abstractive Document Summarization by Reinstating Source Text Yanyan Zou Xingxing Zhang Wei Lu Furu Wei Ming Zhou 28 1 0 04 Apr 2020
Abstractive Summarization with Combination of Pre-trained Sequence-to-Sequence and Saliency Models Itsumi Saito Kyosuke Nishida Kosuke Nishida J. Tomita 20 28 0 29 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,450 0 18 Mar 2020
Learning to Encode Position for Transformer with Continuous Dynamical Model Xuanqing Liu Hsiang-Fu Yu Inderjit Dhillon Cho-Jui Hsieh 6 107 0 13 Mar 2020
Natural Language Processing Advancements By Deep Learning: A Survey A. Torfi Rouzbeh A. Shirvani Yaser Keneshloo Nader Tavvaf Edward A. Fox AI4CE VLM 78 214 0 02 Mar 2020