HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization

Annual Meeting of the Association for Computational Linguistics (ACL), 2019

16 May 2019

Papers citing "HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization"

50 / 167 papers shown

Title
Long Text Generation by Modeling Sentence-Level and Discourse-Level CoherenceAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Jian Guan Xiaoxi Mao Changjie Fan Zitao Liu Wenbiao Ding Shiyu Huang AuLLM 169 89 0 19 May 2021
EASE: Extractive-Abstractive Summarization with Explanations Haoran Li Arash Einolghozati Srini Iyer Bhargavi Paranjape Yashar Mehdad Sonal Gupta Marjan Ghazvininejad 84 13 0 14 May 2021
ReadTwice: Reading Very Large Documents with MemoriesNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Yury Zemlyanskiy Joshua Ainslie Michiel de Jong Philip Pham Ilya Eckstein Fei Sha AIMat RALM 191 18 0 10 May 2021
Long-Span Summarization via Local Attention and Content SelectionAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Potsawee Manakul Mark Gales 169 45 0 08 May 2021
Three-level Hierarchical Transformer Networks for Long-sequence and Multiple Clinical Documents Classification Yuqi Si Kirk Roberts 154 9 0 17 Apr 2021
Predicting Discourse Trees from Transformer-based Neural SummarizersNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Wen Xiao Patrick Huber Giuseppe Carenini 116 17 0 14 Apr 2021
Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-ReviewsEmpirical Software Engineering (EMSE), 2021 M. Hadi Fatemeh H. Fard 280 38 0 12 Apr 2021
Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers and Self-supervised LearningComputer Vision and Pattern Recognition (CVPR), 2021 Amaia Salvador Erhan Gundogdu Loris Bazzani M. Donoser ViT 220 66 0 24 Mar 2021
Extractive Summarization of Call TranscriptsIEEE Access (IEEE Access), 2021 Pratik K. Biswas Aleksandr Iakubovich 160 15 0 19 Mar 2021
Summaformers @ LaySumm 20, LongSumm 20 Sayar Ghosh Roy Nikhil Pinnaparaju Risubh Jain Manish Gupta Vasudeva Varma 136 14 0 10 Jan 2021
CDLM: Cross-Document Language ModelingConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Avi Caciularu Arman Cohan Iz Beltagy Matthew E. Peters Arie Cattan Ido Dagan VLM 224 34 0 02 Jan 2021
ERNIE-Doc: A Retrospective Long-Document Modeling TransformerAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Siyu Ding Junyuan Shang Shuohuan Wang Yu Sun Hao Tian Hua Wu Haifeng Wang 245 62 0 31 Dec 2020
Toward Transformer-Based Object Detection Josh Beal Eric Kim Eric Tzeng Dong Huk Park Andrew Zhai Dmitry Kislyuk ViT 232 241 0 17 Dec 2020
Open Problems in Cooperative AI Allan Dafoe Edward Hughes Yoram Bachrach Tantum Collins Kevin R. McKee Joel Z Leibo Kate Larson T. Graepel 331 229 0 15 Dec 2020
Topic-Oriented Spoken Dialogue Summarization for Customer Service with Saliency-Aware Topic ModelingAAAI Conference on Artificial Intelligence (AAAI), 2020 Yicheng Zou Lujun Zhao Yangyang Kang Jun Lin Minlong Peng Zhuoren Jiang Changlong Sun Tao Gui Xuanjing Huang Xiaozhong Liu 190 63 0 14 Dec 2020
DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank UtterancesAAAI Conference on Artificial Intelligence (AAAI), 2020 X. Gu Kang Min Yoo Jung-Woo Ha 290 76 0 03 Dec 2020
FFCI: A Framework for Interpretable Automatic Evaluation of SummarizationJournal of Artificial Intelligence Research (JAIR), 2020 Fajri Koto Timothy Baldwin Jey Han Lau HILM 211 40 0 27 Nov 2020
AGenT Zero: Zero-shot Automatic Multiple-Choice Question Generation for Skill Assessments Eric Li Jingyi Su Hao Sheng Lawrence Wai 181 3 0 25 Nov 2020
Fact-level Extractive Summarization with Hierarchical Graph Mask on BERTInternational Conference on Computational Linguistics (COLING), 2020 Ruifeng Yuan Zili Wang Wenjie Li 139 24 0 19 Nov 2020
Tabular Transformers for Modeling Multivariate Time Series Inkit Padhi Yair Schiff Igor Melnyk Mattia Rigotti Youssef Mroueh Pierre Dognin Jerret Ross Ravi Nair Erik Altman LMTD AI4TS 269 110 0 03 Nov 2020
SLM: Learning a Discourse Language Representation with Sentence UnshufflingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Haejun Lee Drew A. Hudson Kangwook Lee Christopher D. Manning SSL 187 53 0 30 Oct 2020
Hierarchical Transformer for Task Oriented Dialog SystemsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2020 Bishal Santra P. Anusha Pawan Goyal 161 29 0 24 Oct 2020
SciSummPip: An Unsupervised Scientific Paper Summarization Pipeline Jiaxin Ju Ming Liu Longxiang Gao Shirui Pan 213 14 0 19 Oct 2020
Knowledge-Grounded Dialogue Generation with Pre-trained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Xueliang Zhao Wei Wu Can Xu Chongyang Tao Dongyan Zhao Rui Yan 383 201 0 17 Oct 2020
Unsupervised Extractive Summarization by Pre-training Hierarchical TransformersFindings (Findings), 2020 Shusheng Xu Xingxing Zhang Yi Wu Furu Wei Ming Zhou 174 45 0 16 Oct 2020
Semantic Label Smoothing for Sequence to Sequence Problems Michal Lukasik Himanshu Jain A. Menon Seungyeon Kim Srinadh Bhojanapalli Felix X. Yu Sanjiv Kumar AI4TS 120 18 0 15 Oct 2020
Re-evaluating Evaluation in Text Summarization Manik Bhandari Pranav Narayan Gour A. Ashfaq Pengfei Liu Graham Neubig 269 198 0 14 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 673 694 0 13 Oct 2020
Enhancing Extractive Text Summarization with Topic-Aware Graph Neural Networks Peng Cui Le Hu Yuanchao Liu 164 74 0 13 Oct 2020
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring Farjana Sultana Mim Naoya Inoue Paul Reisert Hiroki Ouchi Kentaro Inui 100 8 0 13 Oct 2020
Open-sourced Dataset Protection via Backdoor Watermarking Yiming Li Zi-Mou Zhang Jiawang Bai Baoyuan Wu Yong Jiang Shutao Xia 195 46 0 12 Oct 2020
Stepwise Extractive Summarization and Planning with Structured Transformers Shashi Narayan Joshua Maynez Jakub Adamek Daniele Pighin Blavz Bratanivc Ryan T. McDonald 167 32 0 06 Oct 2020
Hierarchical Pre-training for Sequence Labelling in Spoken DialogFindings (Findings), 2020 E. Chapuis Pierre Colombo Matteo Manica Matthieu Labeau Chloé Clavel 413 64 0 23 Sep 2020
Adjusting for Confounders with Text: Challenges and an Empirical Evaluation Framework for Causal InferenceInternational Conference on Web and Social Media (ICWSM), 2020 Galen Cassebeer Weld Peter West M. Glenski David Arbour Ryan Rossi Tim Althoff CML 236 23 0 21 Sep 2020
Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models Jihyeon Roh Huiseong Gim Soo-Young Lee 106 1 0 18 Sep 2020
Multi-modal Summarization for Video-containing Documents Xiyan Fu Jun Wang Zhenglu Yang 134 26 0 17 Sep 2020
On Learning Universal Representations Across LanguagesInternational Conference on Learning Representations (ICLR), 2020 Xiangpeng Wei Rongxiang Weng Yue Hu Luxi Xing Heng Yu Weihua Luo SSL VLM 358 90 0 31 Jul 2020
SummEval: Re-evaluating Summarization EvaluationTransactions of the Association for Computational Linguistics (TACL), 2020 Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 466 850 0 24 Jul 2020
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing Zihang Dai Guokun Lai Yiming Yang Quoc V. Le 244 255 0 05 Jun 2020
Deep Learning Models for Automatic Summarization Pirmin Lemberger VLM 101 2 0 25 May 2020
BlaBla: Linguistic Feature Extraction for Clinical Analysis in Multiple Languages Abhishek Shivkumar J. Weston R. Lenain E. Fristed 91 9 0 20 May 2020
From Standard Summarization to New Tasks and Beyond: Summarization with Manifold Information Shen Gao Preslav Nakov Zhaochun Ren Dongyan Zhao Rui Yan 164 47 0 10 May 2020
Discourse-Aware Unsupervised Summarization of Long Scientific Documents Yue Dong Andrei Mircea Jackie C.K. Cheung 178 8 0 01 May 2020
Text Segmentation by Cross Segment AttentionConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Michal Lukasik Boris Dadachev Gonçalo Simões Kishore Papineni VLM 161 98 0 30 Apr 2020
Multiscale Collaborative Deep Models for Neural Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Xiangpeng Wei Heng Yu Yue Hu Yue Zhang Rongxiang Weng Weihua Luo 203 29 0 29 Apr 2020
Beyond 512 Tokens: Siamese Multi-depth Transformer-based Hierarchical Encoder for Long-Form Document MatchingInternational Conference on Information and Knowledge Management (CIKM), 2020 Liu Yang Mingyang Zhang Cheng Li Michael Bendersky Marc Najork 227 94 0 26 Apr 2020
Exploring Explainable Selection to Control Abstractive Summarization Wang Haonan Gao Yang Bai Yu Mirella Lapata Huang Heyan 164 3 0 24 Apr 2020
Extractive Summarization as Text MatchingAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Ming Zhong Pengfei Liu Yiran Chen Danqing Wang Xipeng Qiu Xuanjing Huang 231 490 0 19 Apr 2020
ETC: Encoding Long and Structured Inputs in Transformers Joshua Ainslie Santiago Ontanon Chris Alberti Vaclav Cvicek Zachary Kenneth Fisher Philip Pham Anirudh Ravula Sumit Sanghai Qifan Wang Li Yang 291 56 0 17 Apr 2020
AREDSUM: Adaptive Redundancy-Aware Iterative Sentence Ranking for Extractive Document SummarizationConference of the European Chapter of the Association for Computational Linguistics (EACL), 2020 Keping Bi Rahul Jha W. Bruce Croft Asli Celikyilmaz 164 23 0 13 Apr 2020