MASS: Masked Sequence to Sequence Pre-training for Language Generation

7 May 2019

Xu Tan

Papers citing "MASS: Masked Sequence to Sequence Pre-training for Language Generation"

50 / 203 papers shown

Title
A Well-Composed Text is Half Done! Composition Sampling for Diverse Conditional Generation Shashi Narayan Gonccalo Simoes Yao-Min Zhao Joshua Maynez Dipanjan Das Michael Collins Mirella Lapata 29 30 0 28 Mar 2022
ANNA: Enhanced Language Representation for Question Answering Changwook Jun Hansol Jang Myoseop Sim Hyun Kim Jooyoung Choi Kyungkoo Min Kyunghoon Bae 29 6 0 28 Mar 2022
EAG: Extract and Generate Multi-way Aligned Corpus for Complete Multi-lingual Neural Machine Translation Yulin Xu Zhen Yang Fandong Meng JieZhou 25 3 0 04 Mar 2022
Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few Shots Wenting Zhao Ye Liu Yao Wan Philip S. Yu 21 11 0 01 Mar 2022
Using natural language prompts for machine translation Xavier Garcia Orhan Firat AI4CE 25 30 0 23 Feb 2022
What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code Yao Wan Wei-Ye Zhao Hongyu Zhang Yulei Sui Guandong Xu Hairong Jin 32 105 0 14 Feb 2022
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework Peng Wang An Yang Rui Men Junyang Lin Shuai Bai Zhikang Li Jianxin Ma Chang Zhou Jingren Zhou Hongxia Yang MLLM ObjD 53 850 0 07 Feb 2022
Neural Grapheme-to-Phoneme Conversion with Pre-trained Grapheme Models Lu Dong Zhiyuan Guo Chao-Hong Tan Ya-Jun Hu Yuan Jiang Zhenhua Ling 30 11 0 26 Jan 2022
Linguistically-driven Multi-task Pre-training for Low-resource Neural Machine Translation Zhuoyuan Mao Chenhui Chu Sadao Kurohashi 17 6 0 20 Jan 2022
Improving Neural Machine Translation by Denoising Training Liang Ding Keqin Peng Dacheng Tao VLM AI4CE 35 6 0 19 Jan 2022
Assemble Foundation Models for Automatic Code Summarization Jian Gu P. Salza H. Gall 33 34 0 13 Jan 2022
Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning Aditya Siddhant Ankur Bapna Orhan Firat Yuan Cao M. Chen Isaac Caswell Xavier Garcia ELM LRM 31 29 0 09 Jan 2022
A Survey of Natural Language Generation Chenhe Dong Hai-Tao Zheng Haifan Gong M. Chen Junxin Li Ying Shen Min Yang 3DV 24 43 0 22 Dec 2021
Domain Adaptation with Pre-trained Transformers for Query Focused Abstractive Text Summarization Md Tahmid Rahman Laskar Enamul Hoque J. Huang 33 45 0 22 Dec 2021
Diaformer: Automatic Diagnosis via Symptoms Sequence Generation Junying Chen Dongfang Li Qingcai Chen Wenxiu Zhou Xin Liu MedIm 25 30 0 20 Dec 2021
May the Force Be with Your Copy Mechanism: Enhanced Supervised-Copy Method for Natural Language Generation Sanghyuk Choi J. Hwang Hyungjong Noh Yeonsoo Lee 20 3 0 20 Dec 2021
Data Augmentation for Mental Health Classification on Social Media Gunjan Ansari Muskan Garg Chandni Saxena 36 19 0 19 Dec 2021
Automatic Product Copywriting for E-Commerce Xueying Zhang Yanyan Zou Hainan Zhang Jing Zhou Shiliang Diao ... Xueqi He Yun Xiao Bo Long Han Yu Lingfei Wu 19 27 0 15 Dec 2021
Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasures Eugene Bagdasaryan Vitaly Shmatikov SILM AAML 24 76 0 09 Dec 2021
Transformer-based Korean Pretrained Language Models: A Survey on Three Years of Progress Kichang Yang KELM VLM 29 11 0 25 Nov 2021
Dialogue Inspectional Summarization with Factual Inconsistency Awareness Leilei Gan Yating Zhang Kun Kuang Lin Yuan Shuo Li Changlong Sun Xiaozhong Liu Fei Wu HILM 17 4 0 05 Nov 2021
OpenPrompt: An Open-source Framework for Prompt-learning Ning Ding Shengding Hu Weilin Zhao Yulin Chen Zhiyuan Liu Haitao Zheng Maosong Sun VLM LLMAG 25 284 0 03 Nov 2021
Empirical Analysis of Korean Public AI Hub Parallel Corpora and in-depth Analysis using LIWC Chanjun Park Midan Shim Sugyeong Eo Seolhwa Lee Jaehyung Seo Hyeonseok Moon Heuiseok Lim 11 8 0 28 Oct 2021
Interpreting Deep Learning Models in Natural Language Processing: A Review Xiaofei Sun Diyi Yang Xiaoya Li Tianwei Zhang Yuxian Meng Han Qiu Guoyin Wang Eduard H. Hovy Jiwei Li 17 44 0 20 Oct 2021
GNN-LM: Language Modeling based on Global Contexts via GNN Yuxian Meng Shi Zong Xiaoya Li Xiaofei Sun Tianwei Zhang Fei Wu Jiwei Li LRM 16 37 0 17 Oct 2021
End-to-End Segmentation-based News Summarization Yang Liu Chenguang Zhu Michael Zeng VLM 38 26 0 15 Oct 2021
Unsupervised Neural Machine Translation with Generative Language Models Only Jesse Michael Han Igor Babuschkin Harrison Edwards Arvind Neelakantan Tao Xu ... Alex Ray Pranav Shyam Aditya A. Ramesh Alec Radford Ilya Sutskever 47 36 0 11 Oct 2021
Advances in Multi-turn Dialogue Comprehension: A Survey Zhuosheng Zhang Hai Zhao 21 21 0 11 Oct 2021
Self-Supervised Knowledge Assimilation for Expert-Layman Text Style Transfer Wenda Xu Michael Stephen Saxon Misha Sra Luu Anh Tuan MedIm 13 13 0 06 Oct 2021
Unsupervised Translation of German--Lower Sorbian: Exploring Training and Novel Transfer Methods on a Low-Resource Language Lukas Edman A. Ustun Antonio Toral Gertjan van Noord 8 6 0 24 Sep 2021
Enriching and Controlling Global Semantics for Text Summarization Thong Nguyen A. Luu Truc Lu Tho Quan 27 34 0 22 Sep 2021
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries Xiangru Tang Alexander R. Fabbri Haoran Li Ziming Mao Griffin Adams Borui Wang Asli Celikyilmaz Yashar Mehdad Dragomir R. Radev HILM 13 19 0 19 Sep 2021
Improving Unsupervised Question Answering via Summarization-Informed Question Generation Chenyang Lyu Lifeng Shang Yvette Graham Jennifer Foster Xin Jiang Qun Liu 21 44 0 16 Sep 2021
Multilingual Translation via Grafting Pre-trained Language Models Zewei Sun Mingxuan Wang Lei Li AI4CE 188 22 0 11 Sep 2021
AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languages Machel Reid Junjie Hu Graham Neubig Y. Matsuo 77 31 0 10 Sep 2021
HintedBT: Augmenting Back-Translation with Quality and Transliteration Hints Sahana Ramnath Melvin Johnson Abhirut Gupta A. Raghuveer 45 8 0 09 Sep 2021
Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inference Xiaoyu Yang Xiao-Dan Zhu Zhan Shi Tianda Li SSL 11 1 0 08 Sep 2021
Paraphrase Generation as Unsupervised Machine Translation Xiaofei Sun Yufei Tian Yuxian Meng Nanyun Peng Fei Wu Jiwei Li Chun Fan LRM 16 5 0 07 Sep 2021
Frustratingly Simple Pretraining Alternatives to Masked Language Modeling Atsuki Yamaguchi G. Chrysostomou Katerina Margatina Nikolaos Aletras 27 25 0 04 Sep 2021
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq R. Joty S. Hoi 235 1,489 0 02 Sep 2021
Survey of Low-Resource Machine Translation Barry Haddow Rachel Bawden Antonio Valerio Miceli Barone Jindvrich Helcl Alexandra Birch AIMat 31 147 0 01 Sep 2021
Sentence Bottleneck Autoencoders from Transformer Language Models Ivan Montero Nikolaos Pappas Noah A. Smith AI4CE 17 28 0 31 Aug 2021
MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER Ran Zhou Xin Li Ruidan He Lidong Bing Erik Cambria Luo Si Chun Miao 34 95 0 31 Aug 2021
Scheduled Sampling Based on Decoding Steps for Neural Machine Translation Yijin Liu Fandong Meng Yufeng Chen Jinan Xu Jie Zhou 25 16 0 30 Aug 2021
Enhanced Seq2Seq Autoencoder via Contrastive Learning for Abstractive Text Summarization Chujie Zheng Kunpeng Zhang Harry J. Wang Ling Fan Zhe Wang 25 6 0 26 Aug 2021
Alleviating Exposure Bias via Contrastive Learning for Abstractive Text Summarization Shichao Sun Wenjie Li 19 26 0 26 Aug 2021
Auxiliary Task Update Decomposition: The Good, The Bad and The Neutral Lucio Dery Yann N. Dauphin David Grangier MoMe 13 29 0 25 Aug 2021
Regularizing Transformers With Deep Probabilistic Layers Aurora Cobo Aguilera Pablo Martínez Olmos Antonio Artés-Rodríguez Fernando Pérez-Cruz 26 7 0 23 Aug 2021
MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation Pan Xie Zexian Li Xiaohui Hu 31 11 0 19 Aug 2021
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining Machel Reid Mikel Artetxe VLM 42 26 0 04 Aug 2021