RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 3,487 papers shown

Title
Tell me what you see: A zero-shot action recognition method based on natural language descriptions Valter Estevam Rayson Laroca David Menotti Hélio Pedrini 25 13 0 18 Dec 2021
Best of Both Worlds: A Hybrid Approach for Multi-Hop Explanation with Declarative Facts Shane Storks Qiaozi Gao Aishwarya N. Reganti Govind Thattai 14 1 0 17 Dec 2021
Sublinear Time Approximation of Text Similarity Matrices Archan Ray Nicholas Monath Andrew McCallum Cameron Musco 20 7 0 17 Dec 2021
Align and Prompt: Video-and-Language Pre-training with Entity Prompts Dongxu Li Junnan Li Hongdong Li Juan Carlos Niebles S. Hoi 20 191 0 17 Dec 2021
ActKnow: Active External Knowledge Infusion Learning for Question Answering in Low Data Regime K. Annervaz Pritam Kumar Nath Ambedkar Dukkipati RALM 8 1 0 17 Dec 2021
Contrastive Vision-Language Pre-training with Limited Resources Quan Cui Boyan Zhou Yu Guo Weidong Yin Hao Wu Osamu Yoshie Yubo Chen VLM CLIP 16 32 0 17 Dec 2021
Neural Architectures for Biological Inter-Sentence Relation Extraction Enrique Noriega-Atala Peter Lovett Clayton T. Morrison Mihai Surdeanu NAI 25 3 0 17 Dec 2021
Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability Kyle Richardson Ashish Sabharwal ReLM LRM 20 24 0 16 Dec 2021
UNIREX: A Unified Learning Framework for Language Model Rationale Extraction Aaron Chan Maziar Sanjabi Lambert Mathias L Tan Shaoliang Nie Xiaochang Peng Xiang Ren Hamed Firooz 36 41 0 16 Dec 2021
Harnessing Cross-lingual Features to Improve Cognate Detection for Low-resource Languages Diptesh Kanojia Raj Dabre Shubham Dewangan P. Bhattacharyya Gholamreza Haffari Malhar A. Kulkarni 10 5 0 16 Dec 2021
Efficient Hierarchical Domain Adaptation for Pretrained Language Models Alexandra Chronopoulou Matthew E. Peters Jesse Dodge 23 42 0 16 Dec 2021
Sharpness-Aware Minimization with Dynamic Reweighting Wenxuan Zhou Fangyu Liu Huan Zhang Muhao Chen AAML 19 8 0 16 Dec 2021
CODER: An efficient framework for improving retrieval through COntextual Document Embedding Reranking George Zerveas Navid Rekabsaz Daniel Cohen Carsten Eickhoff 23 8 0 16 Dec 2021
Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks Akari Asai Matt Gardner Hannaneh Hajishirzi RALM 17 45 0 16 Dec 2021
Knowledge-Augmented Language Models for Cause-Effect Relation Classification Pedram Hosseini David A. Broniatowski Mona T. Diab CML 18 18 0 16 Dec 2021
QuALITY: Question Answering with Long Input Texts, Yes! Richard Yuanzhe Pang Alicia Parrish Nitish Joshi Nikita Nangia Jason Phang ... Vishakh Padmakumar Johnny Ma Jana Thompson He He Sam Bowman RALM 25 141 0 16 Dec 2021
Learning Rich Representation of Keyphrases from Text Mayank Kulkarni Debanjan Mahata Ravneet Arora Rajarshi Bhowmik VLM 19 65 0 16 Dec 2021
ErAConD : Error Annotated Conversational Dialog Dataset for Grammatical Error Correction Xun Yuan Derek Pham Sam Davidson Zhou Yu 11 6 0 15 Dec 2021
Automatic Product Copywriting for E-Commerce Xueying Zhang Yanyan Zou Hainan Zhang Jing Zhou Shiliang Diao ... Xueqi He Yun Xiao Bo Long Han Yu Lingfei Wu 16 27 0 15 Dec 2021
DG2: Data Augmentation Through Document Grounded Dialogue Generation Qingyang Wu Song Feng Derek Chen Sachindra Joshi Luis A. Lastras Zhou Yu 22 13 0 15 Dec 2021
GenIE: Generative Information Extraction Martin Josifoski Nicola De Cao Maxime Peyrard Fabio Petroni Robert West 50 63 0 15 Dec 2021
Evaluating Pretrained Transformer Models for Entity Linking in Task-Oriented Dialog Sai Muralidhar Jayanthi Varsha Embar Karthik Raghunathan 15 6 0 15 Dec 2021
Is "My Favorite New Movie" My Favorite Movie? Probing the Understanding of Recursive Noun Phrases Qing Lyu Hua Zheng Daoxin Li Li Zhang Marianna Apidianaki Chris Callison-Burch 18 4 0 15 Dec 2021
LongT5: Efficient Text-To-Text Transformer for Long Sequences Mandy Guo Joshua Ainslie David C. Uthus Santiago Ontanon Jianmo Ni Yun-hsuan Sung Yinfei Yang VLM 31 307 0 15 Dec 2021
Cross-Domain Generalization and Knowledge Transfer in Transformers Trained on Legal Data Jaromír Šavelka Hannes Westermann Karim Benyekhlef 21 15 0 15 Dec 2021
On the Use of External Data for Spoken Named Entity Recognition Ankita Pasad Felix Wu Suwon Shon Karen Livescu Kyu Jeong Han 32 16 0 14 Dec 2021
Towards Interactive Language Modeling Maartje ter Hoeve Evgeny Kharitonov Dieuwke Hupkes Emmanuel Dupoux 20 4 0 14 Dec 2021
Measuring Fairness with Biased Rulers: A Survey on Quantifying Biases in Pretrained Language Models Pieter Delobelle E. Tokpo T. Calders Bettina Berendt 19 25 0 14 Dec 2021
Text Classification Models for Form Entity Linking M. Villota C. Domínguez Jónathan Heras Eloy J. Mata Vico Pascual MedIm 13 2 0 14 Dec 2021
Conversational Search with Mixed-Initiative -- Asking Good Clarification Questions backed-up by Passage Retrieval Y. Mass Doron Cohen Asaf Yehudai D. Konopnicki 14 3 0 14 Dec 2021
Discovering Explanatory Sentences in Legal Case Decisions Using Pre-trained Language Models Jaromír Šavelka Kevin D. Ashley ELM AILaw 21 10 0 14 Dec 2021
Survey of Generative Methods for Social Media Analysis Stan Matwin Aristides Milios P. Prałat Amílcar Soares Franccois Théberge 13 3 0 13 Dec 2021
VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks Yi-Lin Sung Jaemin Cho Mohit Bansal VLM VPVLM 27 342 0 13 Dec 2021
The King is Naked: on the Notion of Robustness for Natural Language Processing Emanuele La Malfa Marta Z. Kwiatkowska 20 28 0 13 Dec 2021
Roof-Transformer: Divided and Joined Understanding with Knowledge Enhancement Wei-Lin Liao Chengwei Su Wei-Yun Ma 14 0 0 13 Dec 2021
Measuring Context-Word Biases in Lexical Semantic Datasets Qianchu Liu Diana McCarthy Anna Korhonen 23 2 0 13 Dec 2021
Generating Fluent Fact Checking Explanations with Unsupervised Post-Editing Shailza Jolly Pepa Atanasova Isabelle Augenstein 28 13 0 13 Dec 2021
WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models Benjamin Minixhofer Fabian Paischer Navid Rekabsaz 22 72 0 13 Dec 2021
Surfer100: Generating Surveys From Web Resources, Wikipedia-style Irene Z Li Alexander R. Fabbri Rina Kawamura Yixin Liu Xiangru Tang Jaesung Tae Chang Shen Sally Ma Tomoe Mizutani Dragomir R. Radev KELM SyDa 21 6 0 13 Dec 2021
ValueNet: A New Dataset for Human Value Driven Dialogue System Liang Qiu Yizhou Zhao Jinchao Li Pan Lu Baolin Peng Jianfeng Gao Song-Chun Zhu 22 35 0 12 Dec 2021
Topic Detection and Tracking with Time-Aware Document Embeddings Hang Jiang Doug Beeferman Weiquan Mao D. Roy AI4TS 16 1 0 12 Dec 2021
UPV at TREC Health Misinformation Track 2021 Ranking with SBERT and Quality Estimators Ipek Baris Schlicht Angel Felipe Magnossão de Paula Paolo Rosso 23 8 0 11 Dec 2021
Show, Write, and Retrieve: Entity-aware Article Generation and Retrieval Zhongping Zhang Yiwen Gu Bryan A. Plummer 40 2 0 11 Dec 2021
Multimodal Interactions Using Pretrained Unimodal Models for SIMMC 2.0 Joosung Lee Kijong Han 37 6 0 10 Dec 2021
Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasures Eugene Bagdasaryan Vitaly Shmatikov SILM AAML 22 75 0 09 Dec 2021
FLAVA: A Foundational Language And Vision Alignment Model Amanpreet Singh Ronghang Hu Vedanuj Goswami Guillaume Couairon Wojciech Galuba Marcus Rohrbach Douwe Kiela CLIP VLM 38 686 0 08 Dec 2021
Automated Story Generation as Question-Answering Louis Castricato Spencer Frazier John C. Balloch Nitya Tarakad Mark O. Riedl 29 6 0 07 Dec 2021
VAE based Text Style Transfer with Pivot Words Enhancement Learning Haoran Xu Sixing Lu Zhongkai Sun Chengyuan Ma Chenlei Guo 21 10 0 06 Dec 2021
MoCA: Incorporating Multi-stage Domain Pretraining and Cross-guided Multimodal Attention for Textbook Question Answering Fangzhi Xu Qika Lin J. Liu Lingling Zhang Tianzhe Zhao Qianyi Chai Yudai Pan 9 2 0 06 Dec 2021
JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering Yueqing Sun Qi Shi Le Qi Yu Zhang RALM LRM 13 69 0 06 Dec 2021