RoBERTa: A Robustly Optimized BERT Pretraining Approach

26 July 2019

Luke Zettlemoyer

Papers citing "RoBERTa: A Robustly Optimized BERT Pretraining Approach"

50 / 3,487 papers shown

Title
Measuring Retrieval Complexity in Question Answering Systems Matteo Gabburo Nicolaas Paul Jedema Siddhant Garg Leonardo F. R. Ribeiro Alessandro Moschitti 39 0 0 05 Jun 2024
Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation Hao Li Yuping Wu Viktor Schlegel R. Batista-Navarro Tharindu Madusanka ... Jiayan Zeng Xiaochi Wang Xinran He Yizhi Li Goran Nenadic 31 6 0 05 Jun 2024
Space Decomposition for Sentence Embedding Wuttikorn Ponwitayarat Peerat Limkonchotiwat E. Chuangsuwanich Sarana Nutanong 24 0 0 05 Jun 2024
Balancing Performance and Efficiency in Zero-shot Robotic Navigation Dmytro Kuzmenko N. Shvai LM&Ro 27 0 0 05 Jun 2024
Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Models Jiexin Wang Adam Jatowt Yi Cai AI4CE 35 1 0 04 Jun 2024
Deciphering Oracle Bone Language with Diffusion Models Haisu Guan Huanxin Yang Xinyu Wang Shengwei Han Yongge Liu Lianwen Jin Xiang Bai Y. Liu AAML AI4CE 85 7 0 02 Jun 2024
Multimodal Metadata Assignment for Cultural Heritage Artifacts Luis Rei Dunja Mladenić M. Dorozynski Franz Rottensteiner Thomas Schleider Raphael Troncy J. Lozano Mar Gaitán Salvatella 29 6 0 01 Jun 2024
CONFINE: Conformal Prediction for Interpretable Neural Networks Linhui Huang S. Lala N. Jha 65 2 0 01 Jun 2024
RoBERTa-BiLSTM: A Context-Aware Hybrid Model for Sentiment Analysis Md. Mostafizer Rahman Ariful Islam Shiplu Yutaka Watanobe Md. Ashad Alam 23 10 0 01 Jun 2024
Entangled Relations: Leveraging NLI and Meta-analysis to Enhance Biomedical Relation Extraction William Hogan Jingbo Shang 13 0 0 31 May 2024
1st Place Solution to Odyssey Emotion Recognition Challenge Task1: Tackling Class Imbalance Problem Mingjie Chen Hezhao Zhang Yuanchao Li Jiachen Luo Wen Wu ... Lin Wang P. Woodland Xie Chen Huy P Phan Thomas Hain 23 0 0 30 May 2024
Unlearning Climate Misinformation in Large Language Models Michael Fore Simranjit Singh Chaehong Lee Amritanshu Pandey Antonios Anastasopoulos Dimitrios Stamoulis MU 52 1 0 29 May 2024
Don't Forget to Connect! Improving RAG with Graph-based Reranking Jialin Dong Bahare Fatemi Bryan Perozzi Lin F. Yang Anton Tsitsulin 50 24 0 28 May 2024
VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections Roy Miles Pradyumna Reddy Ismail Elezi Jiankang Deng VLM 32 3 0 28 May 2024
FAIIR: Building Toward A Conversational AI Agent Assistant for Youth Mental Health Service Provision Stephen Obadinma Alia Lachana M. Norman Jocelyn Rankin Joanna Yu Xiaodan Zhu Darren Mastropaolo D. Pandya Roxana Sultan Elham Dolatabadi AI4MH 28 1 0 28 May 2024
Exploiting the Layered Intrinsic Dimensionality of Deep Models for Practical Adversarial Training Enes Altinisik Safa Messaoud H. Sencar Hassan Sajjad Sanjay Chawla AAML 43 0 0 27 May 2024
Tokenization Matters! Degrading Large Language Models through Challenging Their Tokenization Dixuan Wang Yanda Li Junyuan Jiang Zepeng Ding Ziqin Luo Guochao Jiang Jiaqing Liang Deqing Yang 27 11 0 27 May 2024
SoK: Leveraging Transformers for Malware Analysis Pradip Kunwar Kshitiz Aryal Maanak Gupta Mahmoud Abdelsalam Elisa Bertino 90 0 0 27 May 2024
A Preliminary Empirical Study on Prompt-based Unsupervised Keyphrase Extraction Mingyang Song Yi Feng Liping Jing 51 2 0 26 May 2024
Generating clickbait spoilers with an ensemble of large language models M. Woźny Mateusz Lango 21 1 0 25 May 2024
How Well Do Deep Learning Models Capture Human Concepts? The Case of the Typicality Effect Siddhartha K. Vemuri Raj Sanjay Shah Sashank Varma VLM 29 4 0 25 May 2024
GPT is Not an Annotator: The Necessity of Human Annotation in Fairness Benchmark Construction Virginia K. Felkner Jennifer A. Thompson Jonathan May 41 9 0 24 May 2024
CHARP: Conversation History AwaReness Probing for Knowledge-grounded Dialogue Systems Abbas Ghaddar David Alfonso-Hermelo Philippe Langlais Mehdi Rezagholizadeh Boxing Chen Prasanna Parthasarathi 34 0 0 24 May 2024
What Do You See? Enhancing Zero-Shot Image Classification with Multimodal Large Language Models Abdelrahman Abdelhamed Mahmoud Afifi Alec Go MLLM VLM 31 3 0 24 May 2024
The Mosaic Memory of Large Language Models Igor Shilov Matthieu Meeus Yves-Alexandre de Montjoye 39 3 0 24 May 2024
A Nurse is Blue and Elephant is Rugby: Cross Domain Alignment in Large Language Models Reveal Human-like Patterns Asaf Yehudai Taelin Karidi Gabriel Stanovsky Ariel Goldstein Omri Abend 33 1 0 23 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 71 41 0 23 May 2024
''You should probably read this'': Hedge Detection in Text Denys Katerenchuk Rivka Levitan 31 1 0 22 May 2024
DEGAP: Dual Event-Guided Adaptive Prefixes for Templated-Based Event Argument Extraction with Slot Querying Guanghui Wang Dexi Liu Jian-Yun Nie Qizhi Wan Rong Hu Xiping Liu Wanlong Liu Jiaming Liu 84 0 0 22 May 2024
Exploration of Masked and Causal Language Modelling for Text Generation Nicolo Micheletti Samuel Belkadi Lifeng Han Goran Nenadic 44 6 0 21 May 2024
Talk2Radar: Bridging Natural Language with 4D mmWave Radar for 3D Referring Expression Comprehension Runwei Guan Ruixiao Zhang Ningwei Ouyang Jianan Liu Ka Lok Man ... Ming Xu Jeremy S. Smith Eng Gee Lim Yutao Yue Hui Xiong 46 9 0 21 May 2024
Learning Regularities from Data using Spiking Functions: A Theory Canlin Zhang Xiuwen Liu 27 0 0 19 May 2024
Unveiling Key Aspects of Fine-Tuning in Sentence Embeddings: A Representation Rank Analysis Euna Jung Jaeill Kim Jungmin Ko Jinwoo Park Wonjong Rhee 40 0 0 18 May 2024
AudioSetMix: Enhancing Audio-Language Datasets with LLM-Assisted Augmentations David Xu 21 2 0 17 May 2024
Evaluating Saliency Explanations in NLP by Crowdsourcing Xiaotian Lu Jiyi Li Zhen Wan Xiaofeng Lin Koh Takeuchi Hisashi Kashima XAI FAtt LRM 22 1 0 17 May 2024
DEPTH: Discourse Education through Pre-Training Hierarchically Zachary Bamberger Ofek Glick Chaim Baskin Yonatan Belinkov 59 0 0 13 May 2024
MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling Sidong Feng Suyu Ma Han Wang David Kong Chunyang Chen 34 9 0 11 May 2024
Aspect-based Sentiment Evaluation of Chess Moves (ASSESS): an NLP-based Method for Evaluating Chess Strategies from Textbooks Haifa Alrdahi R. Batista-Navarro 37 0 0 10 May 2024
LyS at SemEval-2024 Task 3: An Early Prototype for End-to-End Multimodal Emotion Linking as Graph-Based Parsing Ana Ezquerro David Vilares 34 1 0 10 May 2024
Learning to Solve Geometry Problems via Simulating Human Dual-Reasoning Process Tong Xiao Jia-Yin Liu Zhenya Huang Jinze Wu Jing Sha Shijin Wang Enhong Chen AI4CE 34 3 0 10 May 2024
Aligning Tutor Discourse Supporting Rigorous Thinking with Tutee Content Mastery for Predicting Math Achievement Mark Abdelshiheed Jennifer Jacobs Sidney K. D'Mello 26 5 0 10 May 2024
Large Language Models for Cyber Security: A Systematic Literature Review HanXiang Xu Shenao Wang Ningke Li K. Wang Yanjie Zhao Kai Chen Ting Yu Yang Janet Liu H. Wang 31 23 0 08 May 2024
Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScore Junchao Wu Runzhe Zhan Derek F. Wong Shu Yang Xuebo Liu Lidia S. Chao Min Zhang DeLMO 38 4 0 07 May 2024
Hire Me or Not? Examining Language Model's Behavior with Occupation Attributes Damin Zhang Yi Zhang Geetanjali Bihani Julia Taylor Rayz 48 2 0 06 May 2024
Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learning Qizhou Chen Taolin Zhang Xiaofeng He Dongyang Li Chengyu Wang Longtao Huang Hui Xue CLL KELM 43 10 0 06 May 2024
PhilHumans: Benchmarking Machine Learning for Personal Health Vadim Liventsev Vivek Kumar Allmin Pradhap Singh Susaiyah Zixiu "Alex" Wu Ivan Rodin ... Milan Petkovic Diego Reforgiato Recupero Ehud Reiter Daniele Riboni Raymond Sterling AI4MH LM&MA 34 0 0 04 May 2024
A Combination of BERT and Transformer for Vietnamese Spelling Correction Trung Hieu Ngo Ham Duong Tran Tin Huynh Kiem Hoang 29 5 0 04 May 2024
Hoaxpedia: A Unified Wikipedia Hoax Articles Dataset Hsuvas Borkakoty Luis Espinosa-Anke 28 1 0 03 May 2024
The Trade-off between Performance, Efficiency, and Fairness in Adapter Modules for Text Classification Minh Duc Bui K. Wense 31 0 0 03 May 2024
Enhancing Language Models for Financial Relation Extraction with Named Entities and Part-of-Speech Menglin Li Kwan Hui Lim 38 0 0 02 May 2024