DeBERTa: Decoding-enhanced BERT with Disentangled Attention

5 June 2020

Xiaodong Liu

Papers citing "DeBERTa: Decoding-enhanced BERT with Disentangled Attention"

50 / 1,037 papers shown

Title
OMoS-QA: A Dataset for Cross-Lingual Extractive Question Answering in a German Migration Context Steffen Kleinle Jakob Prange Annemarie Friedrich RALM 33 0 0 22 Jul 2024
Pre-Training and Prompting for Few-Shot Node Classification on Text-Attributed Graphs Huan-jing Zhao Beining Yang Yukuo Cen Junyu Ren Chenhui Zhang Yuxiao Dong Evgeny Kharlamov Shu Zhao Jie Tang VLM 49 7 0 22 Jul 2024
SynCPKL: Harnessing LLMs to Generate Synthetic Data for Commonsense Persona Knowledge Linking Kuan-Yen Lin 38 0 0 21 Jul 2024
A Community-Centric Perspective for Characterizing and Detecting Anti-Asian Violence-Provoking Speech Gaurav Verma Rynaa Grover Jiawei Zhou Binny Mathew Jordan Kraemer Munmun De Choudhury Srijan Kumar 40 2 0 21 Jul 2024
How Are LLMs Mitigating Stereotyping Harms? Learning from Search Engine Studies Alina Leidinger Richard Rogers 32 5 0 16 Jul 2024
GraphEval: A Knowledge-Graph Based LLM Hallucination Evaluation Framework Hannah Sansford Nicholas Richardson Hermina Petric Maretic Juba Nait Saada 26 12 0 15 Jul 2024
H2O-Danube3 Technical Report Pascal Pfeiffer Philipp Singer Yauhen Babakhin Gabor Fodor Nischay Dhankhar Sri Satish Ambati 19 3 0 12 Jul 2024
A Look Into News Avoidance Through AWRS: An Avoidance-Aware Recommender System Igor L.R. Azevedo Toyotaro Suzumura Yuichiro Yasui 25 0 0 12 Jul 2024
Characterizing Prompt Compression Methods for Long Context Inference Siddharth Jha Lutfi Eren Erdogan Sehoon Kim Kurt Keutzer A. Gholami 16 5 0 11 Jul 2024
Uncertainty Estimation of Large Language Models in Medical Question Answering Jiaxin Wu Yizhou Yu Hong-Yu Zhou HILM ELM 30 2 0 11 Jul 2024
Turn-Level Empathy Prediction Using Psychological Indicators Shaz Furniturewala Kokil Jaidka 19 0 0 11 Jul 2024
STAGE: Simplified Text-Attributed Graph Embeddings Using Pre-trained LLMs Aaron Zolnai-Lucas Jack Boylan Chris Hokamp Parsa Ghaffari 26 1 0 10 Jul 2024
GLBench: A Comprehensive Benchmark for Graph with Large Language Models Yuhan Li Peisong Wang Xiao Zhu Aochuan Chen Haiyun Jiang Deng Cai Victor Wai Kin Chan Jia Li 43 12 0 10 Jul 2024
Revisiting, Benchmarking and Understanding Unsupervised Graph Domain Adaptation Meihan Liu Zhen Zhang Jiachen Tang Jiajun Bu Bingsheng He Sheng Zhou 19 3 0 09 Jul 2024
PAS: Data-Efficient Plug-and-Play Prompt Augmentation System Miao Zheng H. Liang Fan Yang Haoze Sun Tianpeng Li ... Kun Fang Weipeng Chen Bin Cui Wentao Zhang Zenan Zhou RALM 37 3 0 08 Jul 2024
AI Safety in Generative AI Large Language Models: A Survey Jaymari Chua Yun Yvonna Li Shiyi Yang Chen Wang Lina Yao LM&MA 34 12 0 06 Jul 2024
Leveraging Graph Structures to Detect Hallucinations in Large Language Models Noa Nonkes Sergei Agaronian Evangelos Kanoulas Roxana Petcu 24 1 0 05 Jul 2024
Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Models Yuyan Chen Qiang Fu Yichen Yuan Zhihao Wen Ge Fan Dayiheng Liu Dongmei Zhang Zhixu Li Yanghua Xiao HILM 42 68 0 04 Jul 2024
Hadamard Adapter: An Extreme Parameter-Efficient Adapter Tuning Method for Pre-trained Language Models Yuyan Chen Qiang Fu Ge Fan Lun Du Jian-Guang Lou Shi Han Dongmei Zhang Zhixu Li Yanghua Xiao MoE 19 16 0 04 Jul 2024
Semantic Graphs for Syntactic Simplification: A Revisit from the Age of LLM Peiran Yao Kostyantyn Guzhva Denilson Barbosa 45 3 0 04 Jul 2024
Generalizing Graph Transformers Across Diverse Graphs and Tasks via Pre-Training on Industrial-Scale Data Yufei He Zhenyu Hou Yukuo Cen Feng He Xu Cheng Bryan Hooi AI4CE 22 3 0 04 Jul 2024
ConText at WASSA 2024 Empathy and Personality Shared Task: History-Dependent Embedding Utterance Representations for Empathy and Emotion Prediction in Conversations Patrícia Pereira Helena Moniz Joao Paulo Carvalho 28 0 0 04 Jul 2024
KeyVideoLLM: Towards Large-scale Video Keyframe Selection Hao Liang Jiapeng Li Tianyi Bai Xijie Huang Linzhuang Sun Zhengren Wang Conghui He Bin Cui Chong Chen Wentao Zhang VGen 29 7 0 03 Jul 2024
SAFT: Towards Out-of-Distribution Generalization in Fine-Tuning Bac Nguyen Stefan Uhlich Fabien Cardinaux Lukas Mauch Marzieh Edraki Aaron Courville OODD CLL VLM 52 3 0 03 Jul 2024
Aspect-Based Sentiment Analysis Techniques: A Comparative Study Dineth Jayakody Koshila Isuranda A. V. A. Malkith Nisansa de Silva Sachintha Rajith Ponnamperuma G. Sandamali K. L. Sudheera 24 0 0 03 Jul 2024
ValueScope: Unveiling Implicit Norms and Values via Return Potential Model of Social Interactions Chan Young Park Shuyue Stella Li Hayoung Jung Svitlana Volkova Tanushree Mitra David Jurgens Yulia Tsvetkov 47 5 0 02 Jul 2024
Are Data Augmentation Methods in Named Entity Recognition Applicable for Uncertainty Estimation? Wataru Hashimoto Hidetaka Kamigaito Taro Watanabe 19 1 0 02 Jul 2024
Efficient-Empathy: Towards Efficient and Effective Selection of Empathy Data Linzhuang Sun Hao Liang Jingxuan Wei Linkun Sun Bihui Yu Bin Cui Wentao Zhang 27 1 0 02 Jul 2024
Efficient Nearest Neighbor based Uncertainty Estimation for Natural Language Processing Tasks Wataru Hashimoto Hidetaka Kamigaito Taro Watanabe 52 0 0 02 Jul 2024
Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuning Haobo Song Hao Zhao Soumajit Majumder Tao Lin 23 3 0 01 Jul 2024
Revisiting Random Walks for Learning on Graphs Jinwoo Kim Olga Zaghen Ayhan Suleymanzade Youngmin Ryou Seunghoon Hong 54 0 0 01 Jul 2024
Cross-Lingual Transfer Learning for Speech Translation Rao Ma Yassir Fathullah Mengjie Qian Siyuan Tang Mark J. F. Gales Kate Knill 20 1 0 01 Jul 2024
MasonTigers at SemEval-2024 Task 10: Emotion Discovery and Flip Reasoning in Conversation with Ensemble of Transformers and Prompting Al Nahian Bin Emran Amrita Ganguly Sadiya Sayara Chowdhury Puspo Nishat Raihan Dhiman Goswami LRM 21 0 0 30 Jun 2024
The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning Shaobo Cui Zhijing Jin Bernhard Schölkopf Boi Faltings CML LRM 37 4 0 27 Jun 2024
SSP: Self-Supervised Prompting for Cross-Lingual Transfer to Low-Resource Languages using Large Language Models Vipul Rathore Aniruddha Deb Ankish Chandresh Parag Singla Mausam LRM 44 0 0 27 Jun 2024
Decoding with Limited Teacher Supervision Requires Understanding When to Trust the Teacher Hyunjong Ok Jegwang Ryu Jaeho Lee 37 0 0 26 Jun 2024
Advancing Question Answering on Handwritten Documents: A State-of-the-Art Recognition-Based Model for HW-SQuAD Aniket Pal Ajoy Mondal C. V. Jawahar RALM 21 0 0 25 Jun 2024
RaTEScore: A Metric for Radiology Report Generation W. Zhao Chaoyi Wu X. Zhang Ya Zhang Yanfeng Wang Weidi Xie 21 8 0 24 Jun 2024
The Privileged Students: On the Value of Initialization in Multilingual Knowledge Distillation Haryo Akbarianto Wibowo Thamar Solorio Alham Fikri Aji 29 2 0 24 Jun 2024
Evaluation of Instruction-Following Ability for Large Language Models on Story-Ending Generation Rem Hida Junki Ohmura Toshiyuki Sekiya ELM 32 0 0 24 Jun 2024
Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMs Jannik Kossen Jiatong Han Muhammed Razzak Lisa Schut Shreshth A. Malik Yarin Gal HILM 46 33 0 22 Jun 2024
Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraph Roman Vashurin Ekaterina Fadeeva Artem Vazhentsev Akim Tsvigun Daniil Vasilev ... Timothy Baldwin Timothy Baldwin Maxim Panov Artem Shelmanov Artem Shelmanov HILM 64 8 0 21 Jun 2024
Towards Fine-Grained Citation Evaluation in Generated Text: A Comparative Analysis of Faithfulness Metrics Weijia Zhang Mohammad Aliannejadi Yifei Yuan Jiahuan Pei Jia-Hong Huang Evangelos Kanoulas HILM 29 12 0 21 Jun 2024
Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing Han Jiang Xiaoyuan Yi Zhihua Wei Shu Wang Xing Xie Xing Xie ALM ELM 50 5 0 20 Jun 2024
Text Serialization and Their Relationship with the Conventional Paradigms of Tabular Machine Learning Kyoka Ono Simon A. Lee LMTD 22 7 0 19 Jun 2024
Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Tasks Dan S. Nielsen Kenneth Enevoldsen Peter Schneider-Kamp ELM 35 2 0 19 Jun 2024
Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal Quantization levels and Rank Values trough Differentiable Bayesian Gates Cristian Meo Ksenia Sycheva Anirudh Goyal Justin Dauwels MQ 22 4 0 18 Jun 2024
Prompts as Auto-Optimized Training Hyperparameters: Training Best-in-Class IR Models from Scratch with 10 Gold Labels Jasper Xian Saron Samuel Faraz Khoubsirat Ronak Pradeep Md Arafat Sultan Radu Florian Salim Roukos Avirup Sil Christopher Potts Omar Khattab VLM 26 2 0 17 Jun 2024
An Empirical Investigation of Matrix Factorization Methods for Pre-trained Transformers Ashim Gupta Sina Mahdipour Saravani P. Sadayappan Vivek Srikumar 24 2 0 17 Jun 2024
Can Machines Resonate with Humans? Evaluating the Emotional and Empathic Comprehension of LMs Muhammad Arslan Manzoor Yuxia Wang Minghan Wang Preslav Nakov 32 0 0 17 Jun 2024