v1v2 (latest)

SenseBERT: Driving Some Sense into BERT

15 August 2019

Papers citing "SenseBERT: Driving Some Sense into BERT"

50 / 92 papers shown

Title
Exploring Language Model Generalization in Low-Resource Extractive QA Saptarshi Sengupta Wenpeng Yin Preslav Nakov Shreya Ghosh Suhang Wang 96 1 0 27 Sep 2024
Analyzing Semantic Change through Lexical Replacements Francesco Periti Pierluigi Cassotti Haim Dubossarsky Nina Tahmasebi 85 7 0 29 Apr 2024
KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation Xindi Luo Zequn Sun Jing-xin Zhao Zhe Zhao Wei Hu KELM 69 8 0 22 Mar 2024
Injecting Wiktionary to improve token-level contextual representations using contrastive learning Anna Mosolova Marie Candito Carlos Ramisch 67 0 0 12 Feb 2024
Resolving Regular Polysemy in Named Entities S. Hsieh Yu-Hsiang Tseng Hsin-Yu Chou Ching-Wen Yang Yu-Yun Chang 44 3 0 18 Jan 2024
KTRL+F: Knowledge-Augmented In-Document Search Hanseok Oh Haebin Shin Miyoung Ko Hyunji Lee Minjoon Seo 60 3 0 14 Nov 2023
Towards Concept-Aware Large Language Models Chen Shani Jilles Vreeken Dafna Shahaf LRM 64 7 0 03 Nov 2023
Using Slisemap to interpret physical data Lauri Seppäläinen Anton Björklund V. Besel Kai Puolamäki 67 1 0 24 Oct 2023
Breaking Down Word Semantics from Pre-trained Language Models through Layer-wise Dimension Selection Nayoung Choi 48 0 0 08 Oct 2023
ContrastWSD: Enhancing Metaphor Detection with Word Sense Disambiguation Following the Metaphor Identification Procedure Mohamad Elzohbi Richard Zhao 47 2 0 06 Sep 2023
Representation Learning via Variational Bayesian Networks Oren Barkan Avi Caciularu Idan Rejwan Ori Katz Jonathan Weill Itzik Malkiel Noam Koenigstein BDL 93 15 0 28 Jun 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 110 93 0 20 Jun 2023
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memories Shizhe Diao Tianyang Xu Ruijia Xu Jiawei Wang Tong Zhang MoE AI4CE 55 41 0 08 Jun 2023
Driving Context into Text-to-Text Privatization Stefan Arnold Dilara Yesilbas Sven Weinzierl 45 8 0 02 Jun 2023
Together We Make Sense -- Learning Meta-Sense Embeddings from Pretrained Static Sense Embeddings Haochen Luo Yi Zhou Danushka Bollegala SSL 67 1 0 30 May 2023
Plug-and-Play Knowledge Injection for Pre-trained Language Models Zhengyan Zhang Zhiyuan Zeng Yankai Lin Huadong Wang Deming Ye ... Xu Han Zhiyuan Liu Peng Li Maosong Sun Jie Zhou KELM 94 12 0 28 May 2023
Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs Yihong Liu Haotian Ye Leonie Weissweiler Renhao Pei Hinrich Schütze 91 11 0 22 May 2023
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models Deming Ye Yankai Lin Zhengyan Zhang Maosong Sun KELM 51 0 0 02 May 2023
Bridging the Language Gap: Knowledge Injected Multilingual Question Answering Zhichao Duan Xiuxing Li Zhengyan Zhang Zhenyu Li Ning Liu Jianyong Wang 65 8 0 06 Apr 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 95 28 0 14 Mar 2023
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 92 3 0 27 Dec 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 158 137 0 11 Nov 2022
Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models Xiaoman Pan Wenlin Yao Hongming Zhang Dian Yu Dong Yu Jianshu Chen KELM 296 25 0 28 Oct 2022
$On the Curious Case of $\ell_2$ norm of Sense Embeddings$ On the Curious Case of $\ell_2$ norm of Sense Embeddings Yi Zhou Danushka Bollegala 59 0 0 26 Oct 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining Nafis Sadeq Canwen Xu Julian McAuley 95 13 0 21 Oct 2022
Temporal Word Meaning Disambiguation using TimeLMs Mihir Godbole Parth Dandavate Aditya Kane 74 2 0 15 Oct 2022
Lost in Context? On the Sense-wise Variance of Contextualized Word Embeddings Yile Wang Yue Zhang 59 5 0 20 Aug 2022
SPOT: Knowledge-Enhanced Language Representations for Information Extraction Jiacheng Li Yannis Katsis Tyler Baldwin Ho-Cheol Kim Andrew Bartko Julian McAuley Chun-Nan Hsu 71 17 0 20 Aug 2022
Ered: Enhanced Text Representations with Entities and Descriptions Qinghua Zhao Shuai Ma Yu Lei 54 1 0 18 Aug 2022
Massively Multilingual Lexical Specialization of Multilingual Transformers Tommaso Green Simone Paolo Ponzetto Goran Glavaš 87 0 0 01 Aug 2022
Representation Learning of Image Schema Fajrian Yunus Chloé Clavel Catherine Pelachaud OCL 76 0 0 17 Jul 2022
1Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Task Zhiyong Wang Ge Zhang Nineli Lashkarashvili 60 3 0 08 Jun 2022
Improving Contextual Representation with Gloss Regularized Pre-training Yu Lin Zhecheng An Peihao Wu Zejun Ma 78 5 0 13 May 2022
Knowledge Infused Decoding Ruibo Liu Guoqing Zheng Shashank Gupta Radhika Gaonkar Chongyang Gao Soroush Vosoughi Milad Shokouhi Ahmed Hassan Awadallah KELM 85 14 0 06 Apr 2022
Better Language Model with Hypernym Class Prediction Richard He Bai Tong Wang Alessandro Sordoni Peng Shi 139 16 0 21 Mar 2022
Sense Embeddings are also Biased--Evaluating Social Biases in Static and Contextualised Sense Embeddings Yi Zhou Masahiro Kaneko Danushka Bollegala 68 23 0 14 Mar 2022
SLISEMAP: Supervised dimensionality reduction through local explanations Anton Björklund J. Mäkelä Kai Puolamäki FAtt 72 19 0 12 Jan 2022
Does Entity Abstraction Help Generative Transformers Reason? Nicolas Angelard-Gontier Siva Reddy C. Pal 77 5 0 05 Jan 2022
Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories Wenlin Yao Xiaoman Pan Lifeng Jin Jianshu Chen Dian Yu Dong Yu 46 7 0 27 Oct 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 93 46 0 16 Oct 2021
Learning Sense-Specific Static Embeddings using Contextualised Word Embeddings as a Proxy Yi Zhou Danushka Bollegala 75 9 0 05 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 82 6 0 01 Oct 2021
K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering Fu Sun Feng-Lin Li Ruize Wang Qianglong Chen Xingyi Cheng Ji Zhang VLM KELM 69 4 0 22 Sep 2021
BERT Has Uncommon Sense: Similarity Ranking for Word Sense BERTology Luke Gessler Nathan Schneider 66 7 0 20 Sep 2021
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models Qianchu Liu Fangyu Liu Nigel Collier Anna Korhonen Ivan Vulić 219 21 0 19 Sep 2021
Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation Leyang Cui Yu-Huan Wu Shujie Liu Yue Zhang 146 23 0 12 Sep 2021
Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval Zhiqi Huang Hamed Bonab Sheikh Muhammad Sarwar Razieh Rahimi James Allan 95 11 0 07 Sep 2021
Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Survey Benyamin Ghojogh A. Ghodsi Fakhri Karray Mark Crowley 51 23 0 25 Aug 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 105 270 0 12 Aug 2021
Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition Varsha Suresh Desmond C. Ong 54 20 0 31 Jul 2021