v1v2 (latest)

Dict-BERT: Enhancing Language Model Pre-training with Dictionary

13 October 2021

Papers citing "Dict-BERT: Enhancing Language Model Pre-training with Dictionary"

39 / 39 papers shown

Title
GEAR: A Simple GENERATE, EMBED, AVERAGE AND RANK Approach for Unsupervised Reverse Dictionary F. Almeman Luis Espinosa-Anke 99 0 0 09 Dec 2024
Finding NeMo: Negative-mined Mosaic Augmentation for Referring Image Segmentation Seongsu Ha Chaeyun Kim Donghwa Kim Junho Lee Sangho Lee Joonseok Lee 102 4 0 03 Nov 2024
Threshold Filtering Packing for Supervised Fine-Tuning: Training Related Samples within Packs Jiancheng Dong Lei Jiang Wei Jin Lu Cheng 106 1 0 18 Aug 2024
SpeciaLex: A Benchmark for In-Context Specialized Lexicon Learning Joseph Marvin Imperial Harish Tayyar Madabushi 66 1 0 18 Jul 2024
CHEW: A Dataset of CHanging Events in Wikipedia Hsuvas Borkakoty Luis Espinosa-Anke 73 1 0 27 Jun 2024
KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning Dongyang Li Taolin Zhang Longtao Huang Chengyu Wang Xiaofeng He Hui Xue KELM OffRL 55 0 0 24 Jun 2024
Research Trends for the Interplay between Large Language Models and Knowledge Graphs H. Khorashadizadeh Fatima Zahra Amara Morteza Ezzabady Frédéric Ieng Sanju Tiwari Nandana Mihindukulasooriya Jinghua Groppe S. Sahri Farah Benamara Sven Groppe 95 10 0 12 Jun 2024
kNN-CLIP: Retrieval Enables Training-Free Segmentation on Continually Expanding Large Vocabularies Zhongrui Gui Shuyang Sun Runjia Li Jianhao Yuan Zhaochong An Karsten Roth Ameya Prabhu Philip Torr VLM CLL 71 7 0 15 Apr 2024
CoLLEGe: Concept Embedding Generation for Large Language Models Ryan Teehan Brenden M. Lake Mengye Ren 69 4 0 22 Mar 2024
Graph Language Models Moritz Plenz Anette Frank KELM AI4CE 94 7 0 13 Jan 2024
Unified Representation for Non-compositional and Compositional Expressions Ziheng Zeng Suma Bhat 52 3 0 29 Oct 2023
Improving Language Models Meaning Understanding and Consistency by Learning Conceptual Roles from Dictionary Myeongjun Jang Thomas Lukasiewicz 57 5 0 24 Oct 2023
In-context Pretraining: Language Modeling Beyond Document Boundaries Weijia Shi Sewon Min Maria Lomeli Chunting Zhou Margaret Li ... Victoria Lin Noah A. Smith Luke Zettlemoyer Scott Yih Mike Lewis LRM RALM SyDa 135 56 0 16 Oct 2023
Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models Anni Zou Zhuosheng Zhang Hai Zhao Xiangru Tang LRM ReLM 67 3 0 10 Oct 2023
WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Dataset Hsuvas Borkakoty Luis Espinosa-Anke 64 0 0 07 Aug 2023
Benchmarking and Analyzing Generative Data for Visual Recognition Yue Liu Haotian Liu Liangyu Chen Yong Jae Lee Cuiping Li Ziwei Liu EGVM VLM 46 4 0 25 Jul 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap Shirui Pan Linhao Luo Yufei Wang Chen Chen Jiapu Wang Xindong Wu KELM 151 787 0 14 Jun 2023
Injecting knowledge into language generation: a case study in auto-charting after-visit care instructions from medical dialogue M. Eremeev Ilya Valmianski X. Amatriain Anitha Kannan 66 5 0 06 Jun 2023
Shuo Wen Jie Zi: Rethinking Dictionaries and Glyphs for Chinese Language Pre-training Yuxuan Wang Jianghui Wang Dongyan Zhao Zilong Zheng 54 5 0 30 May 2023
Teaching the Pre-trained Model to Generate Simple Texts for Text Simplification Renliang Sun Wei Xu Xiaojun Wan CLL 93 19 0 21 May 2023
ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain Mike Zhang Rob van der Goot Barbara Plank 58 16 0 20 May 2023
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models Deming Ye Yankai Lin Zhengyan Zhang Maosong Sun KELM 44 0 0 02 May 2023
Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translation Alex Jones Isaac Caswell Ishan Saxena Orhan Firat 68 9 0 27 Mar 2023
Learning Customized Visual Models with Retrieval-Augmented Knowledge Haotian Liu Kilho Son Jianwei Yang Ce Liu Jianfeng Gao Yong Jae Lee Chunyuan Li VLM 129 56 0 17 Jan 2023
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 88 3 0 27 Dec 2022
Detecting Euphemisms with Literal Descriptions and Visual Imagery .Ilker Kesen Aykut Erdem Erkut Erdem Iacer Calixto 51 4 0 08 Nov 2022
Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding Jiadong Wang Wenkang Huang Qiuhui Shi Hongbin Wang Minghui Qiu Xiang Li Ming Gao KELM VLM 87 18 0 16 Oct 2022
Task Compass: Scaling Multi-task Pre-training with Task Prefix Zhuosheng Zhang Shuohang Wang Yichong Xu Yuwei Fang Wenhao Yu Yang Liu Han Zhao Chenguang Zhu Michael Zeng SSL LRM 70 16 0 12 Oct 2022
Prompt Combines Paraphrase: Teaching Pre-trained Models to Understand Rare Biomedical Words Hao Wang Chi-Liang Liu Nuwa Xi Sendong Zhao Meizhi Ju Shiwei Zhang Ziheng Zhang Yefeng Zheng Bing Qin Ting Liu VLM AAML LM&MA 106 6 0 14 Sep 2022
Learning Better Masking for Better Language Model Pre-training Dongjie Yang Zhuosheng Zhang Hai Zhao 78 15 0 23 Aug 2022
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning Qianglong Chen Feng-Lin Li Guohai Xu Ming Yan Ji Zhang Yin Zhang 69 23 0 01 Aug 2022
Getting BART to Ride the Idiomatic Train: Learning to Represent Idiomatic Expressions Ziheng Zeng S. Bhat 44 4 0 08 Jul 2022
K-LITE: Learning Transferable Visual Models with External Knowledge Sheng Shen Chunyuan Li Xiaowei Hu Jianwei Yang Yujia Xie ... Ce Liu Kurt Keutzer Trevor Darrell Anna Rohrbach Jianfeng Gao CLIP VLM 70 85 0 20 Apr 2022
Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer Woojeong Jin Dong-Ho Lee Chenguang Zhu Jay Pujara Xiang Ren CLIP VLM 63 10 0 14 Mar 2022
Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts Wenhao Yu Chenguang Zhu Lianhui Qin Zhihan Zhang Tong Zhao Meng Jiang LRM 78 32 0 14 Mar 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP Yulong Chen Yang Liu Li Dong Shuohang Wang Chenguang Zhu Michael Zeng Yue Zhang VLM 102 48 0 10 Feb 2022
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 82 21 0 18 Mar 2021
A Survey of Knowledge-Enhanced Text Generation Wenhao Yu Chenguang Zhu Zaitang Li Zhiting Hu Qingyun Wang Heng Ji Meng Jiang 129 288 0 09 Oct 2020
JAKET: Joint Pre-training of Knowledge Graph and Language Understanding Donghan Yu Chenguang Zhu Yiming Yang Michael Zeng KELM 78 144 0 02 Oct 2020