Rare Words: A Major Problem for Contextualized Embeddings And How to Fix it by Attentive Mimicking

14 April 2019

Papers citing "Rare Words: A Major Problem for Contextualized Embeddings And How to Fix it by Attentive Mimicking"

16 / 16 papers shown

Title
The Impact of Word Splitting on the Semantic Content of Contextualized Word Representations Aina Garí Soler Matthieu Labeau Chloé Clavel VLM 42 2 0 22 Feb 2024
Explicit Morphological Knowledge Improves Pre-training of Language Models for Hebrew Eylon Gueta Omer Goldman Reut Tsarfaty 11 1 0 01 Nov 2023
Prompt Combines Paraphrase: Teaching Pre-trained Models to Understand Rare Biomedical Words Hao Wang Chi-Liang Liu Nuwa Xi Sendong Zhao Meizhi Ju Shiwei Zhang Ziheng Zhang Yefeng Zheng Bing Qin Ting Liu VLM AAML LM&MA 41 6 0 14 Sep 2022
Generating Coherent Drum Accompaniment With Fills And Improvisations Rishabh A. Dahale Vaibhav Talwadker Preeti Rao Prateek Verma 16 3 0 01 Sep 2022
CoDA21: Evaluating Language Understanding Capabilities of NLP Models With Context-Definition Alignment Lutfi Kerem Senel Timo Schick Hinrich Schütze ELM ALM 23 5 0 11 Mar 2022
Artefact Retrieval: Overview of NLP Models with Knowledge Base Access Vilém Zouhar Marius Mosbach Debanjali Biswas Dietrich Klakow KELM 24 4 0 24 Jan 2022
Using Distributional Principles for the Semantic Study of Contextual Language Models Olivier Ferret 19 1 0 23 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 74 1,030 0 01 Nov 2021
Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios? Arij Riabi Benoît Sagot Djamé Seddah 31 15 0 26 Oct 2021
Towards Open-World Feature Extrapolation: An Inductive Graph Learning Approach Qitian Wu Chenxiao Yang Junchi Yan 19 32 0 09 Oct 2021
Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems Laurel J. Orr Atindriyo Sanyal Xiao Ling Karan Goel Megan Leszczynski 22 18 0 11 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 31 3,831 0 28 Jul 2021
Data-Efficient Pretraining via Contrastive Self-Supervision Nils Rethmeier Isabelle Augenstein 20 20 0 02 Oct 2020
It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners Timo Schick Hinrich Schütze 22 953 0 15 Sep 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 258 1,588 0 21 Jan 2020
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016