How BPE Affects Memorization in Transformers

6 October 2021

Papers citing "How BPE Affects Memorization in Transformers"

6 / 6 papers shown

Title
Efficient Nearest Neighbor Language Models Junxian He Graham Neubig Taylor Berg-Kirkpatrick RALM 180 84 0 09 Sep 2021
The paradox of the compositionality of natural language: a neural machine translation case study Verna Dankers Elia Bruni Dieuwke Hupkes CoGe 131 64 0 12 Aug 2021
Generative Spoken Language Modeling from Raw Audio Kushal Lakhotia Evgeny Kharitonov Wei-Ning Hsu Yossi Adi Adam Polyak ... Tu Nguyen Jade Copet Alexei Baevski A. Mohamed Emmanuel Dupoux AuLLM 165 261 0 01 Feb 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 258 1,386 0 14 Dec 2020
The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MT Jörg Tiedemann 147 131 0 13 Oct 2020
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 375 2,216 0 03 Sep 2019