Learning Which Features Matter: RoBERTa Acquires a Preference for
Linguistic Generalizations (Eventually)

Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)

11 October 2020

Haau-Sing Li

Samuel R. Bowman

Papers citing "Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)"

8 / 8 papers shown

Title
Language model acceptability judgements are not always robust to context Koustuv Sinha Jon Gauthier Aaron Mueller Kanishka Misra Keren Fuentes R. Levy Adina Williams 13 17 0 18 Dec 2022
Unit Testing for Concepts in Neural Networks Charles Lovering Ellie Pavlick 23 28 0 28 Jul 2022
Neural reality of argument structure constructions Bai Li Zining Zhu Guillaume Thomas Frank Rudzicz Yang Xu 38 26 0 24 Feb 2022
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little Koustuv Sinha Robin Jia Dieuwke Hupkes J. Pineau Adina Williams Douwe Kiela 43 243 0 14 Apr 2021
Measuring and Improving Consistency in Pretrained Language Models Yanai Elazar Nora Kassner Shauli Ravfogel Abhilasha Ravichander Eduard H. Hovy Hinrich Schütze Yoav Goldberg HILM 260 346 0 01 Feb 2021
When Do You Need Billions of Words of Pretraining Data? Yian Zhang Alex Warstadt Haau-Sing Li Samuel R. Bowman 21 136 0 10 Nov 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,950 0 20 Apr 2018
Building machines that adapt and compute like brains Brenden Lake J. Tenenbaum AI4CE FedML NAI AILaw 254 890 0 11 Nov 2017