Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT

26 January 2021

Papers citing "Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT"

6 / 6 papers shown

Title
LLMs' morphological analyses of complex FST-generated Finnish words Anssi Moisio Mathias Creutz M. Kurimo 49 1 0 11 Jul 2024
A Method for Studying Semantic Construal in Grammatical Constructions with Interpretable Contextual Embedding Spaces Gabriella Chronis Kyle Mahowald K. Erk 18 8 0 29 May 2023
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer? Ningyu Xu Tao Gui Ruotian Ma Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 35 13 0 21 Dec 2022
Insights into Pre-training via Simpler Synthetic Tasks Yuhuai Wu Felix Li Percy Liang AIMat 26 20 0 21 Jun 2022
Pretraining with Artificial Language: Studying Transferable Knowledge in Language Models Ryokan Ri Yoshimasa Tsuruoka 32 25 0 19 Mar 2022
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little Koustuv Sinha Robin Jia Dieuwke Hupkes J. Pineau Adina Williams Douwe Kiela 45 243 0 14 Apr 2021