Deep RNNs Encode Soft Hierarchical Syntax

11 May 2018

Luke Zettlemoyer

Papers citing "Deep RNNs Encode Soft Hierarchical Syntax"

50 / 78 papers shown

Title
Implicit Causality-biases in humans and LLMs as a tool for benchmarking LLM discourse capabilities Florian Kankowski Torgrim Solstad Sina Zarriess Oliver Bott 79 1 0 22 Jan 2025
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations Paul Soulos Henry Conklin Mattia Opper P. Smolensky Jianfeng Gao Roland Fernandez 73 4 0 18 Dec 2024
The representation landscape of few-shot learning and fine-tuning in large language models Diego Doimo Alessandro Serra A. Ansuini Alberto Cazzaniga 93 4 0 05 Sep 2024
Multilingual Nonce Dependency Treebanks: Understanding how Language Models represent and process syntactic structure David Arps Laura Kallmeyer Younes Samih Hassan Sajjad 24 1 0 13 Nov 2023
Probing LLMs for Joint Encoding of Linguistic Categories Giulio Starace Konstantinos Papakostas Rochelle Choenni Apostolos Panagiotopoulos Matteo Rosati Alina Leidinger Ekaterina Shutova 23 5 0 28 Oct 2023
Implications of Annotation Artifacts in Edge Probing Test Datasets Sagnik Ray Choudhury Jushaan Kalra 16 0 0 20 Oct 2023
Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization Ningyu Xu Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 41 4 0 19 Oct 2023
Disentangling the Linguistic Competence of Privacy-Preserving BERT Stefan Arnold Nils Kemmerzell Annika Schreiner 30 0 0 17 Oct 2023
Explainability for Large Language Models: A Survey Haiyan Zhao Hanjie Chen Fan Yang Ninghao Liu Huiqi Deng Hengyi Cai Shuaiqiang Wang Dawei Yin Jundong Li LRM 29 411 0 02 Sep 2023
The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classification Anastasiia Grishina Max Hort Leon Moonen 22 6 0 08 May 2023
SketchXAI: A First Look at Explainability for Human Sketches Zhiyu Qu Yulia Gryaditskaya Ke Li Kaiyue Pang Tao Xiang Yi-Zhe Song 28 8 0 23 Apr 2023
The geometry of hidden representations of large transformer models L. Valeriani Diego Doimo F. Cuturello A. Laio A. Ansuini Alberto Cazzaniga MILM 21 48 0 01 Feb 2023
Deep Learning Models to Study Sentence Comprehension in the Human Brain S. Arana Jacques Pesnot Lerousseau P. Hagoort 23 10 0 16 Jan 2023
Explainability of Text Processing and Retrieval Methods: A Critical Survey Sourav Saha Debapriyo Majumdar Mandar Mitra 18 5 0 14 Dec 2022
Prompting Language Models for Linguistic Structure Terra Blevins Hila Gonen Luke Zettlemoyer LRM 35 40 0 15 Nov 2022
On the Explainability of Natural Language Processing Deep Models Julia El Zini M. Awad 29 82 0 13 Oct 2022
Analyzing Encoded Concepts in Transformer Language Models Hassan Sajjad Nadir Durrani Fahim Dalvi Firoj Alam A. Khan Jia Xu 19 40 0 27 Jun 2022
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models Terra Blevins Hila Gonen Luke Zettlemoyer LRM 59 26 0 24 May 2022
Probing for Constituency Structure in Neural Language Models David Arps Younes Samih Laura Kallmeyer Hassan Sajjad 27 12 0 13 Apr 2022
Compositional Generalization Requires Compositional Parsers Pia Weissenhorn Yuekun Yao L. Donatelli Alexander Koller CoGe 19 3 0 24 Feb 2022
Semantics-aware Attention Improves Neural Machine Translation Aviv Slobodkin Leshem Choshen Omri Abend 38 11 0 13 Oct 2021
Can Edge Probing Tasks Reveal Linguistic Knowledge in QA Models? Sagnik Ray Choudhury Nikita Bhutani Isabelle Augenstein 27 1 0 15 Sep 2021
Examining Cross-lingual Contextual Embeddings with Orthogonal Structural Probes Tomasz Limisiewicz David Marevcek 11 3 0 10 Sep 2021
What do End-to-End Speech Models Learn about Speaker, Language and Channel Information? A Layer-wise and Neuron-level Analysis Shammur A. Chowdhury Nadir Durrani Ahmed M. Ali 41 12 0 01 Jul 2021
Assessing the Use of Prosody in Constituency Parsing of Imperfect Transcripts Trang Tran Mari Ostendorf 15 5 0 14 Jun 2021
Meta-Learning to Compositionally Generalize Henry Conklin Bailin Wang Kenny Smith Ivan Titov OOD 31 73 0 08 Jun 2021
Language Model Evaluation Beyond Perplexity Clara Meister Ryan Cotterell 22 73 0 31 May 2021
Mediators in Determining what Processing BERT Performs First Aviv Slobodkin Leshem Choshen Omri Abend MoE 68 15 0 13 Apr 2021
To Understand Representation of Layer-aware Sequence Encoders as Multi-order-graph Sufeng Duan Hai Zhao MILM 22 0 0 16 Jan 2021
Towards a Universal Continuous Knowledge Base Gang Chen Maosong Sun Yang Liu 22 3 0 25 Dec 2020
A Self-supervised Representation Learning of Sentence Structure for Authorship Attribution Fereshteh Jafariakinabad K. Hua NAI SSL 29 17 0 14 Oct 2020
Analyzing Individual Neurons in Pre-trained Language Models Nadir Durrani Hassan Sajjad Fahim Dalvi Yonatan Belinkov MILM 11 104 0 06 Oct 2020
LSTMs Compose (and Learn) Bottom-Up Naomi Saphra Adam Lopez CoGe 21 18 0 06 Oct 2020
On the Sub-Layer Functionalities of Transformer Decoder Yilin Yang Longyue Wang Shuming Shi Prasad Tadepalli Stefan Lee Zhaopeng Tu 24 27 0 06 Oct 2020
Linguistic Profiling of a Neural Language Model Alessio Miaschi D. Brunato F. Dell’Orletta Giulia Venturi 36 46 0 05 Oct 2020
Syntax Representation in Word Embeddings and Neural Networks -- A Survey Tomasz Limisiewicz David Marecek NAI 23 9 0 02 Oct 2020
How LSTM Encodes Syntax: Exploring Context Vectors and Semi-Quantization on Natural Text Chihiro Shibata Kei Uchiumi D. Mochihashi 6 7 0 01 Oct 2020
What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties Rochelle Choenni Ekaterina Shutova 22 37 0 27 Sep 2020
Visually Grounded Compound PCFGs Yanpeng Zhao Ivan Titov 16 43 0 25 Sep 2020
Measuring Memorization Effect in Word-Level Neural Networks Probing Rudolf Rosa Tomáš Musil David Marevcek 19 3 0 29 Jun 2020
Emergence of Separable Manifolds in Deep Language Representations Jonathan Mamou Hang Le Miguel Angel del Rio Cory Stephenson Hanlin Tang Yoon Kim SueYeon Chung AAML AI4CE 19 38 0 01 Jun 2020
Encodings of Source Syntax: Similarities in NMT Representations Across Target Languages Tyler A. Chang Anna N. Rafferty 19 2 0 17 May 2020
Emergence of Syntax Needs Minimal Supervision Raphaël Bailly Kata Gábor 31 5 0 03 May 2020
Asking without Telling: Exploring Latent Ontologies in Contextual Representations Julian Michael Jan A. Botha Ian Tenney 28 42 0 29 Apr 2020
What Happens To BERT Embeddings During Fine-tuning? Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney 17 176 0 29 Apr 2020
Do Neural Language Models Show Preferences for Syntactic Formalisms? Artur Kulmizev Vinit Ravishankar Mostafa Abdou Joakim Nivre MILM 11 43 0 29 Apr 2020
Word Interdependence Exposes How LSTMs Compose Representations Naomi Saphra Adam Lopez 33 3 0 27 Apr 2020
Understanding Cross-Lingual Syntactic Transfer in Multilingual Recurrent Neural Networks Prajit Dhar Arianna Bisazza 16 10 0 31 Mar 2020
Discovering the Compositional Structure of Vector Representations with Role Learning Networks Paul Soulos R. Thomas McCoy Tal Linzen P. Smolensky CoGe 29 43 0 21 Oct 2019
Style-aware Neural Model with Application in Authorship Attribution Fereshteh Jafariakinabad K. Hua 14 21 0 12 Sep 2019