Structural Guidance for Transformer Language Models

Structural Guidance for Transformer Language Models

30 July 2021

Ramón Fernández Astudillo

Papers citing "Structural Guidance for Transformer Language Models"

13 / 13 papers shown

Title
Sneaking Syntax into Transformer Language Models with Tree Regularization Ananjan Nandi Christopher D. Manning Shikhar Murty 69 0 0 28 Nov 2024
Multi-State-Action Tokenisation in Decision Transformers for Multi-Discrete Action Spaces Perusha Moodley Pramod S. Kaushik Dhillu Thambi Mark Trovinger Praveen Paruchuri Xia Hong Benjamin Rosman 42 0 0 01 Jul 2024
Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings Yichen Jiang Xiang Zhou Mohit Bansal 23 1 0 09 Feb 2024
Incorporating Distributions of Discourse Structure for Long Document Abstractive Summarization Dongqi Pu Yifa Wang Vera Demberg 24 21 0 26 May 2023
Probing for Incremental Parse States in Autoregressive Language Models Tiwalayo Eisape Vineet Gangireddy R. Levy Yoon Kim 15 11 0 17 Nov 2022
Composition, Attention, or Both? Ryosuke Yoshida Yohei Oseki CoGe 6 0 0 24 Oct 2022
Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling Jakob Prange Nathan Schneider Lingpeng Kong 17 9 0 15 Dec 2021
Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing Jiawei Zhou Tahira Naseem Ramón Fernández Astudillo Young-Suk Lee Radu Florian Salim Roukos 30 43 0 29 Oct 2021
Controlled Evaluation of Grammatical Knowledge in Mandarin Chinese Language Models Yiwen Wang Jennifer Hu R. Levy Peng Qian 9 3 0 22 Sep 2021
Improving BERT with Syntax-aware Local Attention Zhongli Li Qingyu Zhou Chao Li Ke Xu Yunbo Cao 56 44 0 30 Dec 2020
SG-Net: Syntax Guided Transformer for Language Representation Zhuosheng Zhang Yuwei Wu Junru Zhou Sufeng Duan Hai Zhao Rui-cang Wang 38 36 0 27 Dec 2020
Transition-based Parsing with Stack-Transformers Ramón Fernández Astudillo Miguel Ballesteros Tahira Naseem Austin Blodgett Radu Florian 46 71 0 20 Oct 2020
Stack-propagation: Improved Representation Learning for Syntax Yuan Zhang David J. Weiss 29 87 0 21 Mar 2016