Generative Pretrained Structured Transformers: Unsupervised Syntactic
Language Models at Scale

v1v2v3 (latest)

Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at Scale

Annual Meeting of the Association for Computational Linguistics (ACL), 2024

13 March 2024

ArXiv (abs)PDF HTML

Papers citing "Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at Scale"

6 / 6 papers shown

Title
Understanding Syntactic Generalization in Structure-inducing Language Models David Arps Hassan Sajjad Laura Kallmeyer 66 0 0 11 Aug 2025
Sneaking Syntax into Transformer Language Models with Tree RegularizationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Ananjan Nandi Christopher D. Manning Shikhar Murty 291 1 0 28 Nov 2024
On Eliciting Syntax from Language Models via HashingConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Yiran Wang Masao Utiyama 176 0 0 05 Oct 2024
Unsupervised Morphological Tree Tokenizer Qingyang Zhu Xiang Hu Pengyu Ji Wei Wu Kewei Tu 218 0 0 21 Jun 2024
Tree-Planted Transformers: Unidirectional Transformer Language Models with Implicit Syntactic Supervision Ryosuke Yoshida Taiga Someya Yohei Oseki 165 1 0 20 Feb 2024
Structured Attention NetworksInternational Conference on Learning Representations (ICLR), 2017 Yoon Kim Carl Denton Luong Hoang Alexander M. Rush 458 479 0 03 Feb 2017