StructFormer: Joint Unsupervised Induction of Dependency and
Constituency Structure from Masked Language Modeling

v1v2v3 (latest)

StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling

1 December 2020

Aaron Courville

ArXiv (abs)PDF HTML

Papers citing "StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling"

10 / 10 papers shown

Title
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 202 121 0 10 Apr 2025
Improving Unsupervised Constituency Parsing via Maximizing Semantic Information Junjie Chen Xiangheng He Yusuke Miyao Danushka Bollegala 119 0 0 03 Oct 2024
Punctuation Restoration Improves Structure Understanding Without Supervision Junghyun Min Minho Lee Woochul Lee Yeonsoo Lee 161 1 0 13 Feb 2024
LVDiffusor: Distilling Functional Rearrangement Priors from Large Models into Diffusor Yiming Zeng Mingdong Wu Long Yang Jiyao Zhang Hao Ding Hui Cheng Hao Dong DiffM 71 8 0 03 Dec 2023
Dynamic Programming in Rank Space: Scaling Structured Inference with Low-Rank HMMs and PCFGs Aaron Courville Wei Liu Kewei Tu 110 9 0 01 May 2022
Dependency-based Mixture Language Models Zhixian Yang Xiaojun Wan 95 2 0 19 Mar 2022
Fast-R2D2: A Pretrained Recursive Neural Network based on Pruned CKY for Grammar Induction and Text Representation Xiang Hu Haitao Mi Liang Li Gerard de Melo 92 14 0 01 Mar 2022
Unsupervised Full Constituency Parsing with Neighboring Distribution Divergence Letian Peng Zuchao Li Hai Zhao 35 0 0 29 Oct 2021
Neural Bi-Lexicalized PCFG Induction Aaron Courville Yanpeng Zhao Kewei Tu 73 23 0 31 May 2021
Cooperative Self-training of Machine Reading Comprehension Hongyin Luo Shang-Wen Li Ming Gao Seunghak Yu James R. Glass SyDa RALM 37 12 0 12 Mar 2021