R2D2: Recursive Transformer based on Differentiable Tree for
Interpretable Hierarchical Language Modeling

v1v2 (latest)

R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling

2 July 2021

ArXiv (abs)PDF HTML

Papers citing "R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling"

16 / 16 papers shown

Title
Sneaking Syntax into Transformer Language Models with Tree Regularization Ananjan Nandi Christopher D. Manning Shikhar Murty 150 1 0 28 Nov 2024
On Eliciting Syntax from Language Models via Hashing Yiran Wang Masao Utiyama 77 0 0 05 Oct 2024
Banyan: Improved Representation Learning with Explicit Structure Mattia Opper N. Siddharth 223 1 0 25 Jul 2024
Unsupervised Morphological Tree Tokenizer Qingyang Zhu Xiang Hu Pengyu Ji Wei Wu Kewei Tu 88 0 0 21 Jun 2024
Self-StrAE at SemEval-2024 Task 1: Making Self-Structuring AutoEncoders Learn More With Less Mattia Opper Siddharth Narayanaswamy 84 3 0 02 Apr 2024
Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at Scale Xiang Hu Pengyu Ji Qingyang Zhu Wei Wu Kewei Tu LRM 77 5 0 13 Mar 2024
Recursion in Recursion: Two-Level Nested Recursion for Length Generalization with Scalability Jishnu Ray Chowdhury Cornelia Caragea 78 5 0 08 Nov 2023
AMR Parsing with Causal Hierarchical Attention and Pointers Chao Lou Kewei Tu 3DV 75 2 0 18 Oct 2023
Augmenting Transformers with Recursively Composed Multi-grained Representations Xiang Hu Qingyang Zhu Kewei Tu Wei Wu 77 4 0 28 Sep 2023
Efficient Beam Tree Recursion Jishnu Ray Chowdhury Cornelia Caragea 83 3 0 20 Jul 2023
Beam Tree Recursive Cells Jishnu Ray Chowdhury Cornelia Caragea 91 6 0 31 May 2023
A Multi-Grained Self-Interpretable Symbolic-Neural Model For Single/Multi-Labeled Text Classification Xiang Hu Xinyu Kong Kewei Tu MILM BDL 67 5 0 06 Mar 2023
Forming Trees with Treeformers Nilay Patel Jeffrey Flanigan AI4CE 87 3 0 14 Jul 2022
Fast-R2D2: A Pretrained Recursive Neural Network based on Pruned CKY for Grammar Induction and Text Representation Xiang Hu Haitao Mi Liang Li Gerard de Melo 92 14 0 01 Mar 2022
Learning with Latent Structures in Natural Language Processing: A Survey Zhaofeng Wu BDL DRL 73 4 0 03 Jan 2022
Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation Raymond Li Wen Xiao Linzi Xing Lanjun Wang Gabriel Murray Giuseppe Carenini ViT 69 8 0 10 Dec 2021