Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks

22 October 2018

Aaron Courville

Papers citing "Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks"

48 / 48 papers shown

Title
Sneaking Syntax into Transformer Language Models with Tree Regularization Ananjan Nandi Christopher D. Manning Shikhar Murty 74 0 0 28 Nov 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 56 17 0 28 Feb 2024
Augmenting Transformers with Recursively Composed Multi-grained Representations Xiang Hu Qingyang Zhu Kewei Tu Wei Wu 21 3 0 28 Sep 2023
Unsupervised Chunking with Hierarchical RNN Zijun Wu Anup Anand Deshmukh Yongkang Wu Jimmy Lin Lili Mou 18 3 0 10 Sep 2023
Ordered and Binary Speaker Embedding Jiaying Wang Xianglong Wang Na Wang Lantian Li Dong Wang 16 0 0 25 May 2023
Trading Syntax Trees for Wordpieces: Target-oriented Opinion Words Extraction with Wordpieces and Aspect Enhancement Samuel Mensah Kai Sun Nikolaos Aletras 19 1 0 18 May 2023
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model Hao Fei Shengqiong Wu Jingye Li Bobo Li Fei Li Libo Qin Meishan Zhang M. Zhang Tat-Seng Chua 26 76 0 13 Apr 2023
Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothing Yunchong Song Cheng Zhou Xinbing Wang Zhouhan Lin 18 62 0 03 Feb 2023
Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs Anej Svete Benjamin Dayan Tim Vieira Ryan Cotterell Jason Eisner 22 1 0 17 Jan 2023
Bird-Eye Transformers for Text Generation Models Lei Sha Yuhang Song Yordan Yordanov Tommaso Salvatori Thomas Lukasiewicz 17 0 0 08 Oct 2022
Learning to Collocate Visual-Linguistic Neural Modules for Image Captioning Xu Yang Hanwang Zhang Chongyang Gao Jianfei Cai MLLM 31 10 0 04 Oct 2022
Revisiting the Practical Effectiveness of Constituency Parse Extraction from Pre-trained Language Models Taeuk Kim 37 1 0 15 Sep 2022
A Survey on Open Information Extraction from Rule-based Model to Large Language Model Pai Liu Wenya Gao Wenjie Dong Lin Ai Wen Dong Songfang Huang Zongsheng Li Ehsan Hoque Julia Hirschberg Yue Zhang 32 2 0 18 Aug 2022
Towards Unsupervised Content Disentanglement in Sentence Representations via Syntactic Roles G. Felhi Joseph Le Roux Djamé Seddah DRL 16 5 0 22 Jun 2022
Exploiting Inductive Bias in Transformers for Unsupervised Disentanglement of Syntax and Semantics with VAEs G. Felhi Joseph Le Roux Djamé Seddah DRL 21 2 0 12 May 2022
Dependency-based Mixture Language Models Zhixian Yang Xiaojun Wan 41 2 0 19 Mar 2022
Fast-R2D2: A Pretrained Recursive Neural Network based on Pruned CKY for Grammar Induction and Text Representation Xiang Hu Haitao Mi Liang Li Gerard de Melo 21 13 0 01 Mar 2022
Low-Rank Constraints for Fast Inference in Structured Models Justin T. Chiu Yuntian Deng Alexander M. Rush BDL 27 13 0 08 Jan 2022
Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling Jakob Prange Nathan Schneider Lingpeng Kong 17 9 0 15 Dec 2021
Interpreting Deep Learning Models in Natural Language Processing: A Review Xiaofei Sun Diyi Yang Xiaoya Li Tianwei Zhang Yuxian Meng Han Qiu Guoyin Wang Eduard H. Hovy Jiwei Li 17 44 0 20 Oct 2021
Co-training an Unsupervised Constituency Parser with Weak Supervision Nickil Maveli Shay B. Cohen SSL 41 3 0 05 Oct 2021
Exploring the Long Short-Term Dependencies to Infer Shot Influence in Badminton Matches Wei-Yao Wang Teng-Fong Chan Hui-Kuo Yang Chih-Chuan Wang Yao-Chung Fan Wen-Chih Peng 38 20 0 14 Sep 2021
A Partition Filter Network for Joint Entity and Relation Extraction Zhiheng Yan Chong Zhang Jinlan Fu Qi Zhang Zhongyu Wei 17 134 0 27 Aug 2021
Learning Algebraic Recombination for Compositional Generalization Chenyao Liu Shengnan An Zeqi Lin Qian Liu Bei Chen Jian-Guang Lou Lijie Wen Nanning Zheng Dongmei Zhang CoGe 186 36 0 14 Jul 2021
The Limitations of Limited Context for Constituency Parsing Yuchen Li Andrej Risteski 24 4 0 03 Jun 2021
LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relations Ruisheng Cao Lu Chen Zhi Chen Yanbin Zhao Su Zhu Kai Yu 17 159 0 02 Jun 2021
Learning Syntax from Naturally-Occurring Bracketings Tianze Shi Ozan Irsoy Igor Malioutov Lillian Lee 22 5 0 28 Apr 2021
PCFGs Can Do Better: Inducing Probabilistic Context-Free Grammars with Many Symbols Songlin Yang Yanpeng Zhao Kewei Tu 16 22 0 28 Apr 2021
Refining Targeted Syntactic Evaluation of Language Models Benjamin Newman Kai-Siang Ang Julia Gong John Hewitt 16 43 0 19 Apr 2021
Where and What? Examining Interpretable Disentangled Representations Xinqi Zhu Chang Xu Dacheng Tao FAtt DRL 43 38 0 07 Apr 2021
Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey Tapas Nayak Navonil Majumder Pawan Goyal Soujanya Poria ViT 12 49 0 31 Mar 2021
Learning Task Decomposition with Ordered Memory Policy Network Yucheng Lu Yikang Shen Siyuan Zhou Aaron Courville J. Tenenbaum Chuang Gan 11 15 0 19 Mar 2021
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees Jiangang Bai Yujing Wang Yiren Chen Yaming Yang Jing Bai J. Yu Yunhai Tong 37 104 0 07 Mar 2021
Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction Benfeng Xu Quan Wang Yajuan Lyu Yong Zhu Zhendong Mao 17 166 0 20 Feb 2021
STNet: Scale Tree Network with Multi-level Auxiliator for Crowd Counting Mingjie Wang Hao Cai Xianfeng Han Jun Zhou Minglun Gong 29 41 0 18 Dec 2020
Multi-timescale Representation Learning in LSTM Language Models Shivangi Mahto Vy A. Vo Javier S. Turek Alexander G. Huth 8 29 0 27 Sep 2020
Syntax-driven Iterative Expansion Language Models for Controllable Text Generation Noe Casas José A. R. Fonollosa Marta R. Costa-jussá 11 11 0 05 Apr 2020
Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction Taeuk Kim Jihun Choi Daniel Edmiston Sang-goo Lee 17 90 0 30 Jan 2020
Discovering the Compositional Structure of Vector Representations with Role Learning Networks Paul Soulos R. Thomas McCoy Tal Linzen P. Smolensky CoGe 21 43 0 21 Oct 2019
Deep Contextualized Pairwise Semantic Similarity for Arabic Language Questions Hesham Al-Bataineh Wael Farhan Ahmad Mustafa Haitham Seelawi Hussein T. Al-Natsheh 14 16 0 19 Sep 2019
NSURL-2019 Shared Task 8: Semantic Question Similarity in Arabic Haitham Seelawi Ahmad Mustafa Hesham Al-Bataineh Wael Farhan Hussein T. Al-Natsheh 9 17 0 12 Sep 2019
PaLM: A Hybrid Parser and Language Model Hao Peng Roy Schwartz Noah A. Smith AIMat 18 15 0 04 Sep 2019
Towards Better Modeling Hierarchical Structure for Self-Attention with Ordered Neurons Jie Hao Xing Wang Shuming Shi Jinfeng Zhang Zhaopeng Tu 19 12 0 04 Sep 2019
The Unbearable Weight of Generating Artificial Errors for Grammatical Error Correction Phu Mon Htut Joel R. Tetreault 11 12 0 21 Jul 2019
Structure-Invariant Testing for Machine Translation Pinjia He Clara Meister Z. Su 19 104 0 19 Jul 2019
Scalable Syntax-Aware Language Models Using Knowledge Distillation A. Kuncoro Chris Dyer Laura Rimell S. Clark Phil Blunsom 25 26 0 14 Jun 2019
Modeling Recurrence for Transformer Jie Hao Xing Wang Baosong Yang Longyue Wang Jinfeng Zhang Zhaopeng Tu 23 85 0 05 Apr 2019
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,326 0 05 Nov 2016