A Surprisingly Effective Fix for Deep Latent Variable Modeling of Text

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019

2 September 2019

Bohan Li

Junxian He

Graham Neubig

Taylor Berg-Kirkpatrick

Yiming Yang

DRL

ArXiv (abs)PDF HTML

Papers citing "A Surprisingly Effective Fix for Deep Latent Variable Modeling of Text"

49 / 49 papers shown

Title
Learning to Disentangle Latent Reasoning Rules with Language VAEs: A Systematic Study Yingji Zhang Marco Valentino Danilo S. Carvalho André Freitas LRM 150 1 0 24 Jun 2025
Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoders Yingji Zhang Danilo S. Carvalho Marco Valentino Ian Pratt-Hartmann André Freitas DRL 174 9 0 01 Feb 2024
LlaMaVAE: Guiding Large Language Model Generation via Continuous Latent Sentence Spaces Yingji Zhang Danilo S. Carvalho Ian Pratt-Hartmann André Freitas VLM 146 3 0 20 Dec 2023
Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders Yingji Zhang Marco Valentino Danilo S. Carvalho Ian Pratt-Hartmann André Freitas DRL 154 11 0 14 Nov 2023
VOLTA: Improving Generative Diversity by Variational Mutual Information Maximizing Autoencoder Yueen Ma Dafeng Chi Jingjing Li Kai Song Yuzheng Zhuang Irwin King DRL 262 2 0 03 Jul 2023
Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual InformationAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Kun Zhao Bohao Yang Chenghua Lin Wenge Rong Aline Villavicencio Xiaohui Cui DRL 167 10 0 26 May 2023
Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog GenerationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Tianyu Yang Thy Thy Tran Iryna Gurevych DiffM 164 1 0 24 May 2023
Controlling Posterior Collapse by an Inverse Lipschitz Constraint on the Decoder NetworkInternational Conference on Machine Learning (ICML), 2023 Yuri Kinoshita Kenta Oono Kenji Fukumizu Yuichi Yoshida S. Maeda DRL BDL 191 4 0 25 Apr 2023
Posterior Collapse and Latent Variable Non-identifiabilityNeural Information Processing Systems (NeurIPS), 2023 Yixin Wang David M. Blei John P. Cunningham CML DRL 309 83 0 02 Jan 2023
An Overview on Controllable Text Generation via Variational Auto-Encoders Haoqin Tu Yitong Li BDL 149 3 0 15 Nov 2022
VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language UnderstandingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Dou Hu Xiaolong Hou Xiyang Du Mengyuan Zhou Lian-Xin Jiang Yang Mo Xiaofeng Shi 238 17 0 01 Nov 2022
Improving Variational Autoencoders with Density Gap-based RegularizationNeural Information Processing Systems (NeurIPS), 2022 Jianfei Zhang Jun Bai Chenghua Lin Yanmeng Wang Wenge Rong DRL 144 8 0 01 Nov 2022
Quasi-symbolic Semantic Geometry over Transformer-based Variational AutoEncoder Yingji Zhang Danilo S. Carvalho Ian Pratt-Hartmann 225 4 0 12 Oct 2022
PCAE: A Framework of Plug-in Conditional Auto-Encoder for Controllable Text GenerationKnowledge-Based Systems (KBS), 2022 Haoqin Tu Zhongliang Yang Jinshuai Yang Siyu Zhang Yong Huang 122 7 0 07 Oct 2022
Learning to Drop Out: An Adversarial Approach to Training Sequence VAEsNeural Information Processing Systems (NeurIPS), 2022 Ðorðe Miladinovic Kumar Shridhar Kushal Kumar Jain Max B. Paulus J. M. Buhmann Mrinmaya Sachan Carl Allen DRL 285 5 0 26 Sep 2022
Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text GenerationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Jinyi Hu Xiaoyuan Yi Wenhao Li Maosong Sun Xing Xie 210 23 0 13 Jul 2022
Hidden Schema NetworksAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Ramses J. Sanchez L. Conrads Pascal Welke K. Cvejoski C. Ojeda NAI MILM 184 5 0 08 Jul 2022
Latent Diffusion Energy-Based Model for Interpretable Text ModelingInternational Conference on Machine Learning (ICML), 2022 Peiyu Yu Sirui Xie Xiaojian Ma Baoxiong Jia Bo Pang Ruigi Gao Yixin Zhu Song-Chun Zhu Ying Nian Wu DiffM 231 93 0 13 Jun 2022
RVAE-LAMOL: Residual Variational Autoencoder to Enhance Lifelong Language LearningIEEE International Joint Conference on Neural Network (IJCNN), 2022 Han Wang Ruiliu Fu Xuejun Zhang Jun Zhou CLL 158 5 0 22 May 2022
Exploiting Inductive Bias in Transformers for Unsupervised Disentanglement of Syntax and Semantics with VAEsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 G. Felhi Joseph Le Roux Djamé Seddah DRL 162 2 0 12 May 2022
AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling Haoqin Tu Zhongliang Yang Jinshuai Yang Yong Huang 175 13 0 12 May 2022
MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory PredictionComputer Vision and Pattern Recognition (CVPR), 2022 Mihee Lee Samuel S. Sohn Seonghyeon Moon Sejong Yoon Mubbasir Kapadia Vladimir Pavlovic 116 81 0 18 Jan 2022
Exploring Story Generation with Multi-task Objectives in Variational AutoencodersAustralasian Language Technology Association Workshop (ALTA), 2021 Zhuohan Xie Trevor Cohn Jey Han Lau DRL 108 7 0 15 Nov 2021
Preventing posterior collapse in variational autoencoders for text generation via decoder regularization Alban Petit Caio Corro DRL 193 3 0 28 Oct 2021
The Neglected Sibling: Isotropic Gaussian Posterior for VAE Lan Zhang Wray Buntine Ehsan Shareghi DRL 94 0 0 14 Oct 2021
On the Latent Holes of VAEs for Text Generation Ruizhe Li Xutan Peng Chenghua Lin 179 4 0 07 Oct 2021
Challenging the Semi-Supervised VAE Framework for Text ClassificationFirst Workshop on Insights from Negative Results in NLP (Insights), 2021 G. Felhi Joseph Le Roux Djamé Seddah BDL 135 2 0 27 Sep 2021
StreamHover: Livestream Transcript Summarization and Annotation Sangwoo Cho Franck Dernoncourt Timothy Jeewun Ganter Trung Bui Nedim Lipka Walter Chang Hailin Jin Jonathan Brandt H. Foroosh Fei Liu 3DGS AI4TS 224 30 0 11 Sep 2021
Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and ClassificationInternational Conference on Machine Learning (ICML), 2021 Bo Pang Ying Nian Wu 137 19 0 26 Aug 2021
Finetuning Pretrained Transformers into Variational AutoencodersFirst Workshop on Insights from Negative Results in NLP (Insights), 2021 Seongmin Park Jihwa Lee 232 22 0 05 Aug 2021
Discrete Auto-regressive Variational Attention Models for Text Modeling Xianghong Fang Haoli Bai Jian Li Zenglin Xu Michael Lyu Irwin King 117 3 0 16 Jun 2021
Generative Text Modeling through Short Run InferenceConference of the European Chapter of the Association for Computational Linguistics (EACL), 2021 Bo Pang Erik Nijkamp Tian Han Ying Nian Wu SyDa BDL DRL 174 5 0 27 May 2021
Convex Aggregation for Opinion SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Hayate Iso Xiaolan Wang Yoshihiko Suhara Stefanos Angelidis W. Tan 296 37 0 03 Apr 2021
Disentangling semantics in language through VAEs and a certain architectural choice G. Felhi Joseph Le Roux Djamé Seddah CoGe DRL 88 1 0 24 Dec 2020
Improving Variational Autoencoder for Text Modelling with Timestep-Wise RegularisationInternational Conference on Computational Linguistics (COLING), 2020 Ruizhe Li Xiao Li Guanyi Chen Chenghua Lin DRL 188 17 0 02 Nov 2020
On the Sentence Embeddings from Pre-trained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Bohan Li Hao Zhou Junxian He Mingxuan Wang Yiming Yang Lei Li 168 236 0 02 Nov 2020
Deep Sequence Learning for Video Anticipation: From Discrete and Deterministic to Continuous and Stochastic S. Aliakbarian AI4TS 97 0 0 09 Oct 2020
Narrative Text Generation with a Latent Discrete Plan Harsh Jhamtani Taylor Berg-Kirkpatrick 135 17 0 07 Oct 2020
Stochastic Graph Recurrent Neural NetworkNeurocomputing (Neurocomputing), 2020 Tijin Yan Hongwei Zhang Zirui Li Yuanqing Xia GNN BDL 114 5 0 01 Sep 2020
Learning Sparse Prototypes for Text Generation Junxian He Taylor Berg-Kirkpatrick Graham Neubig 220 24 0 29 Jun 2020
Discrete Latent Variable Representations for Low-Resource Text ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Shuning Jin Sam Wiseman K. Stratos Karen Livescu BDL 162 16 0 11 Jun 2020
A Batch Normalized Inference Network Keeps the KL Vanishing AwayAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Qile Zhu Jianlin Su Wei Bi Xiaojiang Liu Xiyao Ma Xiaolin Li D. Wu BDL DRL 133 64 0 27 Apr 2020
Discrete Variational Attention Models for Language Generation Xianghong Fang Haoli Bai Zenglin Xu Michael Lyu Irwin King DRL 171 0 0 21 Apr 2020
On the Encoder-Decoder Incompatibility in Variational Text Modeling and BeyondAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Chen Henry Wu P. Wang Wenjie Wang DRL 96 4 0 20 Apr 2020
Variational Inference for Learning Representations of Natural Language EditsAAAI Conference on Artificial Intelligence (AAAI), 2020 Edison Marrese-Taylor Machel Reid Y. Matsuo BDL DRL KELM 256 8 0 20 Apr 2020
Do sequence-to-sequence VAEs learn global features of sentences?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Tom Bosc Pascal Vincent SSL 169 9 0 16 Apr 2020
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent SpaceConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Chunyuan Li Xiang Gao Yuan Li Baolin Peng Xiujun Li Yizhe Zhang Jianfeng Gao SSL DRL 341 192 0 05 Apr 2020
Contextually Plausible and Diverse 3D Human Motion Prediction M. S. Aliakbarian F. Saleh L. Petersson Stephen Gould Mathieu Salzmann 3DH 182 3 0 18 Dec 2019
Effective Estimation of Deep Generative Language Models Tom Pelsmaeker Wilker Aziz BDL 218 28 0 17 Apr 2019