Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishing

25 March 2019

Xiaodong Liu

Lawrence Carin

Papers citing "Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishing"

50 / 54 papers shown

Title
AI-based particle track identification in scintillating fibres read out with imaging sensors Noemi Bührer Saúl Alonso-Monsalve Matthew Franks Till Dieminger D. Sgalaberna 26 0 0 14 Oct 2024
Relative Representations: Topological and Geometric Perspectives Alejandro García-Castellanos G. Marchetti Danica Kragic Martina Scolamiero 48 0 0 17 Sep 2024
A Deep Generative Learning Approach for Two-stage Adaptive Robust Optimization Aron Brenner Rahman Khorramfar Jennifer Sun Saurabh Amin 23 0 0 05 Sep 2024
stl2vec: Semantic and Interpretable Vector Representation of Temporal Logic Gaia Saveri L. Nenzi Luca Bortolussi Jan Křetínský 30 0 0 23 May 2024
Latent Feature-Guided Diffusion Models for Shadow Removal Kangfu Mei Luis Figueroa Zhe-nan Lin Zhihong Ding Scott D. Cohen Vishal M. Patel DiffM 26 18 0 04 Dec 2023
Matching aggregate posteriors in the variational autoencoder Surojit Saha Sarang Joshi Ross T. Whitaker DRL 29 4 0 13 Nov 2023
RegaVAE: A Retrieval-Augmented Gaussian Mixture Variational Auto-Encoder for Language Modeling Jingcheng Deng Liang Pang Huawei Shen Xueqi Cheng RALM 21 10 0 16 Oct 2023
Causal Dynamic Variational Autoencoder for Counterfactual Regression in Longitudinal Data Mouad El Bouchattaoui Myriam Tami Benoit Lepetit P. Cournède CML OOD 63 2 0 16 Oct 2023
BodyFormer: Semantics-guided 3D Body Gesture Synthesis with Transformer Kunkun Pang Dafei Qin Yingruo Fan Julian Habekost Takaaki Shiratori Junichi Yamagishi Taku Komura SLR ViT 21 19 0 07 Sep 2023
Virtual Human Generative Model: Masked Modeling Approach for Learning Human Characteristics Kenta Oono Nontawat Charoenphakdee K. Bito Zhengyan Gao Yoshiaki Ota ... Kohei Hayashi Yuki Saito Koki Tsuda Hiroshi Maruyama K. Hayashi 30 1 0 19 Jun 2023
Explainable Recommender with Geometric Information Bottleneck Hanqi Yan Lin Gui Menghan Wang Kun Zhang Yulan He 13 2 0 09 May 2023
Discouraging posterior collapse in hierarchical Variational Autoencoders using context Anna Kuzina Jakub M. Tomczak BDL DRL 23 1 0 20 Feb 2023
Diffusion-based Generation, Optimization, and Planning in 3D Scenes Siyuan Huang Zan Wang Puhao Li Baoxiong Jia Tengyu Liu Yixin Zhu Wei Liang Song-Chun Zhu DiffM 64 199 0 15 Jan 2023
eVAE: Evolutionary Variational Autoencoder Zhangkai Wu LongBing Cao Lei Qi BDL DRL 30 10 0 01 Jan 2023
DuNST: Dual Noisy Self Training for Semi-Supervised Controllable Text Generation Yuxi Feng Xiaoyuan Yi Xiting Wang L. Lakshmanan Xing Xie DiffM 35 5 0 16 Dec 2022
An Overview on Controllable Text Generation via Variational Auto-Encoders Haoqin Tu Yitong Li BDL 21 2 0 15 Nov 2022
Clinically Plausible Pathology-Anatomy Disentanglement in Patient Brain MRI with Structured Variational Priors Anjun Hu J. Falet Brennan Nichyporuk Changjian Shui Douglas L. Arnold Sotirios A. Tsaftaris Tal Arbel 21 2 0 15 Nov 2022
Hierarchically Structured Task-Agnostic Continual Learning Heinke Hihn Daniel A. Braun BDL CLL 19 8 0 14 Nov 2022
Recurrence Boosts Diversity! Revisiting Recurrent Latent Variable in Transformer-Based Variational AutoEncoder for Diverse Text Generation Jinyi Hu Xiaoyuan Yi Wenhao Li Maosong Sun Xingxu Xie DRL 19 0 0 22 Oct 2022
Learning to Drop Out: An Adversarial Approach to Training Sequence VAEs Ðorðe Miladinovic Kumar Shridhar Kushal Kumar Jain Max B. Paulus J. M. Buhmann Mrinmaya Sachan Carl Allen DRL 21 5 0 26 Sep 2022
Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generation Jinyi Hu Xiaoyuan Yi Wenhao Li Maosong Sun Xing Xie 21 21 0 13 Jul 2022
AS-IntroVAE: Adversarial Similarity Distance Makes Robust IntroVAE Chang-Tien Lu Shen Zheng Zirui Wang O. Dib Gaurav Gupta 29 3 0 28 Jun 2022
NeMF: Neural Motion Fields for Kinematic Animation Chen He Jun Saito James Zachary Holly Rushmeier Yi Zhou 3DH 21 45 0 04 Jun 2022
Competency Assessment for Autonomous Agents using Deep Generative Models Aastha Acharya Rebecca L. Russell Nisar R. Ahmed 26 10 0 23 Mar 2022
Cyclical Variational Bayes Monte Carlo for Efficient Multi-Modal Posterior Distributions Evaluation F. Igea Alice Cicirello 24 8 0 23 Feb 2022
Anomaly Detection of Wind Turbine Time Series using Variational Recurrent Autoencoders Alan Preciado-Grijalva Victor Rodrigo Iza-Teran 8 2 0 05 Dec 2021
Exploring Social Posterior Collapse in Variational Autoencoder for Interaction Modeling Chen Tang Wei Zhan M. Tomizuka DRL 29 19 0 01 Dec 2021
MUGL: Large Scale Multi Person Conditional Action Generation with Locomotion Shubh Maheshwari Debtanu Gupta Ravi Kiran Sarvadevabhatla 34 19 0 21 Oct 2021
How To Not Drive: Learning Driving Constraints from Demonstration K. Rezaee Peyman Yadmellat 28 3 0 01 Oct 2021
A Conditional Generative Matching Model for Multi-lingual Reply Suggestion Budhaditya Deb Guoqing Zheng Milad Shokouhi Ahmed Hassan Awadallah 31 1 0 15 Sep 2021
Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classification Bo Pang Ying Nian Wu 21 18 0 26 Aug 2021
Meta-learning Amidst Heterogeneity and Ambiguity Kyeongryeol Go Seyoung Yun 24 1 0 05 Jul 2021
Discrete Auto-regressive Variational Attention Models for Text Modeling Xianghong Fang Haoli Bai Jian Li Zenglin Xu Michael Lyu Irwin King 34 3 0 16 Jun 2021
MuseMorphose: Full-Song and Fine-Grained Piano Music Style Transfer with One Transformer VAE Shih-Lun Wu Yi-Hsuan Yang ViT 17 53 0 10 May 2021
Beyond Trivial Counterfactual Explanations with Diverse Valuable Explanations Pau Rodríguez López Massimo Caccia Alexandre Lacoste L. Zamparo I. Laradji Laurent Charlin David Vazquez AAML 31 55 0 18 Mar 2021
Provable Super-Convergence with a Large Cyclical Learning Rate Samet Oymak 33 12 0 22 Feb 2021
Dynamic $β$ -VAEs for quantifying biodiversity by clustering optically recorded insect signals Klas Rydhmer Raghavendra Selvan DRL 19 7 0 10 Feb 2021
Generative Capacity of Probabilistic Protein Sequence Models Francisco McGee Quentin Novinger R. Levy Vincenzo Carnevale A. Haldane 24 34 0 03 Dec 2020
Improving Text Generation with Student-Forcing Optimal Transport Guoyin Wang Chunyuan Li Jianqiao Li Hao Fu Yuh-Chen Lin ... Ruiyi Zhang Wenlin Wang Dinghan Shen Qian Yang Lawrence Carin OT 22 17 0 12 Oct 2020
Implicit Latent Variable Model for Scene-Consistent Motion Forecasting Sergio Casas Cole Gulino Simon Suo Katie Z Luo Renjie Liao R. Urtasun 152 155 0 23 Jul 2020
Sequential Segment-based Level Generation and Blending using Variational Autoencoders Anurag Sarkar Seth Cooper 3DV 19 26 0 17 Jul 2020
Single-partition adaptive Q-learning J. Araújo Mário A. T. Figueiredo M. Botto OffRL 18 2 0 14 Jul 2020
Bayesian Neural Networks at Scale: A Performance Analysis and Pruning Study Himanshu Sharma Elise Jennings BDL 27 3 0 23 May 2020
A Batch Normalized Inference Network Keeps the KL Vanishing Away Qile Zhu Jianlin Su Wei Bi Xiaojiang Liu Xiyao Ma Xiaolin Li D. Wu BDL DRL 34 61 0 27 Apr 2020
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space Chunyuan Li Xiang Gao Yuan Li Baolin Peng Xiujun Li Yizhe Zhang Jianfeng Gao SSL DRL 30 181 0 05 Apr 2020
ML4Chem: A Machine Learning Package for Chemistry and Materials Science Muammar El Khatib W. A. Jong VLM 16 6 0 02 Mar 2020
Gravitational-wave parameter estimation with autoregressive neural network flows Stephen R. Green C. Simpson J. Gair BDL 83 87 0 18 Feb 2020
Unsupervised Opinion Summarization as Copycat-Review Generation Arthur Brazinskas Mirella Lapata Ivan Titov 22 125 0 06 Nov 2019
Probabilistic Forecasting using Deep Generative Models A. Fanfarillo B. Roozitalab Weiming Hu G. Cervone 17 17 0 26 Sep 2019
A Surprisingly Effective Fix for Deep Latent Variable Modeling of Text Bohan Li Junxian He Graham Neubig Taylor Berg-Kirkpatrick Yiming Yang DRL 11 70 0 02 Sep 2019