Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinement

19 February 2018

Papers citing "Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinement"

50 / 78 papers shown

Title
FlowTok: Flowing Seamlessly Across Text and Image Tokens Ju He Qihang Yu Qihao Liu Liang-Chieh Chen 66 0 0 13 Mar 2025
FourierNAT: A Fourier-Mixing-Based Non-Autoregressive Transformer for Parallel Sequence Generation Andrew Kiruluta Eric Lundy Andreas Lemos AI4TS 39 0 0 04 Mar 2025
Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning Jiacheng Ye Jiahui Gao Shansan Gong Lin Zheng Xin Jiang Z. Li Lingpeng Kong DiffM LRM 46 15 0 18 Oct 2024
Beyond Next Token Prediction: Patch-Level Training for Large Language Models Chenze Shao Fandong Meng Jie Zhou 41 1 0 17 Jul 2024
Non-autoregressive Personalized Bundle Generation Wenchuan Yang Cheng Yang Jichao Li Yuejin Tan Xin Lu Chuan Shi 28 0 0 11 Jun 2024
Exploration of Masked and Causal Language Modelling for Text Generation Nicolo Micheletti Samuel Belkadi Lifeng Han Goran Nenadic 39 6 0 21 May 2024
GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding Konstantin Yakovlev Alexander Podolskiy A. Bout Sergey I. Nikolenko Irina Piontkovskaya 23 4 0 14 Nov 2023
Text Embeddings Reveal (Almost) As Much As Text John X. Morris Volodymyr Kuleshov Vitaly Shmatikov Alexander M. Rush RALM 26 94 0 10 Oct 2023
TranSFormer: Slow-Fast Transformer for Machine Translation Bei Li Yi Jing Xu Tan Zhen Xing Tong Xiao Jingbo Zhu 41 7 0 26 May 2023
NAIL: Lexical Retrieval Indices with Efficient Non-Autoregressive Decoders Livio Baldini Soares D. Gillick Jeremy R. Cole Tom Kwiatkowski 24 1 0 23 May 2023
Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline Zangwei Zheng Xiaozhe Ren Fuzhao Xue Yang Luo Xin Jiang Yang You 28 54 0 22 May 2023
Extrapolating Multilingual Understanding Models as Multilingual Generators Bohong Wu Fei Yuan Hai Zhao Lei Li Jingjing Xu AI4CE 25 2 0 22 May 2023
A Reparameterized Discrete Diffusion Model for Text Generation Lin Zheng Jianbo Yuan Lei Yu Lingpeng Kong DiffM 28 57 0 11 Feb 2023
Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise Zheng-Wen Lin Yeyun Gong Yelong Shen Tong Wu Zhihao Fan Chen Lin Nan Duan Weizhu Chen AI4CE DiffM VLM 27 60 0 22 Dec 2022
AutoTemplate: A Simple Recipe for Lexically Constrained Text Generation Hayate Iso 24 7 0 15 Nov 2022
SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control Xiaochuang Han Sachin Kumar Yulia Tsvetkov 30 79 0 31 Oct 2022
ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text Generation Junyi Li Tianyi Tang Wayne Xin Zhao J. Nie Ji-Rong Wen 22 17 0 24 Oct 2022
Bilingual Synchronization: Restoring Translational Relationships with Editing Operations Jitao Xu Josep Crego François Yvon 27 4 0 24 Oct 2022
Categorizing Semantic Representations for Neural Machine Translation Yongjing Yin Yafu Li Fandong Meng Jie Zhou Yue Zhang 16 6 0 13 Oct 2022
Viterbi Decoding of Directed Acyclic Transformer for Non-Autoregressive Machine Translation Chenze Shao Zhengrui Ma Yang Feng 34 14 0 11 Oct 2022
Momentum Transformer: Closing the Performance Gap Between Self-attention and Its Linearization T. Nguyen Richard G. Baraniuk Robert M. Kirby Stanley J. Osher Bao Wang 21 9 0 01 Aug 2022
Why is constrained neural language generation particularly challenging? Cristina Garbacea Qiaozhu Mei 59 14 0 11 Jun 2022
LegoNN: Building Modular Encoder-Decoder Models Siddharth Dalmia Dmytro Okhonko M. Lewis Sergey Edunov Shinji Watanabe Florian Metze Luke Zettlemoyer Abdel-rahman Mohamed AuLLM MoE 16 13 0 07 Jun 2022
Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarization Puyuan Liu Chenyang Huang Lili Mou 22 20 0 28 May 2022
Diffusion-LM Improves Controllable Text Generation Xiang Lisa Li John Thickstun Ishaan Gulrajani Percy Liang Tatsunori B. Hashimoto AI4CE 173 773 0 27 May 2022
Learning to Model Editing Processes Machel Reid Graham Neubig KELM BDL 101 35 0 24 May 2022
Twist Decoding: Diverse Generators Guide Each Other Jungo Kasai Keisuke Sakaguchi Ronan Le Bras Hao Peng Ximing Lu Dragomir R. Radev Yejin Choi Noah A. Smith SyDa 19 4 0 19 May 2022
Multi-segment preserving sampling for deep manifold sampler Daniel Berenberg Jae Hyeon Lee S. Kelow Ji Won Park Andrew Watkins Vladimir Gligorijević Richard Bonneau Stephen Ra Kyunghyun Cho MedIm 11 5 0 09 May 2022
Non-Autoregressive Machine Translation: It's Not as Fast as it Seems Jindvrich Helcl Barry Haddow Alexandra Birch 19 19 0 04 May 2022
$$\textit{latent}$-GLAT: Glancing at Latent Variables for Parallel Text Generation$ $\textit{latent}$ -GLAT: Glancing at Latent Variables for Parallel Text Generation Yu Bao Hao Zhou Shujian Huang Dongqi Wang Lihua Qian Xinyu Dai Jiajun Chen Lei Li 23 38 0 05 Apr 2022
Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoders Samuel Stanton Wesley J. Maddox Nate Gruver Phillip M. Maffettone E. Delaney Peyton Greenside A. Wilson BDL 31 89 0 23 Mar 2022
Can Multilinguality benefit Non-autoregressive Machine Translation? Sweta Agrawal Julia Kreutzer Colin Cherry AI4CE 27 1 0 16 Dec 2021
Monotonic Simultaneous Translation with Chunk-wise Reordering and Refinement HyoJung Han Seokchan Ahn Yoonjung Choi Insoo Chung Sangha Kim Kyunghyun Cho 25 6 0 18 Oct 2021
Semi-Autoregressive Image Captioning Xu Yan Zhengcong Fei Zekang Li Shuhui Wang Qingming Huang Qi Tian 27 23 0 11 Oct 2021
Integrated Training for Sequence-to-Sequence Models Using Non-Autoregressive Transformer E. Tokarchuk Jan Rosendahl Weiyue Wang Pavel Petrushkov Tomer Lancewicki Shahram Khadivi Hermann Ney 23 2 0 27 Sep 2021
Parallel Refinements for Lexically Constrained Text Generation with BART Xingwei He 24 39 0 26 Sep 2021
AligNART: Non-autoregressive Neural Machine Translation by Jointly Learning to Estimate Alignment and Translate Jongyoon Song Sungwon Kim Sungroh Yoon 66 37 0 14 Sep 2021
Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy Shaolei Zhang Yang Feng MoE 12 39 0 11 Sep 2021
Mixup Decoding for Diverse Machine Translation Jicheng Li Pengzhi Gao Xuanfu Wu Yang Feng Zhongjun He Hua-Hong Wu Haifeng Wang 19 14 0 08 Sep 2021
MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation Pan Xie Zexian Li Xiaohui Hu 26 11 0 19 Aug 2021
Learning to Complete Code with Sketches Daya Guo Alexey Svyatkovskiy Jian Yin Nan Duan Marc Brockschmidt Miltiadis Allamanis 13 40 0 18 Jun 2021
Learning to Efficiently Sample from Diffusion Probabilistic Models Daniel Watson Jonathan Ho Mohammad Norouzi William Chan DiffM 37 134 0 07 Jun 2021
M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformers Zhu Zhang Jianxin Ma Chang Zhou Rui Men Zhikang Li Ming Ding Jie Tang Jingren Zhou Hongxia Yang 25 46 0 29 May 2021
Going deeper with Image Transformers Hugo Touvron Matthieu Cord Alexandre Sablayrolles Gabriel Synnaeve Hervé Jégou ViT 23 986 0 31 Mar 2021
Non-Autoregressive Translation by Learning Target Categorical Codes Yu Bao Shujian Huang Tong Xiao Dongqi Wang Xinyu Dai Jiajun Chen 16 35 0 21 Mar 2021
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade Jiatao Gu X. Kong 17 135 0 31 Dec 2020
Neural Machine Translation: A Review of Methods, Resources, and Tools Zhixing Tan Shuo Wang Zonghan Yang Gang Chen Xuancheng Huang Maosong Sun Yang Liu 3DV AI4TS 13 105 0 31 Dec 2020
Understanding and Improving Lexical Choice in Non-Autoregressive Translation Liang Ding Longyue Wang Xuebo Liu Derek F. Wong Dacheng Tao Zhaopeng Tu 93 77 0 29 Dec 2020
Parallel Tacotron: Non-Autoregressive and Controllable TTS Isaac Elias Heiga Zen Jonathan Shen Yu Zhang Ye Jia Ron J. Weiss Yonghui Wu DRL 11 102 0 22 Oct 2020
Infusing Sequential Information into Conditional Masked Translation Model with Self-Review Mechanism Pan Xie Zhi Cui Xiuying Chen Xiaohui Hu Jianwei Cui Bin Wang 134 9 0 19 Oct 2020