ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2001.08785
  4. Cited By
Semi-Autoregressive Training Improves Mask-Predict Decoding

Semi-Autoregressive Training Improves Mask-Predict Decoding

23 January 2020
Marjan Ghazvininejad
Omer Levy
Luke Zettlemoyer
ArXiv (abs)PDFHTML

Papers citing "Semi-Autoregressive Training Improves Mask-Predict Decoding"

49 / 49 papers shown
Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs
Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs
Jaydip Sen
Saptarshi Sengupta
S. Dasgupta
332
4
0
03 Jun 2025
Promises and Pitfalls of Generative Masked Language Modeling:
  Theoretical Framework and Practical Guidelines
Promises and Pitfalls of Generative Masked Language Modeling: Theoretical Framework and Practical Guidelines
Yuchen Li
Alexandre Kirchmeyer
Aashay Mehta
Yilong Qin
Boris Dadachev
Kishore Papineni
Sanjiv Kumar
Andrej Risteski
426
5
0
22 Jul 2024
Leveraging Diverse Modeling Contexts with Collaborating Learning for
  Neural Machine Translation
Leveraging Diverse Modeling Contexts with Collaborating Learning for Neural Machine Translation
Yusheng Liao
Yanfeng Wang
Yu Wang
AI4CE
237
2
0
28 Feb 2024
Improving Non-autoregressive Machine Translation with Error Exposure and
  Consistency Regularization
Improving Non-autoregressive Machine Translation with Error Exposure and Consistency Regularization
Xinran Chen
Sufeng Duan
Gongshen Liu
246
1
0
15 Feb 2024
Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems
Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems
Xupeng Miao
Xupeng Miao
Zhihao Zhang
Xinhao Cheng
Hongyi Jin
Tianqi Chen
Zhihao Jia
569
142
0
23 Dec 2023
Emage: Non-Autoregressive Text-to-Image Generation
Emage: Non-Autoregressive Text-to-Image Generation
Zhangyin Feng
Runyi Hu
Liangxin Liu
Fan Zhang
Duyu Tang
Yong Dai
Xiaocheng Feng
Jiwei Li
Bing Qin
Shuming Shi
DiffMVLM
229
0
0
22 Dec 2023
Non-autoregressive Machine Translation with Probabilistic Context-free
  Grammar
Non-autoregressive Machine Translation with Probabilistic Context-free GrammarNeural Information Processing Systems (NeurIPS), 2023
Shangtong Gui
Chenze Shao
Zhengrui Ma
Xishan Zhang
Yunji Chen
Yang Feng
324
15
0
14 Nov 2023
Encoder-decoder multimodal speaker change detection
Encoder-decoder multimodal speaker change detectionInterspeech (Interspeech), 2023
Jee-weon Jung
Soonshin Seo
Hee-Soo Heo
Geon-min Kim
You Jin Kim
Youngki Kwon
Min-Ji Lee
Bong-Jin Lee
249
3
0
01 Jun 2023
Optimizing Non-Autoregressive Transformers with Contrastive Learning
Optimizing Non-Autoregressive Transformers with Contrastive Learning
Chen An
Jiangtao Feng
Fei Huang
Xipeng Qiu
Dianbo Sui
273
0
0
23 May 2023
Accelerating Transformer Inference for Translation via Parallel Decoding
Accelerating Transformer Inference for Translation via Parallel DecodingAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Andrea Santilli
Silvio Severino
Emilian Postolache
Valentino Maiorca
Michele Mancusi
R. Marin
Emanuele Rodolà
344
126
0
17 May 2023
Dynamic Alignment Mask CTC: Improved Mask-CTC with Aligned Cross Entropy
Dynamic Alignment Mask CTC: Improved Mask-CTC with Aligned Cross EntropyIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Xulong Zhang
Haobin Tang
Jianzong Wang
Ning Cheng
Jian Luo
Jing Xiao
256
4
0
14 Mar 2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language
  Model
AMOM: Adaptive Masking over Masking for Conditional Masked Language ModelAAAI Conference on Artificial Intelligence (AAAI), 2023
Yisheng Xiao
Ruiyang Xu
Lijun Wu
Juntao Li
Tao Qin
Yan-Tie Liu
Hao Fei
181
14
0
13 Mar 2023
Fuzzy Alignments in Directed Acyclic Graph for Non-Autoregressive
  Machine Translation
Fuzzy Alignments in Directed Acyclic Graph for Non-Autoregressive Machine TranslationInternational Conference on Learning Representations (ICLR), 2023
Zhengrui Ma
Chenze Shao
Shangtong Gui
Hao Fei
Yanghe Feng
319
18
0
12 Mar 2023
DINOISER: Diffused Conditional Sequence Learning by Manipulating Noises
DINOISER: Diffused Conditional Sequence Learning by Manipulating Noises
Jiasheng Ye
Zaixiang Zheng
Yu Bao
Lihua Qian
Mingxuan Wang
DiffM
438
61
0
20 Feb 2023
A Reparameterized Discrete Diffusion Model for Text Generation
A Reparameterized Discrete Diffusion Model for Text Generation
Lin Zheng
Jianbo Yuan
Lei Yu
Lingpeng Kong
DiffM
398
144
0
11 Feb 2023
Candidate Soups: Fusing Candidate Results Improves Translation Quality
  for Non-Autoregressive Translation
Candidate Soups: Fusing Candidate Results Improves Translation Quality for Non-Autoregressive TranslationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Huanran Zheng
Wei-wei Zhu
Pengfei Wang
Xiaoling Wang
200
15
0
27 Jan 2023
Diffusion Glancing Transformer for Parallel Sequence to Sequence
  Learning
Diffusion Glancing Transformer for Parallel Sequence to Sequence LearningNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022
Lihua Qian
Mingxuan Wang
Yang Liu
Hao Zhou
DiffM
301
7
0
20 Dec 2022
Uncertainty-Aware Image Captioning
Uncertainty-Aware Image CaptioningAAAI Conference on Artificial Intelligence (AAAI), 2022
Zhengcong Fei
Mingyuan Fan
Li Zhu
Junshi Huang
Xiaoming Wei
Xiaolin K. Wei
UQLM
261
21
0
30 Nov 2022
Continuous diffusion for categorical data
Continuous diffusion for categorical data
Sander Dieleman
Laurent Sartran
Arman Roshannai
Nikolay Savinov
Yaroslav Ganin
...
Conor Durkan
Curtis Hawthorne
Rémi Leblond
Will Grathwohl
J. Adler
DiffM
440
177
0
28 Nov 2022
Hybrid-Regressive Neural Machine Translation
Hybrid-Regressive Neural Machine Translation
Qiang Wang
Xinhui Hu
Ming-Tso Chen
170
5
0
19 Oct 2022
DiMS: Distilling Multiple Steps of Iterative Non-Autoregressive
  Transformers for Machine Translation
DiMS: Distilling Multiple Steps of Iterative Non-Autoregressive Transformers for Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Sajad Norouzi
Rasa Hosseinzadeh
Felipe Pérez
Anthony L. Caterini
170
2
0
07 Jun 2022
Lossless Acceleration for Seq2seq Generation with Aggressive Decoding
Lossless Acceleration for Seq2seq Generation with Aggressive Decoding
Tao Ge
Heming Xia
Xin Sun
Si-Qing Chen
Furu Wei
322
22
0
20 May 2022
Directed Acyclic Transformer for Non-Autoregressive Machine Translation
Directed Acyclic Transformer for Non-Autoregressive Machine TranslationInternational Conference on Machine Learning (ICML), 2022
Fei Huang
Hao Zhou
Yang Liu
Hanguang Li
Shiyu Huang
AI4CE
257
82
0
16 May 2022
A Survey on Non-Autoregressive Generation for Neural Machine Translation
  and Beyond
A Survey on Non-Autoregressive Generation for Neural Machine Translation and BeyondIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Yisheng Xiao
Lijun Wu
Junliang Guo
Juntao Li
Hao Fei
Tao Qin
Tie-Yan Liu
3DVMedImAI4CE
333
121
0
20 Apr 2022
Improving Top-K Decoding for Non-Autoregressive Semantic Parsing via
  Intent Conditioning
Improving Top-K Decoding for Non-Autoregressive Semantic Parsing via Intent ConditioningInternational Conference on Computational Linguistics (COLING), 2022
Geunseob Oh
Rahul Goel
Christopher Hidey
Shachi Paul
Aditya Gupta
Pararth Shah
Rushin Shah
357
2
0
14 Apr 2022
Step-unrolled Denoising Autoencoders for Text Generation
Step-unrolled Denoising Autoencoders for Text Generation
Nikolay Savinov
Junyoung Chung
Mikolaj Binkowski
Erich Elsen
Aaron van den Oord
DiffM
466
139
0
13 Dec 2021
Non-autoregressive End-to-end Speech Translation with Parallel
  Autoregressive Rescoring
Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoring
Hirofumi Inaguma
Yosuke Higuchi
Kevin Duh
Tatsuya Kawahara
Shinji Watanabe
280
13
0
09 Sep 2021
MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive
  Machine Translation
MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation
Pan Xie
Zexian Li
Xiaohui Hu
137
13
0
19 Aug 2021
Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and
  Conditional Speaker Chain
Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain
Pengcheng Guo
Xuankai Chang
Shinji Watanabe
Lei Xie
230
22
0
16 Jun 2021
Duplex Sequence-to-Sequence Learning for Reversible Machine Translation
Duplex Sequence-to-Sequence Learning for Reversible Machine TranslationNeural Information Processing Systems (NeurIPS), 2021
Zaixiang Zheng
Hao Zhou
Shujian Huang
Jiajun Chen
Jingjing Xu
Lei Li
385
13
0
07 May 2021
Can Latent Alignments Improve Autoregressive Machine Translation?
Can Latent Alignments Improve Autoregressive Machine Translation?North American Chapter of the Association for Computational Linguistics (NAACL), 2021
Adi Haviv
Lior Vassertail
Omer Levy
151
5
0
19 Apr 2021
Towards Variable-Length Textual Adversarial Attacks
Towards Variable-Length Textual Adversarial Attacks
Junliang Guo
Zhirui Zhang
Linlin Zhang
Linli Xu
Boxing Chen
Enhong Chen
Weihua Luo
AAML
285
8
0
16 Apr 2021
Source and Target Bidirectional Knowledge Distillation for End-to-end
  Speech Translation
Source and Target Bidirectional Knowledge Distillation for End-to-end Speech TranslationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021
Hirofumi Inaguma
Tatsuya Kawahara
Shinji Watanabe
264
47
0
13 Apr 2021
Non-Autoregressive Semantic Parsing for Compositional Task-Oriented
  Dialog
Non-Autoregressive Semantic Parsing for Compositional Task-Oriented DialogNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021
Arun Babu
Akshat Shrivastava
Armen Aghajanyan
Ahmed Aly
Angela Fan
Marjan Ghazvininejad
172
21
0
11 Apr 2021
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade
Fully Non-autoregressive Neural Machine Translation: Tricks of the TradeFindings (Findings), 2020
Jiatao Gu
X. Kong
353
149
0
31 Dec 2020
Non-Autoregressive Transformer ASR with CTC-Enhanced Decoder Input
Non-Autoregressive Transformer ASR with CTC-Enhanced Decoder InputIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020
Xingcheng Song
Zhiyong Wu
Yiheng Huang
Chao Weng
Jane Polak Scowcroft
Helen Meng
283
42
0
28 Oct 2020
Improved Mask-CTC for Non-Autoregressive End-to-End ASR
Improved Mask-CTC for Non-Autoregressive End-to-End ASRIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020
Yosuke Higuchi
Hirofumi Inaguma
Shinji Watanabe
Tetsuji Ogawa
Tetsunori Kobayashi
444
68
0
26 Oct 2020
Orthros: Non-autoregressive End-to-end Speech Translation with
  Dual-decoder
Orthros: Non-autoregressive End-to-end Speech Translation with Dual-decoderIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020
Hirofumi Inaguma
Yosuke Higuchi
Kevin Duh
Tatsuya Kawahara
Shinji Watanabe
417
26
0
25 Oct 2020
SmBoP: Semi-autoregressive Bottom-up Semantic Parsing
SmBoP: Semi-autoregressive Bottom-up Semantic ParsingNorth American Chapter of the Association for Computational Linguistics (NAACL), 2020
Ohad Rubin
Jonathan Berant
458
180
0
23 Oct 2020
Positioning yourself in the maze of Neural Text Generation: A
  Task-Agnostic Survey
Positioning yourself in the maze of Neural Text Generation: A Task-Agnostic Survey
Khyathi Chandu
A. Black
371
0
0
14 Oct 2020
Inference Strategies for Machine Translation with Conditional Masking
Inference Strategies for Machine Translation with Conditional MaskingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Julia Kreutzer
George F. Foster
Colin Cherry
164
6
0
05 Oct 2020
Glancing Transformer for Non-Autoregressive Neural Machine Translation
Glancing Transformer for Non-Autoregressive Neural Machine Translation
Lihua Qian
Hao Zhou
Yu Bao
Mingxuan Wang
Lin Qiu
Weinan Zhang
Yong Yu
Lei Li
452
178
0
18 Aug 2020
Neural Language Generation: Formulation, Methods, and Evaluation
Neural Language Generation: Formulation, Methods, and Evaluation
Cristina Garbacea
Qiaozhu Mei
411
30
0
31 Jul 2020
Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine
  Translation
Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation
Jungo Kasai
Nikolaos Pappas
Hao Peng
James Cross
Noah A. Smith
514
154
0
18 Jun 2020
Cascaded Text Generation with Markov Transformers
Cascaded Text Generation with Markov TransformersNeural Information Processing Systems (NeurIPS), 2020
Yuntian Deng
Alexander M. Rush
226
16
0
01 Jun 2020
Mask CTC: Non-Autoregressive End-to-End ASR with CTC and Mask Predict
Mask CTC: Non-Autoregressive End-to-End ASR with CTC and Mask Predict
Yosuke Higuchi
Shinji Watanabe
Nanxin Chen
Tetsuji Ogawa
Tetsunori Kobayashi
471
157
0
18 May 2020
Non-Autoregressive Machine Translation with Latent Alignments
Non-Autoregressive Machine Translation with Latent AlignmentsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Chitwan Saharia
William Chan
Saurabh Saxena
Mohammad Norouzi
364
167
0
16 Apr 2020
Aligned Cross Entropy for Non-Autoregressive Machine Translation
Aligned Cross Entropy for Non-Autoregressive Machine TranslationInternational Conference on Machine Learning (ICML), 2020
Marjan Ghazvininejad
Vladimir Karpukhin
Luke Zettlemoyer
Omer Levy
221
121
0
03 Apr 2020
Guiding Non-Autoregressive Neural Machine Translation Decoding with
  Reordering Information
Guiding Non-Autoregressive Neural Machine Translation Decoding with Reordering InformationAAAI Conference on Artificial Intelligence (AAAI), 2019
Qiu Ran
Yankai Lin
Peng Li
Jie Zhou
387
82
0
06 Nov 2019
1
Page 1 of 1