Limitations of Autoregressive Models and Their Alternatives

Limitations of Autoregressive Models and Their Alternatives

22 October 2020

Matthew R. Gormley

Papers citing "Limitations of Autoregressive Models and Their Alternatives"

15 / 15 papers shown

Title
Scaling Diffusion Language Models via Adaptation from Autoregressive Models Shansan Gong Shivam Agarwal Yizhe Zhang Jiacheng Ye Lin Zheng ... Peilin Zhao W. Bi Jiawei Han Hao Peng Lingpeng Kong AI4CE 70 14 0 23 Oct 2024
Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning Jiacheng Ye Jiahui Gao Shansan Gong Lin Zheng Xin Jiang Z. Li Lingpeng Kong DiffM LRM 42 15 0 18 Oct 2024
Detecting Machine-Generated Long-Form Content with Latent-Space Variables Yufei Tian Zeyu Pan Nanyun Peng DeLMO 23 0 0 04 Oct 2024
Local Attention Mechanism: Boosting the Transformer Architecture for Long-Sequence Time Series Forecasting Ignacio Aguilera-Martos Andrés Herrera-Poyatos Julián Luengo Francisco Herrera AI4TS 28 0 0 04 Oct 2024
Principled Gradient-based Markov Chain Monte Carlo for Text Generation Li Du Afra Amini Lucas Torroba Hennigen Xinyan Velocity Yu Jason Eisner Holden Lee Ryan Cotterell BDL 18 1 0 29 Dec 2023
Recurrent Neural Language Models as Probabilistic Finite-state Automata Anej Svete Ryan Cotterell 28 2 0 08 Oct 2023
Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning Jiasheng Ye Zaixiang Zheng Yu Bao Lihua Qian Quanquan Gu DiffM 52 14 0 23 Aug 2023
Mini-Giants: "Small" Language Models and Open Source Win-Win Zhengping Zhou Lezhi Li Xinxi Chen Andy Li SyDa ALM MoE 24 6 0 17 Jul 2023
Likelihood-Based Diffusion Language Models Ishaan Gulrajani Tatsunori B. Hashimoto DiffM 18 51 0 30 May 2023
Faith and Fate: Limits of Transformers on Compositionality Nouha Dziri Ximing Lu Melanie Sclar Xiang Lorraine Li Liwei Jian ... Sean Welleck Xiang Ren Allyson Ettinger Zaïd Harchaoui Yejin Choi ReLM LRM 28 327 0 29 May 2023
Stochastic Code Generation Swapnil Sharma Nikita Anand V. KranthiKiranG. SyDa 14 0 0 14 Apr 2023
Imitating Human Behaviour with Diffusion Models Tim Pearce Tabish Rashid Anssi Kanervisto David Bignell Mingfei Sun ... Sergio Valcarcel Macua Shan Zheng Tan Ida Momennejad Katja Hofmann Sam Devlin DiffM 20 203 0 25 Jan 2023
HYPRO: A Hybridly Normalized Probabilistic Model for Long-Horizon Prediction of Event Sequences Siqiao Xue X. Shi James Y. Zhang Hongyuan Mei AI4TS 11 34 0 04 Oct 2022
Sequence-to-Sequence Learning with Latent Neural Grammars Yoon Kim 25 40 0 02 Sep 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018