Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2210.15097
Cited By
v1
v2 (latest)
Contrastive Decoding: Open-ended Text Generation as Optimization
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
27 October 2022
Xiang Lisa Li
Ari Holtzman
Daniel Fried
Abigail Z. Jacobs
Jason Eisner
Tatsunori Hashimoto
Luke Zettlemoyer
M. Lewis
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Contrastive Decoding: Open-ended Text Generation as Optimization"
50 / 357 papers shown
Large Language Models can Contrastively Refine their Generation for Better Sentence Representation Learning
North American Chapter of the Association for Computational Linguistics (NAACL), 2023
Huiming Wang
Zhaodonghui Li
Liying Cheng
De Wen Soh
Lidong Bing
287
5
0
17 Oct 2023
Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
Neural Information Processing Systems (NeurIPS), 2023
Huayang Li
Tian Lan
Z. Fu
Deng Cai
Lemao Liu
Nigel Collier
Taro Watanabe
Yixuan Su
206
28
0
16 Oct 2023
VLIS: Unimodal Language Models Guide Multimodal Language Generation
Jiwan Chung
Youngjae Yu
VLM
250
2
0
15 Oct 2023
The Consensus Game: Language Model Generation via Equilibrium Search
Athul Paul Jacob
Songlin Yang
Gabriele Farina
Jacob Andreas
246
34
0
13 Oct 2023
Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity
Cunxiang Wang
Xiaoze Liu
Yuanhao Yue
Xiangru Tang
Tianhang Zhang
...
Linyi Yang
Yongfeng Zhang
Xing Xie
Zheng Zhang
Yue Zhang
HILM
KELM
450
258
0
11 Oct 2023
NEFTune: Noisy Embeddings Improve Instruction Finetuning
International Conference on Learning Representations (ICLR), 2023
Neel Jain
Ping Yeh-Chiang
Yuxin Wen
John Kirchenbauer
Hong-Min Chu
...
Avi Schwarzschild
Aniruddha Saha
Micah Goldblum
Jonas Geiping
Tom Goldstein
296
108
0
09 Oct 2023
Amortizing intractable inference in large language models
International Conference on Learning Representations (ICLR), 2023
Marvin Schmitt
Moksh Jain
Daniel Habermann
Younesse Kaddar
Ullrich Kothe
Stefan T. Radev
Nikolay Malkin
AIFin
BDL
375
78
0
06 Oct 2023
Large Language Model Cascades with Mixture of Thoughts Representations for Cost-efficient Reasoning
International Conference on Learning Representations (ICLR), 2023
Murong Yue
Jie Zhao
Min Zhang
Liang Du
Ziyu Yao
LRM
351
120
0
04 Oct 2023
Closing the Curious Case of Neural Text Degeneration
International Conference on Learning Representations (ICLR), 2023
Matthew Finlayson
John Hewitt
Alexander Koller
Swabha Swayamdipta
Ashish Sabharwal
245
29
0
02 Oct 2023
Language Model Decoding as Direct Metrics Optimization
International Conference on Learning Representations (ICLR), 2023
Haozhe Ji
Pei Ke
Hongning Wang
Shiyu Huang
343
8
0
02 Oct 2023
Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaboration
Qiushi Sun
Zhangyue Yin
Xiang Li
Zhiyong Wu
Xipeng Qiu
Lingpeng Kong
LRM
LLMAG
395
69
0
30 Sep 2023
Self-Specialization: Uncovering Latent Expertise within Large Language Models
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Junmo Kang
Hongyin Luo
Yada Zhu
Jacob A. Hansen
James R. Glass
David D. Cox
Alan Ritter
Rogerio Feris
Leonid Karlinsky
ALM
MoMe
291
6
0
29 Sep 2023
Jointly Training Large Autoregressive Multimodal Models
International Conference on Learning Representations (ICLR), 2023
Emanuele Aiello
L. Yu
Yixin Nie
Armen Aghajanyan
Barlas Oğuz
310
31
0
27 Sep 2023
Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Zheng Chu
Jingchang Chen
Qianglong Chen
Weijiang Yu
Tao He
Haotian Wang
Weihua Peng
Ming-Yuan Liu
Bing Qin
Ting Liu
LRM
AI4CE
496
222
0
27 Sep 2023
Contrastive Decoding Improves Reasoning in Large Language Models
Sean O'Brien
Mike Lewis
SyDa
LRM
ReLM
308
48
0
17 Sep 2023
Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Rico Sennrich
Jannis Vamvas
Alireza Mohammadshahi
HILM
451
53
0
13 Sep 2023
Unsupervised Contrast-Consistent Ranking with Language Models
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Niklas Stoehr
Pengxiang Cheng
Jing Wang
Daniel Preoţiuc-Pietro
Rajarshi Bhowmik
ALM
203
14
0
13 Sep 2023
Does Writing with Language Models Reduce Content Diversity?
International Conference on Learning Representations (ICLR), 2023
Vishakh Padmakumar
He He
436
133
0
11 Sep 2023
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
International Conference on Learning Representations (ICLR), 2023
Yung-Sung Chuang
Yujia Xie
Hongyin Luo
Yoon Kim
James R. Glass
Pengcheng He
HILM
286
284
0
07 Sep 2023
Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning
L. Yu
Bowen Shi
Ramakanth Pasunuru
Benjamin Muller
O. Yu. Golovneva
...
Yaniv Taigman
Maryam Fazel-Zarandi
Asli Celikyilmaz
Luke Zettlemoyer
Armen Aghajanyan
MLLM
269
162
0
05 Sep 2023
Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation
Charles OÑeill
Y. Ting 丁
I. Ciucă
Jack Miller
Thang Bui
SyDa
307
1
0
15 Aug 2023
Lightweight reranking for language model generations
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Siddhartha Jain
Xiaofei Ma
Hao Ding
Bing Xiang
386
9
0
11 Jul 2023
On the Efficacy of Sampling Adapters
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Clara Meister
Tiago Pimentel
Luca Malagutti
Ethan Gotlieb Wilcox
Robert Bamler
339
19
0
07 Jul 2023
PREADD: Prefix-Adaptive Decoding for Controlled Text Generation
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Jonathan Pei
Kevin Kaichuang Yang
Dan Klein
285
29
0
06 Jul 2023
Mitigating the Learning Bias towards Repetition by Self-Contrastive Training for Open-Ended Generation
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Jian Guan
Shiyu Huang
193
1
0
04 Jul 2023
Stay on topic with Classifier-Free Guidance
Guillaume Sanchez
Honglu Fan
Alexander Spangher
Elad Levi
Pawan Sasanka Ammanamanchi
Stella Biderman
3DV
238
69
0
30 Jun 2023
GPT-FinRE: In-context Learning for Financial Relation Extraction using Large Language Models
P. Rajpoot
Ankur P. Parikh
152
16
0
30 Jun 2023
Open-Domain Text Evaluation via Contrastive Distribution Methods
International Conference on Machine Learning (ICML), 2023
Sidi Lu
Hongyi Liu
Asli Celikyilmaz
Tianlu Wang
Nanyun Peng
218
1
0
20 Jun 2023
On the Reliability of Watermarks for Large Language Models
International Conference on Learning Representations (ICLR), 2023
John Kirchenbauer
Jonas Geiping
Yuxin Wen
Manli Shu
Khalid Saifullah
Kezhi Kong
Kasun Fernando
Aniruddha Saha
Micah Goldblum
Tom Goldstein
WaLM
315
176
0
07 Jun 2023
EEL: Efficiently Encoding Lattices for Reranking
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Prasann Singhal
Jiacheng Xu
Xi Ye
Greg Durrett
182
4
0
01 Jun 2023
Less Likely Brainstorming: Using Language Models to Generate Alternative Hypotheses
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Liyan Tang
Yifan Peng
Yanshan Wang
Ying Ding
Greg Durrett
Justin F. Rousseau
192
11
0
30 May 2023
Language Models are Bounded Pragmatic Speakers: Understanding RLHF from a Bayesian Cognitive Modeling Perspective
Khanh Nguyen
LRM
520
9
0
28 May 2023
Robust Natural Language Understanding with Residual Attention Debiasing
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Fei Wang
James Y. Huang
Tianyi Yan
Wenxuan Zhou
Muhao Chen
165
13
0
28 May 2023
MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Shiyue Zhang
Shijie Wu
Ozan Irsoy
Steven Lu
Joey Tianyi Zhou
Mark Dredze
David S. Rosenberg
256
14
0
26 May 2023
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Ximing Lu
Faeze Brahman
Peter West
Jaehun Jang
Khyathi Chandu
...
Bill Yuchen Lin
Skyler Hallinan
Xiang Ren
Sean Welleck
Yejin Choi
326
33
0
24 May 2023
From Shortcuts to Triggers: Backdoor Defense with Denoised PoE
North American Chapter of the Association for Computational Linguistics (NAACL), 2023
Qin Liu
Fei Wang
Chaowei Xiao
Muhao Chen
AAML
280
29
0
24 May 2023
David helps Goliath: Inference-Time Collaboration Between Small Specialized and Large General Diffusion LMs
North American Chapter of the Association for Computational Linguistics (NAACL), 2023
Xiaochuang Han
Sachin Kumar
Yulia Tsvetkov
Marjan Ghazvininejad
DiffM
281
5
0
24 May 2023
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding
North American Chapter of the Association for Computational Linguistics (NAACL), 2023
Weijia Shi
Xiaochuang Han
M. Lewis
Yulia Tsvetkov
Luke Zettlemoyer
Scott Yih
HILM
240
292
0
24 May 2023
Look-back Decoding for Open-Ended Text Generation
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Nan Xu
Chunting Zhou
Asli Celikyilmaz
Xuezhe Ma
191
9
0
22 May 2023
A Frustratingly Simple Decoding Method for Neural Text Generation
International Conference on Language Resources and Evaluation (LREC), 2023
Haoran Yang
Deng Cai
Huayang Li
Wei Bi
Wai Lam
Shuming Shi
175
13
0
22 May 2023
FACE: Evaluating Natural Language Generation with Fourier Analysis of Cross-Entropy
Neural Information Processing Systems (NeurIPS), 2023
Zuhao Yang
Yingfang Yuan
Yang Xu
Shuo Zhan
Huajun Bai
Kefan Chen
CVBM
239
8
0
17 May 2023
Surfacing Biases in Large Language Models using Contrastive Input Decoding
G. Yona
Or Honovich
Itay Laish
Roee Aharoni
211
15
0
12 May 2023
HistAlign: Improving Context Dependency in Language Generation by Aligning with History
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
David Wan
Shiyue Zhang
Joey Tianyi Zhou
AI4TS
192
10
0
08 May 2023
SCOTT: Self-Consistent Chain-of-Thought Distillation
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Jamie Yap
Zhengyang Wang
Zheng Li
K. Lynch
Bing Yin
Xiang Ren
LRM
383
120
0
03 May 2023
The Benefits of Bad Advice: Autocontrastive Decoding across Model Layers
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Ariel Gera
Roni Friedman
Ofir Arviv
Chulaka Gunasekara
Benjamin Sznajder
Noam Slonim
Eyal Shnarch
225
32
0
02 May 2023
Text2Motion: From Natural Language Instructions to Feasible Plans
Autonomous Robots (Auton. Robots), 2023
Kevin Qinghong Lin
Christopher Agia
Toki Migimatsu
Marco Pavone
Jeannette Bohg
LM&Ro
540
361
0
21 Mar 2023
Stealing the Decoding Algorithms of Language Models
Conference on Computer and Communications Security (CCS), 2023
A. Naseh
Kalpesh Krishna
Mohit Iyyer
Amir Houmansadr
MLAU
310
29
0
08 Mar 2023
A Reparameterized Discrete Diffusion Model for Text Generation
Lin Zheng
Jianbo Yuan
Lei Yu
Lingpeng Kong
DiffM
285
115
0
11 Feb 2023
Grounding Language Models to Images for Multimodal Inputs and Outputs
International Conference on Machine Learning (ICML), 2023
Jing Yu Koh
Ruslan Salakhutdinov
Daniel Fried
MLLM
444
150
0
31 Jan 2023
MAUVE Scores for Generative Models: Theory and Practice
Journal of machine learning research (JMLR), 2022
Krishna Pillutla
Lang Liu
John Thickstun
Sean Welleck
Swabha Swayamdipta
Rowan Zellers
Sewoong Oh
Yejin Choi
Zaïd Harchaoui
EGVM
300
30
0
30 Dec 2022
Previous
1
2
3
4
5
6
7
8
Next
