Gradient-Based Constrained Sampling from Language Models

25 May 2022

Papers citing "Gradient-Based Constrained Sampling from Language Models"

50 / 51 papers shown

Title
Semantic Probabilistic Control of Language Models Kareem Ahmed Catarina G Belém Padhraic Smyth Sameer Singh 35 0 0 04 May 2025
TRACE Back from the Future: A Probabilistic Reasoning Approach to Controllable Language Generation Gwen Yidou Weng Benjie Wang Guy Van den Broeck BDL 36 0 0 25 Apr 2025
Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo João Loula Benjamin LeBrun Li Du Ben Lipkin Clemente Pasti ... Ryan Cotterel Vikash K. Mansinghka Alexander K. Lew Tim Vieira Timothy J. O'Donnell 29 1 0 17 Apr 2025
Sample, Don't Search: Rethinking Test-Time Alignment for Language Models Gonçalo Faria Noah A. Smith 22 0 0 04 Apr 2025
Palette of Language Models: A Solver for Controlled Text Generation Zhe Yang Yi Huang Yaqin Chen Xiaoting Wu Junlan Feng Chao Deng 38 0 0 14 Mar 2025
Constrained Language Generation with Discrete Diffusion Models Michael Cardei Jacob K Christopher Thomas Hartvigsen Brian Bartoldson B. Kailkhura Ferdinando Fioretto DiffM 55 0 0 12 Mar 2025
Robust Multi-Objective Controlled Decoding of Large Language Models Seongho Son William Bankes Sangwoong Yoon Shyam Sundhar Ramesh Xiaohang Tang Ilija Bogunovic 39 0 0 11 Mar 2025
REINFORCE Adversarial Attacks on Large Language Models: An Adaptive, Distributional, and Semantic Objective Simon Geisler Tom Wollschlager M. H. I. Abdalla Vincent Cohen-Addad Johannes Gasteiger Stephan Günnemann AAML 81 2 0 24 Feb 2025
Sequence-level Large Language Model Training with Contrastive Preference Optimization Zhili Feng Dhananjay Ram Cole Hawkins Aditya Rawal Jinman Zhao Sheng Zha 57 0 0 23 Feb 2025
Growing a Tail: Increasing Output Diversity in Large Language Models Michal Shur-Ofry Bar Horowitz-Amsalem Adir Rahamim Yonatan Belinkov ALM 33 0 0 05 Nov 2024
Non-Halting Queries: Exploiting Fixed Points in LLMs Ghaith Hammouri Kemal Derya B. Sunar 26 0 0 08 Oct 2024
Locate&Edit: Energy-based Text Editing for Efficient, Flexible, and Faithful Controlled Text Generation Hye Ryung Son Jay-Yoon Lee 25 0 0 30 Jun 2024
Decoding-Time Language Model Alignment with Multiple Objectives Ruizhe Shi Yifang Chen Yushi Hu Alisa Liu Hannaneh Hajishirzi Noah A. Smith Simon Du 41 30 0 27 Jun 2024
Self-Control of LLM Behaviors by Compressing Suffix Gradient into Prefix Controller Min Cai Yuchen Zhang Shichang Zhang Fan Yin Difan Zou Yisong Yue Ziniu Hu 21 0 0 04 Jun 2024
Grammar-Aligned Decoding Kanghee Park Jiayu Wang Taylor Berg-Kirkpatrick Nadia Polikarpova Loris Dántoni 21 9 0 31 May 2024
QUEST: Quality-Aware Metropolis-Hastings Sampling for Machine Translation Gonccalo R. A. Faria Sweta Agrawal António Farinhas Ricardo Rei José G. C. de Souza André F. T. Martins 19 4 0 28 May 2024
Controllable Text Generation in the Instruction-Tuning Era D. Ashok Barnabás Póczos 32 6 0 02 May 2024
Constrained Decoding for Secure Code Generation Yanjun Fu Ethan Baker Yu Ding Yizheng Chen AAML 18 1 0 30 Apr 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 42 17 0 28 Feb 2024
Attacking Large Language Models with Projected Gradient Descent Simon Geisler Tom Wollschlager M. H. I. Abdalla Johannes Gasteiger Stephan Günnemann AAML SILM 42 48 0 14 Feb 2024
Effective Controllable Bias Mitigation for Classification and Retrieval using Gate Adapters Shahed Masoudian Cornelia Volaucnik Markus Schedl Navid Rekabsaz 11 5 0 29 Jan 2024
Black-Box Access is Insufficient for Rigorous AI Audits Stephen Casper Carson Ezell Charlotte Siegmann Noam Kolt Taylor Lynn Curtis ... Michael Gerovitch David Bau Max Tegmark David M. Krueger Dylan Hadfield-Menell AAML 13 75 0 25 Jan 2024
Fluent dreaming for language models T. B. Thompson Zygimantas Straznickas Michael Sklar VLM 14 2 0 24 Jan 2024
DeepEdit: Knowledge Editing as Decoding with Constraints Yiwei Wang Muhao Chen Nanyun Peng Kai-Wei Chang KELM 16 26 0 19 Jan 2024
Can Large Language Model Summarizers Adapt to Diverse Scientific Communication Goals? Marcio Fonseca Shay B. Cohen 36 10 0 18 Jan 2024
An Autoregressive Text-to-Graph Framework for Joint Entity and Relation Extraction Urchade Zaratiana Nadi Tomeh Pierre Holat Thierry Charnois 28 15 0 02 Jan 2024
Learning to Generate Text in Arbitrary Writing Styles Aleem Khan Andrew Wang Sophia Hager Nicholas Andrews 8 4 0 28 Dec 2023
Fast sampling from constrained spaces using the Metropolis-adjusted Mirror Langevin algorithm Vishwak Srinivasan Andre Wibisono Ashia C. Wilson 17 7 0 14 Dec 2023
A Block Metropolis-Hastings Sampler for Controllable Energy-based Text Generation Jarad Forristal Niloofar Mireshghallah Greg Durrett Taylor Berg-Kirkpatrick 102 2 0 07 Dec 2023
Controlled Text Generation via Language Model Arithmetic Jasper Dekoninck Marc Fischer Luca Beurer-Kellner Martin Vechev 24 36 0 24 Nov 2023
P^3SUM: Preserving Author's Perspective in News Summarization with Diffusion Language Models Yuhan Liu Shangbin Feng Xiaochuang Han Vidhisha Balachandran Chan Young Park Sachin Kumar Yulia Tsvetkov DiffM 20 2 0 16 Nov 2023
Generating Summaries with Controllable Readability Levels Leonardo F. R. Ribeiro Mohit Bansal Markus Dreyer 43 19 0 16 Oct 2023
KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection Sehyun Choi Tianqing Fang Zhaowei Wang Yangqiu Song 19 32 0 13 Oct 2023
A Geometric Notion of Causal Probing Clément Guerner Anej Svete Tianyu Liu Alex Warstadt Ryan Cotterell LLMSV 24 12 0 27 Jul 2023
How Does Diffusion Influence Pretrained Language Models on Out-of-Distribution Data? Huazheng Wang Daixuan Cheng Haifeng Sun Jingyu Wang Q. Qi Jianxin Liao Jing Wang Cong Liu 8 0 0 26 Jul 2023
Explore, Establish, Exploit: Red Teaming Language Models from Scratch Stephen Casper Jason Lin Joe Kwon Gatlen Culp Dylan Hadfield-Menell AAML 8 83 0 15 Jun 2023
ChatGPT vs Human-authored Text: Insights into Controllable Text Summarization and Sentence Style Transfer Dongqi Pu Vera Demberg DeLMO 26 64 0 13 Jun 2023
Extrapolating Multilingual Understanding Models as Multilingual Generators Bohong Wu Fei Yuan Hai Zhao Lei Li Jingjing Xu AI4CE 15 2 0 22 May 2023
Word Embeddings Are Steers for Language Models Chi Han Jialiang Xu Manling Li Yi Ren Fung Chenkai Sun Nan Jiang Tarek F. Abdelzaher Heng Ji LLMSV 19 10 0 22 May 2023
Revisiting the Architectures like Pointer Networks to Efficiently Improve the Next Word Distribution, Summarization Factuality, and Beyond Haw-Shiuan Chang Zonghai Yao Alolika Gon Hong-ye Yu Andrew McCallum 17 10 0 20 May 2023
BOLT: Fast Energy-based Controlled Text Generation with Tunable Biases Xin Liu Muhammad Khalifa Lu Wang 12 11 0 19 May 2023
Controlled Text Generation with Natural Language Instructions Wangchunshu Zhou Yuchen Eleanor Jiang Ethan Gotlieb Wilcox Ryan Cotterell Mrinmaya Sachan 143 84 0 27 Apr 2023
Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery Yuxin Wen Neel Jain John Kirchenbauer Micah Goldblum Jonas Geiping Tom Goldstein VLM DiffM 8 247 1 07 Feb 2023
Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too? Weijia Shi Xiaochuang Han Hila Gonen Ari Holtzman Yulia Tsvetkov Luke Zettlemoyer 19 41 0 20 Dec 2022
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey Sachin Kumar Vidhisha Balachandran Lucille Njoo Antonios Anastasopoulos Yulia Tsvetkov ELM 61 59 0 14 Oct 2022
Diffusion-LM Improves Controllable Text Generation Xiang Lisa Li John Thickstun Ishaan Gulrajani Percy Liang Tatsunori B. Hashimoto AI4CE 163 768 0 27 May 2022
A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond Yisheng Xiao Lijun Wu Junliang Guo Juntao Li M. Zhang Tao Qin Tie-Yan Liu 3DV MedIm AI4CE 14 81 0 20 Apr 2022
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics Artidoro Pagnoni Vidhisha Balachandran Yulia Tsvetkov HILM 215 305 0 27 Apr 2021
Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed Eric Luhman Troy Luhman DiffM 175 256 0 07 Jan 2021
Fine-Tuning Language Models from Human Preferences Daniel M. Ziegler Nisan Stiennon Jeff Wu Tom B. Brown Alec Radford Dario Amodei Paul Christiano G. Irving ALM 273 1,561 0 18 Sep 2019