Controlled Text Generation as Continuous Optimization with Multiple Constraints

4 August 2021

Papers citing "Controlled Text Generation as Continuous Optimization with Multiple Constraints"

50 / 63 papers shown

Title
Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo João Loula Benjamin LeBrun Li Du Ben Lipkin Clemente Pasti ... Ryan Cotterel Vikash K. Mansinghka Alexander K. Lew Tim Vieira Timothy J. O'Donnell 32 1 0 17 Apr 2025
PINNverse: Accurate parameter estimation in differential equations from noisy data with constrained physics-informed neural networks Marius Almanstötter Roman Vetter Dagmar Iber PINN 32 1 0 07 Apr 2025
GPT's Devastated and LLaMA's Content: Emotion Representation Alignment in LLMs for Keyword-based Generation Shadab Choudhury Asha Kumar Lara J. Martin 50 0 0 14 Mar 2025
Palette of Language Models: A Solver for Controlled Text Generation Zhe Yang Yi Huang Yaqin Chen Xiaoting Wu Junlan Feng Chao Deng 44 0 0 14 Mar 2025
Growing a Tail: Increasing Output Diversity in Large Language Models Michal Shur-Ofry Bar Horowitz-Amsalem Adir Rahamim Yonatan Belinkov ALM 33 1 0 05 Nov 2024
A Lightweight Multi Aspect Controlled Text Generation Solution For Large Language Models Chenyang Zhang Jiayi Lin Haibo Tong Bingxuan Hou Dongyu Zhang Jialin Li Junli Wang 26 0 0 18 Oct 2024
DiDOTS: Knowledge Distillation from Large-Language-Models for Dementia Obfuscation in Transcribed Speech Dominika Woszczyk Soteris Demetriou 25 0 0 05 Oct 2024
Analysing Zero-Shot Readability-Controlled Sentence Simplification Abdullah Barayan Jose Camacho-Collados Fernando Alva-Manchego 29 1 0 30 Sep 2024
CLIBE: Detecting Dynamic Backdoors in Transformer-based NLP Models Rui Zeng Xi Chen Yuwen Pu Xuhong Zhang Tianyu Du Shouling Ji 41 2 0 02 Sep 2024
Decoding-Time Language Model Alignment with Multiple Objectives Ruizhe Shi Yifang Chen Yushi Hu Alisa Liu Hannaneh Hajishirzi Noah A. Smith Simon Du 44 30 0 27 Jun 2024
TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddings Zachary Horvitz Ajay Patel Kanishk Singh Chris Callison-Burch Kathleen McKeown Zhou Yu 25 3 0 21 Jun 2024
Self-Control of LLM Behaviors by Compressing Suffix Gradient into Prefix Controller Min Cai Yuchen Zhang Shichang Zhang Fan Yin Difan Zou Yisong Yue Ziniu Hu 21 0 0 04 Jun 2024
Multi-Aspect Controllable Text Generation with Disentangled Counterfactual Augmentation Yi Liu Xiangyu Liu Xiangrong Zhu Wei Hu 26 2 0 30 May 2024
Constrained Decoding for Secure Code Generation Yanjun Fu Ethan Baker Yu Ding Yizheng Chen AAML 36 8 0 30 Apr 2024
Outcome-Constrained Large Language Models for Countering Hate Speech Lingzi Hong Pengcheng Luo Eduardo Blanco Xiaoying Song 36 6 0 25 Mar 2024
Language Rectified Flow: Advancing Diffusion Language Generation with Probabilistic Flows Shujian Zhang Lemeng Wu Chengyue Gong Xingchao Liu DiffM 53 3 0 25 Mar 2024
SumTra: A Differentiable Pipeline for Few-Shot Cross-Lingual Summarization Jacob Parnell Inigo Jauregi Unanue Massimo Piccardi 29 2 0 20 Mar 2024
Reinforcement Learning with Token-level Feedback for Controllable Text Generation Wendi Li Wei Wei Kaihe Xu Wenfeng Xie Dangyang Chen Yu Cheng 41 7 0 18 Mar 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 56 17 0 28 Feb 2024
CEV-LM: Controlled Edit Vector Language Model for Shaping Natural Language Generations Samraj Moorjani A. Krishnan Hari Sundaram KELM 32 1 0 22 Feb 2024
Controllable Decontextualization of Yes/No Question and Answers into Factual Statements Lingbo Mo B. Fetahu Oleg Rokhlenko S. Malmasi 24 0 0 18 Jan 2024
A Block Metropolis-Hastings Sampler for Controllable Energy-based Text Generation Jarad Forristal Niloofar Mireshghallah Greg Durrett Taylor Berg-Kirkpatrick 110 4 0 07 Dec 2023
Controlled Text Generation via Language Model Arithmetic Jasper Dekoninck Marc Fischer Luca Beurer-Kellner Martin Vechev 26 36 0 24 Nov 2023
P^3SUM: Preserving Author's Perspective in News Summarization with Diffusion Language Models Yuhan Liu Shangbin Feng Xiaochuang Han Vidhisha Balachandran Chan Young Park Sachin Kumar Yulia Tsvetkov DiffM 36 2 0 16 Nov 2023
Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders Yingji Zhang Marco Valentino Danilo S. Carvalho Ian Pratt-Hartmann André Freitas DRL 21 7 0 14 Nov 2023
Air-Decoding: Attribute Distribution Reconstruction for Decoding-Time Controllable Text Generation Tianqi Zhong Quan Wang Jingxuan Han Yongdong Zhang Zhendong Mao 19 9 0 23 Oct 2023
Controllable Text Generation with Residual Memory Transformer Hanqing Zhang Sun Si Haiming Wu Dawei Song 29 1 0 28 Sep 2023
ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfer Zachary Horvitz Ajay Patel Chris Callison-Burch Zhou Yu Kathleen McKeown DiffM 26 12 0 29 Aug 2023
Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio Allen Roush Sanjay Basu Akshay Moorthy Dmitry Dubovoy 18 7 0 28 Jun 2023
ECGBERT: Understanding Hidden Language of ECGs with Self-Supervised Representation Learning Seokmin Choi Sajad Mousavi Phillip Si Haben Yhdego Fatemeh Khadem Fatemeh Afghah SSL 24 3 0 10 Jun 2023
Sequential Monte Carlo Steering of Large Language Models using Probabilistic Programs Alexander K. Lew Tan Zhi-Xuan Gabriel Grand Vikash K. Mansinghka LLMSV LRM 54 35 0 05 Jun 2023
Structured Voronoi Sampling Afra Amini Li Du Ryan Cotterell DiffM 27 1 0 05 Jun 2023
PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning Faeze Brahman Chandra Bhagavatula Valentina Pyatkin Jena D. Hwang Xiang Lorraine Li H. J. Arai Soumya Sanyal Keisuke Sakaguchi Xiang Ren Yejin Choi LRM 24 0 0 31 May 2023
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning Ximing Lu Faeze Brahman Peter West Jaehun Jang Khyathi Raghavi Chandu ... Bill Yuchen Lin Skyler Hallinan Xiang Ren Sean Welleck Yejin Choi 20 26 0 24 May 2023
Controlling Pre-trained Language Models for Grade-Specific Text Simplification Sweta Agrawal Marine Carpuat 19 14 0 24 May 2023
TalkUp: Paving the Way for Understanding Empowering Language Lucille Njoo Chan Young Park Octavia Stappart Marvin Thielk Yi Chu Yulia Tsvetkov 10 3 0 23 May 2023
Word Embeddings Are Steers for Language Models Chi Han Jialiang Xu Manling Li Yi Ren Fung Chenkai Sun Nan Jiang Tarek F. Abdelzaher Heng Ji LLMSV 24 26 0 22 May 2023
MacLaSa: Multi-Aspect Controllable Text Generation via Efficient Sampling from Compact Latent Space Hanxing Ding Liang Pang Zihao Wei Huawei Shen Xueqi Cheng Tat-Seng Chua DiffM 32 10 0 22 May 2023
BOLT: Fast Energy-based Controlled Text Generation with Tunable Biases Xin Liu Muhammad Khalifa Lu Wang 28 18 0 19 May 2023
Automatically Auditing Large Language Models via Discrete Optimization Erik Jones Anca Dragan Aditi Raghunathan Jacob Steinhardt 35 157 0 08 Mar 2023
Critic-Guided Decoding for Controlled Text Generation Minbeom Kim Hwanhee Lee Kang Min Yoo Joonsuk Park Hwaran Lee Kyomin Jung 31 35 0 21 Dec 2022
Socratic Pretraining: Question-Driven Pretraining for Controllable Summarization Artidoro Pagnoni Alexander R. Fabbri Wojciech Kry'sciñski Chien-Sheng Wu RALM 27 18 0 20 Dec 2022
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text Generation Xuancheng Huang Zijun Liu Peng Li Tao Li Maosong Sun Yang Liu 19 10 0 19 Dec 2022
Plansformer: Generating Symbolic Plans using Transformers Vishal Pallagani Bharath Muppasani K. Murugesan F. Rossi L. Horesh Biplav Srivastava F. Fabiano Andrea Loreggia LM&Ro LLMAG OffRL 15 35 0 16 Dec 2022
Controllable Text Generation via Probability Density Estimation in the Latent Space Yuxuan Gu Xiaocheng Feng Sicheng Ma Lingyuan Zhang Heng Gong Weihong Zhong Bing Qin 19 18 0 16 Dec 2022
Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning Yu Meng Martin Michalski Jiaxin Huang Yu Zhang Tarek F. Abdelzaher Jiawei Han VLM 41 46 0 06 Nov 2022
SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control Xiaochuang Han Sachin Kumar Yulia Tsvetkov 30 79 0 31 Oct 2022
BioNLI: Generating a Biomedical NLI Dataset Using Lexico-semantic Constraints for Adversarial Examples Mohaddeseh Bastan Mihai Surdeanu Niranjan Balasubramanian 21 13 0 26 Oct 2022
DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generation Hanqing Zhang Dawei Song 27 36 0 18 Oct 2022
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey Sachin Kumar Vidhisha Balachandran Lucille Njoo Antonios Anastasopoulos Yulia Tsvetkov ELM 66 85 0 14 Oct 2022