A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models

14 January 2022

Papers citing "A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models"

50 / 107 papers shown

Title
ControlCap: Controllable Region-level Captioning Yuzhong Zhao Yue Liu Zonghao Guo Weijia Wu Chen Gong Fang Wan QiXiang Ye 24 5 0 31 Jan 2024
Weight subcloning: direct initialization of transformers using larger pretrained ones Mohammad Samragh Mehrdad Farajtabar Sachin Mehta Raviteja Vemulapalli Fartash Faghri Devang Naik Oncel Tuzel Mohammad Rastegari 11 25 0 14 Dec 2023
Successor Features for Efficient Multisubject Controlled Text Generation Mengyao Cao Mehdi Fatemi Jackie Chi Kit Cheung Samira Shabanian BDL 18 0 0 03 Nov 2023
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models Luiza Amador Pozzobon B. Ermiş Patrick Lewis Sara Hooker 18 20 0 11 Oct 2023
Reward Dropout Improves Control: Bi-objective Perspective on Reinforced LM Changhun Lee Chiehyeon Lim 15 0 0 06 Oct 2023
What's the Magic Word? A Control Theory of LLM Prompting Aman Bhargava Cameron Witkowski Manav Shah Matt W. Thomson LLMAG 43 29 0 02 Oct 2023
Controllable Text Generation with Residual Memory Transformer Hanqing Zhang Sun Si Haiming Wu Dawei Song 16 1 0 28 Sep 2023
Is it Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Models Asma Farajidizaji Vatsal Raina Mark J. F. Gales 16 1 0 22 Sep 2023
Toward Unified Controllable Text Generation via Regular Expression Instruction Xin Zheng Hongyu Lin Xianpei Han Le Sun 44 4 0 19 Sep 2023
Towards an On-device Agent for Text Rewriting Yun Zhu Yinxiao Liu Felix Stahlberg Shankar Kumar Yu-hui Chen Liangchen Luo Lei Shu Renjie Liu Jindong Chen Lei Meng LLMAG 19 6 0 22 Aug 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap Shirui Pan Linhao Luo Yufei Wang Chen Chen Jiapu Wang Xindong Wu KELM 24 684 0 14 Jun 2023
Artificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Tasks V. Veselovsky Manoel Horta Ribeiro Robert West 9 126 0 13 Jun 2023
ChatGPT vs Human-authored Text: Insights into Controllable Text Summarization and Sentence Style Transfer Dongqi Pu Vera Demberg DeLMO 26 64 0 13 Jun 2023
An Overview on Generative AI at Scale with Edge-Cloud Computing Yun Cheng Wang Jintang Xue Chengwei Wei C.-C. Jay Kuo 19 27 0 02 Jun 2023
GPT Models in Construction Industry: Opportunities, Limitations, and a Use Case Validation Abdullahi Saka Ridwan Taiwo Nurudeen Saka B. Salami Saheed Ajayi Kabiru O. Akande Hadi Kazemi 9 57 0 30 May 2023
Taming AI Bots: Controllability of Neural States in Large Language Models Stefano Soatto Paulo Tabuada Pratik Chaudhari Tianwei Liu LLMAG LM&Ro 13 13 0 29 May 2023
RewriteLM: An Instruction-Tuned Large Language Model for Text Rewriting Lei Shu Liangchen Luo Jayakumar Hoskere Yun Zhu Canoee Liu Simon Tong Jindong Chen Lei Meng KELM LRM 17 43 0 25 May 2023
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning Ximing Lu Faeze Brahman Peter West Jaehun Jang Khyathi Raghavi Chandu ... Bill Yuchen Lin Skyler Hallinan Xiang Ren Sean Welleck Yejin Choi 15 26 0 24 May 2023
Generating Faithful Synthetic Data with Large Language Models: A Case Study in Computational Social Science V. Veselovsky Manoel Horta Ribeiro Akhil Arora Martin Josifoski Ashton Anderson Robert West SyDa HILM 17 31 0 24 May 2023
MacLaSa: Multi-Aspect Controllable Text Generation via Efficient Sampling from Compact Latent Space Hanxing Ding Liang Pang Zihao Wei Huawei Shen Xueqi Cheng Tat-Seng Chua DiffM 25 10 0 22 May 2023
Autoregressive Modeling with Lookahead Attention Li Du Hongyuan Mei Jason Eisner 14 2 0 20 May 2023
How Useful are Educational Questions Generated by Large Language Models? Sabina Elkins E. Kochmar Jackie C.K. Cheung Iulian Serban ELM AI4Ed 25 22 0 13 Apr 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 27 100 0 20 Mar 2023
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey Xiao Wang Guangyao Chen Guangwu Qian Pengcheng Gao Xiaoyong Wei Yaowei Wang Yonghong Tian Wen Gao AI4CE VLM 24 195 0 20 Feb 2023
(Psycho-)Linguistic Features Meet Transformer Models for Improved Explainable and Controllable Text Simplification Yu Qiao Xiaofei Li Daniel Wiechmann E. Kerz 17 4 0 19 Dec 2022
Synthesis and Evaluation of a Domain-specific Large Data Set for Dungeons & Dragons Akila Peiris Nisansa de Silva 11 5 0 18 Dec 2022
Controllable Text Generation via Probability Density Estimation in the Latent Space Yuxuan Gu Xiaocheng Feng Sicheng Ma Lingyuan Zhang Heng Gong Weihong Zhong Bing Qin 14 18 0 16 Dec 2022
Plug-and-Play Recipe Generation with Content Planning Yinhong Liu Yixuan Su Ehsan Shareghi Nigel Collier 16 5 0 09 Dec 2022
Memorization of Named Entities in Fine-tuned BERT Models Andor Diera N. Lell Aygul Garifullina A. Scherp 8 0 0 07 Dec 2022
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief Review Jiangjie Chen Yanghua Xiao 26 4 0 07 Dec 2022
Controlled Text Generation using T5 based Encoder-Decoder Soft Prompt Tuning and Analysis of the Utility of Generated Text in AI Damith Chamalke Senadeera Julia Ive 8 5 0 06 Dec 2022
Lexical Complexity Controlled Sentence Generation Jinran Nie Liner Yang Cheng Yun Cunliang Kong Junhui Zhu Erhong Yang 9 1 0 26 Nov 2022
Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems Songbo Hu Ivan Vulić Fangyu Liu Anna Korhonen 25 0 0 07 Nov 2022
Visual Semantic Parsing: From Images to Abstract Meaning Representation M. A. Abdelsalam Zhan Shi Federico Fancellu Kalliopi Basioti Dhaivat Bhatt Vladimir Pavlovic Afsaneh Fazly GNN 21 4 0 26 Oct 2022
Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspective Adaku Uchendu Thai Le Dongwon Lee DeLMO 19 40 0 19 Oct 2022
DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generation Hanqing Zhang Dawei Song 11 36 0 18 Oct 2022
Mitigating Covertly Unsafe Text within Natural Language Systems Alex Mei Anisha Kabir Sharon Levy Melanie Subbiah Emily Allaway J. Judge D. Patton Bruce Bimber Kathleen McKeown William Yang Wang 40 13 0 17 Oct 2022
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey Sachin Kumar Vidhisha Balachandran Lucille Njoo Antonios Anastasopoulos Yulia Tsvetkov ELM 61 84 0 14 Oct 2022
COMPILING: A Benchmark Dataset for Chinese Complexity Controllable Definition Generation Jiaxin Yuan Cunliang Kong Chenhui Xie Liner Yang Erhong Yang 19 4 0 29 Sep 2022
APPDIA: A Discourse-aware Transformer-based Style Transfer Model for Offensive Social Media Conversations Katherine Atwell Sabit Hassan Malihe Alikhani 43 30 0 17 Sep 2022
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 16 59 0 07 Sep 2022
Controllable Text Generation with Neurally-Decomposed Oracle Tao Meng Sidi Lu Nanyun Peng Kai-Wei Chang BDL 20 35 0 27 May 2022
Diffusion-LM Improves Controllable Text Generation Xiang Lisa Li John Thickstun Ishaan Gulrajani Percy Liang Tatsunori B. Hashimoto AI4CE 166 768 0 27 May 2022
Evaluating and Inducing Personality in Pre-trained Language Models Guangyuan Jiang Manjie Xu Song-Chun Zhu Wenjuan Han Chi Zhang Yixin Zhu 18 41 0 20 May 2022
Controlling Translation Formality Using Pre-trained Multilingual Language Models Elijah Matthew Rippeth Sweta Agrawal Marine Carpuat AI4CE 42 15 0 13 May 2022
Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation Kexin Yang Dayiheng Liu Wenqiang Lei Baosong Yang Mingfeng Xue Boxing Chen Jun Xie 38 29 0 28 Apr 2022
A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond Yisheng Xiao Lijun Wu Junliang Guo Juntao Li M. Zhang Tao Qin Tie-Yan Liu 3DV MedIm AI4CE 19 81 0 20 Apr 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language Generation Zhuang Li Lizhen Qu Qiongkai Xu Tongtong Wu Tianyang Zhan Gholamreza Haffari CoGe UD DRL 25 2 0 27 Feb 2022
Increasing Faithfulness in Knowledge-Grounded Dialogue with Controllable Features Hannah Rashkin David Reitter Gaurav Singh Tomar Dipanjan Das 149 100 0 14 Jul 2021