v1v2 (latest)

Few-shot Personalization of LLMs with Mis-aligned Responses

26 June 2024

Jaehyung Kim

Papers citing "Few-shot Personalization of LLMs with Mis-aligned Responses"

49 / 49 papers shown

Title
The Personalization Paradox: Semantic Loss vs. Reasoning Gains in Agentic AI Q&A Satyajit Movidi Stephen Russell 0 0 0 04 Dec 2025
MonoCLUE : Object-Aware Clustering Enhances Monocular 3D Object DetectionAnnual Conference of the IEEE Industrial Electronics Society (IECON), 2022 Sunghun Yang M. Lee Jungho Lee Sangyoun Lee 96 0 0 11 Nov 2025
Rethinking LLM Human Simulation: When a Graph is What You Need Joseph Suh Suhong Moon Serina Chang AI4CE 125 0 0 03 Nov 2025
Iterative Critique-Refine Framework for Enhancing LLM Personalization Durga Prasad Maram Dhruvin Gandhi Z. Yao Gayathri Akkinapalli Franck Dernoncourt Yu Wang Ryan Rossi Nesreen K. Ahmed 124 0 0 28 Oct 2025
Instant Personalized Large Language Model Adaptation via Hypernetwork Zhaoxuan Tan Z. Zhang Haoyang Wen Zheng Li Rongzhi Zhang ... Fengran Mo Zheyuan Liu Qingkai Zeng Qingyu Yin Meng Jiang 106 0 0 18 Oct 2025
T-POP: Test-Time Personalization with Online Preference Feedback Zikun Qu Min Zhang Mingze Kong Xiang Li Zhiwei Shang Zhiyong Wang Yikun Ban Shuang Qiu Yao Shu Zhongxiang Dai 124 0 0 29 Sep 2025
Towards On-Device Personalization: Cloud-device Collaborative Data Augmentation for Efficient On-device Language Model Zhaofeng Zhong Wei Yuan Liang Qu Tong Chen Hao Wang Xiangyu Zhao Hongzhi Yin 106 0 0 29 Aug 2025
Training-free LLM Verification via Recycling Few-shot Examples Dongseok Lee Jimyung Hong Dongyoung Kim Jaehyung Kim LRM 118 2 0 08 Jun 2025
RPM: Reasoning-Level Personalization for Black-Box Large Language Models Jieyong Kim Kwangwook Seo Soojin Yoon Jaehyung Kim Dongha Lee LRM 524 2 0 27 May 2025
Is Active Persona Inference Necessary for Aligning Small Models to Personal Preferences? Zilu Tang Afra Feyza Akyürek Ekin Akyürek Derry Wijaya 373 0 0 19 May 2025
A Survey on Personalized and Pluralistic Preference Alignment in Large Language Models Zhouhang Xie Junda Wu Yiran Shen Yu Xia Xintong Li ... Sachin Kumar Bodhisattwa Prasad Majumder Jingbo Shang Prithviraj Ammanabrolu Julian McAuley 395 7 0 09 Apr 2025
Capturing Individual Human Preferences with Reward Features André Barreto Vincent Dumoulin Yiran Mao Nicolas Perez-Nieves Bobak Shahriari Yann Dauphin Doina Precup Hugo Larochelle ALM 230 4 0 21 Mar 2025
EMCee: Improving Multilingual Capability of LLMs via Bridging Knowledge and Reasoning with Extracted Synthetic Multilingual Context Hamin Koo Jaehyung Kim 267 1 0 07 Mar 2025
Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public OpinionsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Joseph Suh Erfan Jahanparast Suhong Moon Minwoo Kang Serina Chang ALM LM&MA 369 26 0 24 Feb 2025
A Survey of Personalized Large Language Models: Progress and Future Directions Jiahong Liu Zexuan Qiu Zhongyang Li Quanyu Dai Jieming Zhu Minda Hu Menglin Yang Irwin King Tat-Seng Chua Irwin King LM&MA 333 29 0 17 Feb 2025
Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinement Chenkai Sun Ke Yang R. Reddy Yi R. Fung Hou Pong Chan Chengxiang Zhai ChengXiang Zhai Heng Ji 374 38 0 16 Feb 2024
GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency Catherine Yeh Gonzalo A. Ramos Rachel Ng Andy Huntington Richard Banks LLMAG 366 31 0 13 Feb 2024
On the steerability of large language models toward data-driven personas Junyi Li Ninareh Mehrabi Charith Peris Palash Goyal Kai-Wei Chang Aram Galstyan Richard Zemel Rahul Gupta 379 50 0 08 Nov 2023
Group Preference Optimization: Few-Shot Alignment of Large Language ModelsInternational Conference on Learning Representations (ICLR), 2023 Siyan Zhao John Dang Aditya Grover 313 46 0 17 Oct 2023
Jailbreaking Black Box Large Language Models in Twenty Queries Patrick Chao Avi Schwarzschild Guang Cheng Hamed Hassani George J. Pappas Eric Wong AAML 605 1,051 0 12 Oct 2023
Large Language Models as OptimizersInternational Conference on Learning Representations (ICLR), 2023 Chengrun Yang Xuezhi Wang Yifeng Lu Hanxiao Liu Quoc V. Le Denny Zhou Xinyun Chen ODL 504 623 0 07 Sep 2023
Benchmarking LLM powered Chatbots: Methods and Metrics D. Banerjee Pooja Singh Arjun Avadhanam Shashank Srivastava LLMAG AI4MH 120 31 0 08 Aug 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron Louis Martin Kevin R. Stone Peter Albert Amjad Almahairi ... Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom AI4MH ALM 6.9K 15,103 0 18 Jul 2023
Towards Measuring the Representation of Subjective Global Opinions in Language Models Esin Durmus Karina Nyugen Thomas I. Liao Nicholas Schiefer Amanda Askell ... Alex Tamkin Janel Thamkul Jared Kaplan Jack Clark Deep Ganguli 319 330 0 28 Jun 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot ArenaNeural Information Processing Systems (NeurIPS), 2023 Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu ... Dacheng Li Eric Xing Haotong Zhang Joseph E. Gonzalez Ion Stoica ALM OSLM ELM 2.9K 6,424 0 09 Jun 2023
Aligning Language Models to User OpinionsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 EunJeong Hwang Bodhisattwa Prasad Majumder Niket Tandon 331 97 0 24 May 2023
Enabling Large Language Models to Generate Text with CitationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Tianyu Gao Howard Yen Jiatong Yu Danqi Chen LM&MA HILM 415 482 0 24 May 2023
Evaluating Open-Domain Question Answering in the Era of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Ehsan Kamalloo Nouha Dziri C. Clarke Davood Rafiei ELM 446 144 0 11 May 2023
Automatic Prompt Optimization with "Gradient Descent" and Beam SearchConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Reid Pryzant Dan Iter Jerry Li Y. Lee Chenguang Zhu Michael Zeng 292 517 0 04 May 2023
LaMP: When Large Language Models Meet PersonalizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Alireza Salemi Sheshera Mysore Michael Bendersky Hamed Zamani RALM 560 334 0 22 Apr 2023
Whose Opinions Do Language Models Reflect?International Conference on Machine Learning (ICML), 2023 Shibani Santurkar Esin Durmus Faisal Ladhak Cinoo Lee Abigail Z. Jacobs Tatsunori Hashimoto 356 624 0 30 Mar 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 4.3K 20,543 0 15 Mar 2023
Progressive Prompts: Continual Learning for Language ModelsInternational Conference on Learning Representations (ICLR), 2023 Anastasia Razdaibiedina Yuning Mao Rui Hou Madian Khabsa M. Lewis Amjad Almahairi VLM KELM CLL 285 191 0 29 Jan 2023
Self-Instruct: Aligning Language Models with Self-Generated InstructionsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Yizhong Wang Yeganeh Kordi Swaroop Mishra Alisa Liu Noah A. Smith Daniel Khashabi Hannaneh Hajishirzi ALM SyDa LRM 749 2,790 0 20 Dec 2022
Large Language Models Struggle to Learn Long-Tail KnowledgeInternational Conference on Machine Learning (ICML), 2022 Nikhil Kandpal H. Deng Adam Roberts Eric Wallace Colin Raffel RALM KELM 415 543 0 15 Nov 2022
Large Language Models Are Human-Level Prompt EngineersInternational Conference on Learning Representations (ICLR), 2022 Yongchao Zhou Andrei Ioan Muresanu Ziwen Han Keiran Paster Silviu Pitis Harris Chan Jimmy Ba ALM LLMAG 429 1,155 0 03 Nov 2022
Improving alignment of dialogue agents via targeted human judgements Amelia Glaese Nat McAleese Maja Trkebacz John Aslanides Vlad Firoiu ... John F. J. Mellor Demis Hassabis Koray Kavukcuoglu Lisa Anne Hendricks G. Irving ALM AAML 517 628 0 28 Sep 2022
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Mingkai Deng Jianyu Wang Cheng-Ping Hsieh Yihan Wang Han Guo Tianmin Shu Meng Song Eric Xing Zhiting Hu 337 426 0 25 May 2022
ASQA: Factoid Questions Meet Long-Form AnswersConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Ivan Stelmakh Yi Luan Bhuwan Dhingra Ming-Wei Chang 334 230 0 12 Apr 2022
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL), 2022 Archiki Prasad Peter Hase Xiang Zhou Joey Tianyi Zhou 221 146 0 14 Mar 2022
Continual Prompt Tuning for Dialog State TrackingAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Qi Zhu Bing Li Fei Mi Xiaoyan Zhu Shiyu Huang CLL KELM 205 67 0 13 Mar 2022
Unsupervised Dense Information Retrieval with Contrastive Learning Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin Edouard Grave RALM 740 1,219 0 16 Dec 2021
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 347 1,048 0 16 Dec 2021
Process for Adapting Language Models to Society (PALMS) with Values-Targeted DatasetsNeural Information Processing Systems (NeurIPS), 2021 Irene Solaiman Christy Dennison 260 248 0 18 Jun 2021
The Power of Scale for Parameter-Efficient Prompt TuningConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Brian Lester Rami Al-Rfou Noah Constant VPVLM 1.3K 4,914 0 18 Apr 2021
MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence FrontiersNeural Information Processing Systems (NeurIPS), 2021 Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui 365 443 0 02 Feb 2021
Prefix-Tuning: Optimizing Continuous Prompts for GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Xiang Lisa Li Abigail Z. Jacobs 650 5,161 0 01 Jan 2021
MPNet: Masked and Permuted Pre-training for Language UnderstandingNeural Information Processing Systems (NeurIPS), 2020 Kaitao Song Xu Tan Tao Qin Jianfeng Lu Tie-Yan Liu 228 1,446 0 20 Apr 2020
Sentence-BERT: Sentence Embeddings using Siamese BERT-NetworksConference on Empirical Methods in Natural Language Processing (EMNLP), 2019 Nils Reimers Iryna Gurevych 1.9K 15,338 0 27 Aug 2019