Improving Factuality and Reasoning in Language Models through Multiagent Debate

23 May 2023

Yilun Du

Shuang Li

Antonio Torralba

Papers citing "Improving Factuality and Reasoning in Language Models through Multiagent Debate"

50 / 453 papers shown

Title
Beyond Isolation: Multi-Agent Synergy for Improving Knowledge Graph Construction Hongbin Ye Honghao Gui Aijia Zhang Tong Liu Wei Hua Weiqiang Jia LLMAG 15 5 0 05 Dec 2023
Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication Zhangyue Yin Qiushi Sun Cheng Chang Qipeng Guo Junqi Dai Xuanjing Huang Xipeng Qiu LRM 48 46 0 04 Dec 2023
D-Bot: Database Diagnosis System using Large Language Models Xuanhe Zhou Guoliang Li Zhaoyan Sun Zhiyuan Liu Weize Chen Jianming Wu Jiesi Liu Ruohang Feng Guoyang Zeng LLMAG 54 13 0 03 Dec 2023
OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation Qidong Huang Xiao-wen Dong Pan Zhang Bin Wang Conghui He Jiaqi Wang Dahua Lin Weiming Zhang Neng H. Yu MLLM 26 165 0 29 Nov 2023
Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs Andries P. Smit Paul Duckworth Nathan Grinsztajn Thomas D. Barrett Arnu Pretorius 11 19 0 29 Nov 2023
ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up? Hailin Chen Fangkai Jiao Xingxuan Li Chengwei Qin Mathieu Ravaut Ruochen Zhao Caiming Xiong Shafiq R. Joty ELM CLL AI4MH LRM ALM 77 27 0 28 Nov 2023
RELIC: Investigating Large Language Model Responses using Self-Consistency Furui Cheng Vilém Zouhar Simran Arora Mrinmaya Sachan Hendrik Strobelt Mennatallah El-Assady HILM 13 18 0 28 Nov 2023
Controlling Large Language Model-based Agents for Large-Scale Decision-Making: An Actor-Critic Approach Bin Zhang Hangyu Mao Jingqing Ruan Ying Wen Yang Li ... Dapeng Li Ziyue Li Rui Zhao Lijuan Li Guoliang Fan LM&Ro LLMAG 19 33 0 23 Nov 2023
On the Calibration of Large Language Models and Alignment Chiwei Zhu Benfeng Xu Quan Wang Yongdong Zhang Zhendong Mao 61 32 0 22 Nov 2023
Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agents Qinghua Lu Liming Zhu Xiwei Xu Zhenchang Xing Stefan Harrer Jon Whittle LM&Ro AI4CE LLMAG 29 11 0 22 Nov 2023
Evil Geniuses: Delving into the Safety of LLM-based Agents Yu Tian Xiao Yang Jingyuan Zhang Yinpeng Dong Hang Su LLMAG AAML 26 52 0 20 Nov 2023
Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agents Zhuosheng Zhang Yao Yao Aston Zhang Xiangru Tang Xinbei Ma ... Yiming Wang Mark B. Gerstein Rui Wang Gongshen Liu Hai Zhao LLMAG LM&Ro LRM 31 51 0 20 Nov 2023
MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning Xiangru Tang Anni Zou Zhuosheng Zhang Ziming Li Yilun Zhao Xingyao Zhang Arman Cohan Mark B. Gerstein LRM LM&MA 22 134 0 16 Nov 2023
R-Tuning: Instructing Large Language Models to Say `I Don't Know' Hanning Zhang Shizhe Diao Yong Lin Yi Ren Fung Qing Lian Xingyao Wang Yangyi Chen Heng Ji Tong Zhang UQLM 24 36 0 16 Nov 2023
Simulating Opinion Dynamics with Networks of LLM-based Agents Yun-Shiuan Chuang Agam Goyal Nikunj Harlalka Siddharth Suresh Robert Hawkins Sijia Yang Dhavan Shah Junjie Hu Timothy T. Rogers AI4CE 19 51 0 16 Nov 2023
Effective Large Language Model Adaptation for Improved Grounding and Citation Generation Xi Ye Ruoxi Sun Sercan Ö. Arik Tomas Pfister HILM 13 25 0 16 Nov 2023
How Well Do Large Language Models Truly Ground? Hyunji Lee Se June Joo Chaeeun Kim Joel Jang Doyoung Kim Kyoung-Woon On Minjoon Seo HILM 8 6 0 15 Nov 2023
StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem Solving Chang Gao Haiyun Jiang Deng Cai Shuming Shi Wai Lam LRM 23 3 0 15 Nov 2023
Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experiment Philippe Laban Lidiya Murakhovs'ka Caiming Xiong Chien-Sheng Wu LRM 19 17 0 14 Nov 2023
Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios Lei Lin Jiayi Fu Pengli Liu Qingyang Li Yan Gong Junchen Wan Fuzheng Zhang Zhongyuan Wang Di Zhang Kun Gai LRM 14 7 0 14 Nov 2023
Towards Reasoning in Large Language Models via Multi-Agent Peer Review Collaboration Zhenran Xu Senbao Shi Baotian Hu Jindi Yu Dongfang Li Min Zhang Yuxiang Wu LRM LLMAG ALM 58 19 0 14 Nov 2023
SAIE Framework: Support Alone Isn't Enough -- Advancing LLM Training with Adversarial Remarks Mengsay Loem Masahiro Kaneko Naoaki Okazaki LRM 19 5 0 14 Nov 2023
Explanation-aware Soft Ensemble Empowers Large Language Model In-context Learning Yue Yu Jiaming Shen Tianqi Liu Zhen Qin Jing Nathan Yan Jialu Liu Chao Zhang Michael Bendersky 31 6 0 13 Nov 2023
On the Discussion of Large Language Models: Symmetry of Agents and Interplay with Prompts Qineng Wang Zihao W. Wang Ying Su Yangqiu Song AI4CE LLMAG 26 0 0 13 Nov 2023
TrainerAgent: Customizable and Efficient Model Training through LLM-Powered Multi-Agent System Haoyuan Li Hao Jiang Tianke Zhang Zhelun Yu Aoxiong Yin Hao Cheng Siming Fu Yuhao Zhang Wanggui He LLMAG 6 4 0 11 Nov 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng ... Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu LRM HILM 31 684 0 09 Nov 2023
Sentiment Analysis through LLM Negotiations Xiaofei Sun Xiaoya Li Shengyu Zhang Shuhe Wang Fei Wu Jiwei Li Tianwei Zhang Guoyin Wang 19 3 0 03 Nov 2023
Leveraging Large Language Models for Collective Decision-Making Marios Papachristou Longqi Yang Chin-Chia Hsu LLMAG 29 2 0 03 Nov 2023
Leveraging Word Guessing Games to Assess the Intelligence of Large Language Models Tian Liang Zhiwei He Jen-tse Huang Wenxuan Wang Wenxiang Jiao Rui Wang Yujiu Yang Zhaopeng Tu Shuming Shi Xing Wang LLMAG 34 5 0 31 Oct 2023
Multi-Agent Consensus Seeking via Large Language Models Huaben Chen Wenkang Ji Lufeng Xu Shiyu Zhao LM&Ro LLMAG 49 20 0 31 Oct 2023
Prompt Engineering Through the Lens of Optimal Control Yifan Luo Yiming Tang Chengfeng Shen Zhennan Zhou Bin Dong OffRL 25 5 0 22 Oct 2023
Metric Ensembles For Hallucination Detection Grant C. Forbes Parth Katlana Zeydy Ortiz HILM 23 4 0 16 Oct 2023
Stance Detection with Collaborative Role-Infused LLM-Based Agents Xiaochong Lan Chen Gao Depeng Jin Yong Li 17 13 0 16 Oct 2023
AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systems Junjie Zhang Yupeng Hou Ruobing Xie Wenqi Sun Julian McAuley Wayne Xin Zhao Leyu Lin Ji-Rong Wen LLMAG 17 65 0 13 Oct 2023
The Consensus Game: Language Model Generation via Equilibrium Search Athul Paul Jacob Yikang Shen Gabriele Farina Jacob Andreas 31 19 0 13 Oct 2023
Can Large Language Models Really Improve by Self-critiquing Their Own Plans? Karthik Valmeekam Matthew Marquez Subbarao Kambhampati LRM 25 84 0 12 Oct 2023
Evaluating Large Language Models at Evaluating Instruction Following Zhiyuan Zeng Jiatong Yu Tianyu Gao Yu Meng Tanya Goyal Danqi Chen ELM ALM 13 159 0 11 Oct 2023
Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity Cunxiang Wang Xiaoze Liu Yuanhao Yue Xiangru Tang Tianhang Zhang ... Linyi Yang Jindong Wang Xing Xie Zheng-Wei Zhang Yue Zhang HILM KELM 39 170 0 11 Oct 2023
Benchmarking and Explaining Large Language Model-based Code Generation: A Causality-Centric Approach Zhenlan Ji Pingchuan Ma Zongjie Li Shuai Wang 11 18 0 10 Oct 2023
MetaAgents: Simulating Interactions of Human Behaviors for LLM-based Task-oriented Coordination via Collaborative Generative Agents Yuan Li Yixuan Zhang Lichao Sun LLMAG LM&Ro 20 97 0 10 Oct 2023
Let Models Speak Ciphers: Multiagent Debate through Embeddings Chau Pham Boyi Liu Yingxiang Yang Zhengyu Chen Tianyi Liu Jianbo Yuan Bryan A. Plummer Zhaoran Wang Hongxia Yang LLMAG 29 15 0 10 Oct 2023
Factuality Challenges in the Era of Large Language Models Isabelle Augenstein Timothy Baldwin Meeyoung Cha Tanmoy Chakraborty Giovanni Luca Ciampaglia ... Rubén Míguez Preslav Nakov Dietram A. Scheufele Shivam Sharma Giovanni Zagni HILM 27 31 0 08 Oct 2023
Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Models Junchi Yu Ran He Rex Ying LRM 41 13 0 06 Oct 2023
Chain of Natural Language Inference for Reducing Large Language Model Ungrounded Hallucinations Deren Lei Yaxi Li Mengya Hu Mingyu Wang Vincent Yun Emily Ching Eslam Kamal HILM LRM 24 39 0 06 Oct 2023
Balancing Autonomy and Alignment: A Multi-Dimensional Taxonomy for Autonomous LLM-powered Multi-Agent Architectures Thorsten Händler LLMAG 16 22 0 05 Oct 2023
EcoAssistant: Using LLM Assistant More Affordably and Accurately Jieyu Zhang Ranjay Krishna Ahmed Hassan Awadallah Chi Wang 25 33 0 03 Oct 2023
Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization Zijun Liu Yanzhe Zhang Peng Li Yang Janet Liu Diyi Yang LLMAG 15 103 0 03 Oct 2023
Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View Jintian Zhang Xin Xu Ningyu Zhang Ruibo Liu Bryan Hooi Shumin Deng LLMAG 27 123 0 03 Oct 2023
Large Language Models Cannot Self-Correct Reasoning Yet Jie Huang Xinyun Chen Swaroop Mishra Huaixiu Steven Zheng Adams Wei Yu Xinying Song Denny Zhou ReLM LRM 6 415 0 03 Oct 2023
Resolving Knowledge Conflicts in Large Language Models Yike Wang Shangbin Feng Heng Wang Weijia Shi Vidhisha Balachandran Tianxing He Yulia Tsvetkov 45 12 0 02 Oct 2023