Mixture-of-Agents Enhances Large Language Model Capabilities

International Conference on Learning Representations (ICLR), 2024

7 June 2024

Junlin Wang

Jue Wang

Ben Athiwaratkun

Ce Zhang

James Zou

LLMAG

AIFin

ArXiv (abs)PDF HTML HuggingFace (60 upvotes)

Papers citing "Mixture-of-Agents Enhances Large Language Model Capabilities"

50 / 109 papers shown

Title
On the Entropy Calibration of Language Models Steven Cao Gregory Valiant Percy Liang 48 0 0 15 Nov 2025
S-DAG: A Subject-Based Directed Acyclic Graph for Multi-Agent Heterogeneous ReasoningMachine-mediated learning (ML), 2025 Jiangwen Dong Zehui Lin Wanyu Lin Mingjin Zhang LLMAG LRM 58 0 0 10 Nov 2025
C3PO: Optimized Large Language Model Cascades with Probabilistic Cost Constraints for Reasoning Antonios Valkanas Soumyasundar Pal Pavel Rumiantsev Yingxue Zhang Mark Coates 76 0 0 10 Nov 2025
CoLM: Collaborative Large Models via A Client-Server Paradigm Siqi Huang Sida Huang Hongyuan Zhang LRM 56 0 0 10 Nov 2025
From Measurement to Expertise: Empathetic Expert Adapters for Context-Based Empathy in Conversational AI Agents Erfan Shayegani Jina Suh Andy Wilson Nagu Rangan Javier Hernández 44 0 0 05 Nov 2025
Optimal-Agent-Selection: State-Aware Routing Framework for Efficient Multi-Agent Collaboration Jingbo Wang Sendong Zhao Haochun Wang Yuzheng Fan L. Zhang Yan Liu Ting Liu 84 0 0 04 Nov 2025
Hybrid Retrieval-Augmented Generation Agent for Trustworthy Legal Question Answering in Judicial Forensics Yueqing Xi Yifan Bai Huasen Luo Weiliang Wen Hui Liu Haoliang Li AILaw RALM 213 0 0 03 Nov 2025
Count-Based Approaches Remain Strong: A Benchmark Against Transformer and LLM Pipelines on Structured EHR Jifan Gao M. Rosenthal B. Wolpin Simona Cristea 88 0 0 02 Nov 2025
PDE-SHARP: PDE Solver Hybrids through Analysis and Refinement Passes Shaghayegh Fazliani Madeleine Udell 67 1 0 31 Oct 2025
Teaming LLMs to Detect and Mitigate Hallucinations Demian Till John Smeaton Peter Haubrick Gouse Saheb Florian Graef David Berman HILM 234 0 0 22 Oct 2025
When to Ensemble: Identifying Token-Level Points for Stable and Fast LLM Ensembling Heecheol Yun Kwangmin Ki J. H. Lee Eunho Yang 65 0 0 17 Oct 2025
Harnessing Consistency for Robust Test-Time LLM Ensemble Zhichen Zeng Qi Yu Xiao Lin Ruizhong Qiu Xuying Ning Tianxin Wei Yuchen Yan Jingrui He Hanghang Tong 64 0 0 12 Oct 2025
SwarmSys: Decentralized Swarm-Inspired Agents for Scalable and Adaptive Reasoning Ruohao Li Hongjun Liu Leyi Zhao Zisu Li Jiawei Li Jiajun Jiang Linning Xu Chen Zhao Mingming Fan Chen Liang LLMAG LRM 109 0 0 11 Oct 2025
NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answering Kaiwen Shi Zheyuan Zhang Zhengqing Yuan K. Murugesan Vincent Galass Chuxu Zhang Yanfang Ye 72 0 0 10 Oct 2025
CoMAS: Co-Evolving Multi-Agent Systems via Interaction Rewards Xiangyuan Xue Yifan Zhou G. Zhang Zaibin Zhang Y. Li Chen Zhang Z. Yin Philip Torr Wanli Ouyang Lei Bai LLMAG 97 2 0 09 Oct 2025
MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference Zheyuan Zhang Lin Ge Hongjiang Li Weicheng Zhu Chuxu Zhang Yanfang Ye LLMAG 76 1 0 08 Oct 2025
LLM-FS-Agent: A Deliberative Role-based Large Language Model Architecture for Transparent Feature Selection Mohamed Bal-Ghaoui Fayssal Sabri LLMAG 57 0 0 07 Oct 2025
Staircase Streaming for Low-Latency Multi-Agent Inference Junlin Wang Jue Wang Zhen Ben Athiwaratkun Bhuwan Dhingra Ce Zhang James Y. Zou 106 0 0 06 Oct 2025
Multi-Agent Collaborative Intelligence: Dual-Dial Control for Reliable LLM Reasoning Edward Y. Chang Ethan Chang 60 2 0 06 Oct 2025
Slm-mux: Orchestrating small language models for reasoning Chenyu Wang Zishen Wan Hao Kang Emma Chen Zhiqiang Xie T. Krishna Vijay Janapa Reddi Yilun Du MoE LRM 107 0 0 06 Oct 2025
Sample, Align, Synthesize: Graph-Based Response Synthesis with ConGrs Sayan Ghosh Shahzaib Saqib Warraich Dhruv Tarsadiya Gregory Yauney Swabha Swayamdipta 76 0 0 03 Oct 2025
Efficient Test-Time Scaling for Small Vision-Language Models Mehmet Onurcan Kaya Desmond Elliott Dim P. Papadopoulos VLM 122 2 0 03 Oct 2025
PRISM-Consult: A Panel-of-Experts Architecture for Clinician-Aligned Diagnosis Lionel Levine John Santerre Alexander S. Young T. Barry Levine Francis Campion Majid Sarrafzadeh 59 0 0 01 Oct 2025
Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Models S. Venkatraman Vineet Jain Sarthak Mittal Vedant Shah J. Obando-Ceron ... B. Kailkhura Guillaume Lajoie Glen Berseth Nikolay Malkin Moksh Jain ReLM AIFin LRM 172 1 0 30 Sep 2025
TUMIX: Multi-Agent Test-Time Scaling with Tool-Use Mixture Yongchao Chen Jiefeng Chen Rui Meng Ji Yin Na Li Chuchu Fan Chi Wang Tomas Pfister Jinsung Yoon LLMAG 101 1 0 30 Sep 2025
EAPO: Enhancing Policy Optimization with On-Demand Expert Assistance Siyao Song Cong Ma Zhihao Cheng Shiye Lei Minghao Li Ying Zeng Huaixiao Tou Kai Jia OffRL LRM 91 0 0 28 Sep 2025
Mixture of Thoughts: Learning to Aggregate What Experts Think, Not Just What They Say Jacob Fein-Ashley Dhruv Parikh Rajgopal Kannan Viktor Prasanna MoE MoMe LRM 108 1 0 25 Sep 2025
Knowledge Base-Aware Orchestration: A Dynamic, Privacy-Preserving Method for Multi-Agent Systems Danilo Trombino Vincenzo Pecorella Alessandro de Giulii Davide Tresoldi 25 0 0 23 Sep 2025
AgentInit: Initializing LLM-based Multi-Agent Systems via Diversity and Expertise Orchestration for Effective and Efficient Collaboration Chunhao Tian Yutong Wang Xuebo Liu Zhexuan Wang Liang Ding Miao Zhang Min Zhang AI4CE 94 0 0 23 Sep 2025
A Knowledge-driven Adaptive Collaboration of LLMs for Enhancing Medical Decision-making Xiao Wu Ting-Zhu Huang Liang-Jian Deng Yanyuan Qiao Imran Razzak Yutong Xie 60 0 0 18 Sep 2025
Aegis: Automated Error Generation and Attribution for Multi-Agent Systems Fanqi Kong Ruijie Zhang Huaxiao Yin Guibin Zhang X. Zhang Ziang Chen Zhaowei Zhang Xiaoyuan Zhang Song-Chun Zhu Xue Feng AAML 256 0 0 17 Sep 2025
LTA-thinker: Latent Thought-Augmented Training Framework for Large Language Models on Complex Reasoning Jiaqi Wang Binquan Ji Haibo Luo Yiyang Qi Ruiting Li Huiyan Wang Yuantao Han Cangyi Yang jiaxu Zhang Feiliang Ren BDL LRM 155 1 0 16 Sep 2025
Large Language Models for Security Operations Centers: A Comprehensive Survey Ali Habibzadeh Farid Feyzi Reza Ebrahimi Atani 200 1 0 13 Sep 2025
K2-Think: A Parameter-Efficient Reasoning System Zhoujun Cheng Richard Fan Shibo Hao Taylor W. Killian Haonan Li ... Xuezhe Ma Guowei He Zhiting Hu Zhengzhong Liu Eric P. Xing ReLM OffRL ALM LRM 206 3 0 09 Sep 2025
Towards Generalized Routing: Model and Agent Orchestration for Adaptive and Efficient Inference Xiyu Guo Shan Wang Chunfang Ji Xuefeng Zhao Wenhao Xi Y. Liu Qinglan Li Chao Deng Junlan Feng 116 0 0 09 Sep 2025
OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaboration Jusheng Zhang Yijia Fan Kaitong Cai Xiaofei Sun Keze Wang 60 9 0 05 Sep 2025
Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate Andrea Wynn Harsh Satija Gillian Hadfield 58 8 0 05 Sep 2025
Reasoning-Intensive Regression Diane Tchuindjo Omar Khattab LRM 77 1 0 29 Aug 2025
Automated Clinical Problem Detection from SOAP Notes using a Collaborative Multi-Agent LLM Architecture Yeawon Lee Xiaoyang Wang Christopher C. Yang LLMAG 82 0 0 29 Aug 2025
Reflective Agreement: Combining Self-Mixture of Agents with a Sequence Tagger for Robust Event Extraction Fatemeh Haji Mazal Bethany Cho-Yu Chiang Anthony Rios Peyman Najafirad 52 0 0 26 Aug 2025
Expertise-aware Multi-LLM Recruitment and Collaboration for Medical Decision-Making Liuxin Bao Zhihao Peng Xiaofei Zhou Runmin Cong Jiyong Zhang Yixuan Yuan 108 0 0 19 Aug 2025
Mediator-Guided Multi-Agent Collaboration among Open-Source Models for Medical Decision-Making Kaitao Chen Mianxin Liu Daoming Zong Chaoyue Ding Shaohao Rui Yankai Jiang Mu Zhou Xiaosong Wang 103 1 0 08 Aug 2025
TRAIL: Joint Inference and Refinement of Knowledge Graphs with Large Language Models Xinkui Zhao Haode Li Yifan Zhang Guanjie Cheng Yueshen Xu KELM LRM 55 1 0 06 Aug 2025
CTTS: Collective Test-Time Scaling Zhende Song Shengji Tang Peng Ye Jiayuan Fan Tao Chen Tao Chen Wanli Ouyang LRM 99 1 0 05 Aug 2025
Industrial LLM-based Code Optimization under Regulation: A Mixture-of-Agents Approach Mari Ashiga Vardan K. Voskanyan Fateme Dinmohammadi Jingzhi Gong P. Brookes Matthew Truscott Rafail Giavrimis Mike Basios Leslie Kanthan Wei Jie 102 1 0 05 Aug 2025
When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMs Fangyi Yu ELM 119 2 0 05 Aug 2025
Diversity-Enhanced Reasoning for Subjective Questions Yumeng Wang Zhiyuan Fan Jiayu Liu J. Huang Yi R. Fung LRM 402 5 0 27 Jul 2025
LingBench++: A Linguistically-Informed Benchmark and Reasoning Framework for Multi-Step and Cross-Cultural Inference with LLMs Da-Chen Lian Ri-Sheng Huang Pin-Er Chen Chunki Lim You-Kuan Lin Guan-Yu Tseng Zi-Cheng Yang Zhen-Yu Lin Pin-Cheng Chen Shu-Kai Hsieh LRM ELM 158 2 0 22 Jul 2025
Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMs Yifan Shen Yuanzhe Liu Jingyuan Zhu Xu Cao Xiaofeng Zhang Yixiao He Wenming Ye James M. Rehg Ismini Lourentzou LRM 98 1 0 26 Jun 2025
MEXA: Towards General Multimodal Reasoning with Dynamic Multi-Expert Aggregation Shoubin Yu Yue Zhang Ziyang Wang Jaehong Yoon Mohit Bansal MoE LRM 117 3 0 20 Jun 2025