Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2406.04692
Cited By
Mixture-of-Agents Enhances Large Language Model Capabilities
International Conference on Learning Representations (ICLR), 2024
7 June 2024
Junlin Wang
Jue Wang
Ben Athiwaratkun
Ce Zhang
James Zou
LLMAG
AIFin
Re-assign community
ArXiv (abs)
PDF
HTML
HuggingFace (60 upvotes)
Papers citing
"Mixture-of-Agents Enhances Large Language Model Capabilities"
50 / 117 papers shown
Industrial LLM-based Code Optimization under Regulation: A Mixture-of-Agents Approach
Mari Ashiga
Vardan K. Voskanyan
Fateme Dinmohammadi
Jingzhi Gong
P. Brookes
Matthew Truscott
Rafail Giavrimis
Mike Basios
Leslie Kanthan
Wei Jie
139
1
0
05 Aug 2025
CTTS: Collective Test-Time Scaling
Zhende Song
Shengji Tang
Peng Ye
Jiayuan Fan
Tao Chen
Tao Chen
Wanli Ouyang
LRM
183
1
0
05 Aug 2025
Diversity-Enhanced Reasoning for Subjective Questions
Yumeng Wang
Zhiyuan Fan
Jiayu Liu
J. Huang
Yi R. Fung
LRM
481
5
0
27 Jul 2025
LingBench++: A Linguistically-Informed Benchmark and Reasoning Framework for Multi-Step and Cross-Cultural Inference with LLMs
Da-Chen Lian
Ri-Sheng Huang
Pin-Er Chen
Chunki Lim
You-Kuan Lin
Guan-Yu Tseng
Zi-Cheng Yang
Zhen-Yu Lin
Pin-Cheng Chen
Shu-Kai Hsieh
LRM
ELM
243
2
0
22 Jul 2025
Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMs
Yifan Shen
Yuanzhe Liu
Jingyuan Zhu
Xu Cao
Xiaofeng Zhang
Yixiao He
Wenming Ye
James M. Rehg
Ismini Lourentzou
LRM
158
3
0
26 Jun 2025
MEXA: Towards General Multimodal Reasoning with Dynamic Multi-Expert Aggregation
Shoubin Yu
Yue Zhang
Ziyang Wang
Jaehong Yoon
Mohit Bansal
MoE
LRM
197
3
0
20 Jun 2025
When Does Divide and Conquer Work for Long Context LLM? A Noise Decomposition Framework
Zhen Xu
Shang Zhu
Jue Wang
Junlin Wang
Ben Athiwaratkun
Chi Wang
James Zou
Ce Zhang
LLMAG
186
2
0
19 Jun 2025
SwarmAgentic: Towards Fully Automated Agentic System Generation via Swarm Intelligence
Y. Zhang
Chenyang Lin
Shijie Tang
Haokun Chen
Shijie Zhou
Yunpu Ma
Volker Tresp
334
4
0
18 Jun 2025
Cost-Efficient Serving of LLM Agents via Test-Time Plan Caching
Qizheng Zhang
Michael Wornow
Kunle Olukotun
219
3
0
17 Jun 2025
AntiGrounding: Lifting Robotic Actions into VLM Representation Space for Decision Making
Wenbo Li
Shiyi Wang
Yiteng Chen
Huiping Zhuang
Qingyao Wu
316
0
0
14 Jun 2025
MEMETRON: Metaheuristic Mechanisms for Test-time Response Optimization of Large Language Models
S. Nguyen
Theja Tulabandhula
199
0
0
10 Jun 2025
Federated In-Context Learning: Iterative Refinement for Improved Answer Quality
Ruhan Wang
Zhiyong Wang
Chengkai Huang
Rui Wang
Tong Yu
Lina Yao
John C. S. Lui
Dongruo Zhou
214
2
0
09 Jun 2025
RMoA: Optimizing Mixture-of-Agents through Diversity Maximization and Residual Compensation
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Zhentao Xie
Chengcheng Han
Jinxin Shi
Wenjun Cui
Xin Zhao
Xingjiao Wu
Jiabao Zhao
230
2
0
30 May 2025
An Adversary-Resistant Multi-Agent LLM System via Credibility Scoring
Sana Ebrahimi
Mohsen Dehghankar
Abolfazl Asudeh
186
3
0
30 May 2025
How Much Backtracking is Enough? Exploring the Interplay of SFT and RL in Enhancing LLM Reasoning
Hongyi Cai
Junlin Wang
Xiaoyin Chen
Bhuwan Dhingra
LRM
220
5
0
30 May 2025
Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systems
J. Yang
M. Zhang
Yiqiao Jin
Hao Chen
Qingsong Wen
...
Yi He
Weijie Xu
James Evans
James Evans
Jindong Wang
LLMAG
AI4CE
448
1
0
28 May 2025
R1-Code-Interpreter: LLMs Reason with Code via Supervised and Multi-stage Reinforcement Learning
Yongchao Chen
Y. Liu
Junwei Zhou
Yilun Hao
Jingquan Wang
Yang Zhang
Chuchu Fan
Chuchu Fan
OffRL
ReLM
AI4TS
SyDa
ALM
LRM
321
4
0
27 May 2025
The Avengers: A Simple Recipe for Uniting Smaller Language Models to Challenge Proprietary Giants
Yiqun Zhang
Hao Li
Chenxu Wang
L. Chen
Qiaosheng Zhang
...
Xinrun Wang
Jia Xu
Mengwei He
Xuming He
Shuyue Hu
398
16
0
26 May 2025
Faster and Better LLMs via Latency-Aware Test-Time Scaling
Zili Wang
Tianyu Zhang
Haoli Bai
Lu Hou
Xianzhi Yu
Wulong Liu
Shiming Xiang
Lei Zhu
LRM
364
4
0
26 May 2025
BanditSpec: Adaptive Speculative Decoding via Bandit Algorithms
Yunlong Hou
Fengzhuo Zhang
Cunxiao Du
Xuan Zhang
Jiachun Pan
Tianyu Pang
Chao Du
Vincent Y. F. Tan
Zhuoran Yang
OffRL
432
5
0
21 May 2025
Abacus: A Cost-Based Optimizer for Semantic Operator Systems
Matthew Russo
Om Chabra
Gerardo Vitagliano
Chunwei Liu
Tim Kraska
Samuel Madden
Michael Cafarella
346
1
0
20 May 2025
SoftCoT++: Test-Time Scaling with Soft Chain-of-Thought Reasoning
Yige Xu
Xu Guo
Zhiwei Zeng
Chunyan Miao
BDL
LRM
494
13
0
16 May 2025
Towards Multi-Agent Reasoning Systems for Collaborative Expertise Delegation: An Exploratory Design Study
Baixuan Xu
Chunyang Li
Weiqi Wang
Wei Fan
Tianshi Zheng
Haizhou Shi
Tao Fan
Yangqiu Song
Qiang Yang
412
3
0
12 May 2025
Internet of Agents: Fundamentals, Applications, and Challenges
IEEE Transactions on Cognitive Communications and Networking (TCCN), 2025
Yuntao Wang
Shaolong Guo
Yanghe Pan
Zhou Su
Fahao Chen
Tom H. Luan
Peng Li
Jiawen Kang
Dusit Niyato
LLMAG
LM&Ro
AI4CE
459
17
0
12 May 2025
Improving Model Alignment Through Collective Intelligence of Open-Source LLMS
Junlin Wang
Roy Xie
Shang Zhu
Jue Wang
Ben Athiwaratkun
Bhuwan Dhingra
Shuaiwen Leon Song
Ce Zhang
James Zou
ALM
235
3
0
05 May 2025
Think Deep, Think Fast: Investigating Efficiency of Verifier-free Inference-time-scaling Methods
Junlin Wang
Shang Zhu
Jon Saad-Falcon
Ben Athiwaratkun
Qingyang Wu
Jue Wang
Shuaiwen Leon Song
Ce Zhang
Bhuwan Dhingra
James Y. Zou
LRM
260
16
0
18 Apr 2025
LITERA: An LLM Based Approach to Latin-to-English Translation
North American Chapter of the Association for Computational Linguistics (NAACL), 2025
Paul Rosu
242
1
0
14 Apr 2025
FuseRL: Dense Preference Optimization for Heterogeneous Model Fusion
Longguang Zhong
Fanqi Wan
Ziyi Yang
Guosheng Liang
Tianyuan Shi
Xiaojun Quan
MoMe
321
1
0
09 Apr 2025
Hogwild! Inference: Parallel LLM Generation via Concurrent Attention
Gleb Rodionov
Roman Garipov
Alina Shutova
George Yakushev
Erik Schultheis
Vage Egiazarian
Anton Sinitsin
Denis Kuznedelev
Dan Alistarh
LRM
514
20
0
08 Apr 2025
Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoning
Sugyeong Eo
Hyeonseok Moon
Evelyn Hayoon Zi
Chanjun Park
Heuiseok Lim
LLMAG
358
12
0
07 Apr 2025
Scaling Test-Time Inference with Policy-Optimized, Dynamic Retrieval-Augmented Generation via KV Caching and Decoding
Sakhinana Sagar Srinivas
Akash Das
Shivam Gupta
Venkataramana Runkana
OffRL
492
2
0
02 Apr 2025
Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Compute
Jianhao Chen
Zishuo Xun
Bocheng Zhou
Han Qi
Qiaosheng Zhang
...
Wei Hu
Yuzhong Qu
W. Ouyang
Wanli Ouyang
Shuyue Hu
547
14
0
01 Apr 2025
Aurelia: Test-time Reasoning Distillation in Audio-Visual LLMs
Sanjoy Chowdhury
Hanan Gani
Nishit Anand
Sayan Nag
Ruohan Gao
Mohamed Elhoseiny
Salman Khan
Dinesh Manocha
LRM
432
6
0
29 Mar 2025
MemInsight: Autonomous Memory Augmentation for LLM Agents
Rana Salama
Jason (Jinglun) Cai
Michelle Yuan
Anna Currey
Monica Sunkara
Yi Zhang
Yassine Benajiba
LLMAG
RALM
547
18
0
27 Mar 2025
Reasoning Beyond Limits: Advances and Open Problems for LLMs
ICT express (ICT Express), 2025
M. Ferrag
Norbert Tihanyi
Merouane Debbah
OffRL
LRM
AI4CE
ELM
805
18
0
26 Mar 2025
Ensemble Learning for Large Language Models in Text and Code Generation: A Survey
Mari Ashiga
Wei Jie
Fan Wu
Vardan K. Voskanyan
Fateme Dinmohammadi
P. Brookes
Jingzhi Gong
Zheng Wang
331
8
0
13 Mar 2025
This Is Your Doge, If It Please You: Exploring Deception and Robustness in Mixture of LLMs
Lorenz Wolf
Sangwoong Yoon
Ilija Bogunovic
215
1
0
07 Mar 2025
The Society of HiveMind: Multi-Agent Optimization of Foundation Model Swarms to Unlock the Potential of Collective Intelligence
International Conference on Swarm Intelligence (ICSI), 2025
Noah Mamie
Susie Xi Rao
LLMAG
AI4CE
353
2
0
07 Mar 2025
LLMs Can Generate a Better Answer by Aggregating Their Own Responses
Zichong Li
Xinyu Feng
Yuheng Cai
Zixuan Zhang
Tianyi Liu
Chen Liang
Weizhu Chen
Haoyu Wang
Tiejun Zhao
LRM
354
14
0
06 Mar 2025
Efficient Algorithms for Verifying Kruskal Rank in Sparse Linear Regression and Related Applications
Fengqin Zhou
334
23
0
06 Mar 2025
Union of Experts: Adapting Hierarchical Routing to Equivalently Decomposed Transformer
Yujiao Yang
Jing Lian
Linhui Li
MoE
358
0
0
04 Mar 2025
Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustness
Tingchen Fu
Fazl Barez
AAML
250
1
0
03 Mar 2025
CrowdSelect: Synthetic Instruction Data Selection with Multi-LLM Wisdom
Yisen Li
Lingfeng Yang
Wenxuan Shen
Pan Zhou
Yao Wan
Weiwei Lin
Benlin Liu
261
4
0
03 Mar 2025
Multi2: Multi-Agent Test-Time Scalable Framework for Multi-Document Processing
Juntai Cao
Xiang Zhang
Raymond Li
Chuyuan Li
Shafiq Joty
Shafiq Joty
Giuseppe Carenini
473
12
0
27 Feb 2025
Weaker LLMs' Opinions Also Matter: Mixture of Opinions Enhances LLM's Mathematical Reasoning
Yanan Chen
Ali Pesaranghader
Tanmana Sadhu
LRM
317
1
0
26 Feb 2025
Aligning Compound AI Systems via System-level DPO
Xiangwen Wang
Yibo Jacky Zhang
Zhoujie Ding
Katherine Tsai
Haolun Wu
Sanmi Koyejo
213
2
0
24 Feb 2025
Think Together and Work Better: Combining Humans' and LLMs' Think-Aloud Outcomes for Effective Text Evaluation
International Conference on Human Factors in Computing Systems (CHI), 2024
SeongYeub Chu
JongWoo Kim
MunYong Yi
354
14
0
21 Feb 2025
Minions: Cost-efficient Collaboration Between On-device and Cloud Language Models
A. Narayan
D. Biderman
Sabri Eyuboglu
Avner May
Scott W. Linderman
James Zou
Christopher Ré
261
12
0
21 Feb 2025
Optimizing Model Selection for Compound AI Systems
Lingjiao Chen
Jared Quincy Davis
Boris Hanin
Peter Bailis
Matei A. Zaharia
James Zou
Ion Stoica
421
17
0
20 Feb 2025
One-shot Federated Learning Methods: A Practical Guide
International Joint Conference on Artificial Intelligence (IJCAI), 2024
Xiang Liu
Zhenheng Tang
Xia Li
Yijun Song
Sijie Ji
Zemin Liu
Bo Han
Linshan Jiang
Jialin Li
FedML
383
6
0
13 Feb 2025
Previous
1
2
3
Next
