On the Adversarial Robustness of Mixture of Experts

On the Adversarial Robustness of Mixture of Experts

19 October 2022

Rodolphe Jenatton

Pranjal Awasthi

Srinadh Bhojanapalli

Papers citing "On the Adversarial Robustness of Mixture of Experts"

16 / 16 papers shown

Title
Backdoor Attacks Against Patch-based Mixture of Experts Cedric Chan Jona te Lintelo S. Picek AAML MoE 84 0 0 03 May 2025
Tight Clusters Make Specialized Experts Stefan K. Nielsen R. Teo Laziz U. Abdullaev Tan M. Nguyen MoE 56 2 0 21 Feb 2025
Towards Adversarial Robustness of Model-Level Mixture-of-Experts Architectures for Semantic Segmentation Svetlana Pavlitska Enrico Eisen J. Marius Zöllner AAML UQCV MoE 88 1 0 16 Dec 2024
MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts R. Teo Tan M. Nguyen MoE 31 3 0 18 Oct 2024
A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts Mohammed Nowaz Rabbani Chowdhury Meng Wang K. E. Maghraoui Naigang Wang Pin-Yu Chen Christopher Carothers MoE 24 4 0 26 May 2024
Evaluating the Adversarial Robustness of Retrieval-Based In-Context Learning for Large Language Models Simon Chi Lok Yu Jie He Pasquale Minervini Jeff Z. Pan 21 0 0 24 May 2024
Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts Anastasis Kratsios Haitz Sáez de Ocáriz Borde Takashi Furuya Marc T. Law MoE 28 1 0 05 Feb 2024
Routers in Vision Mixture of Experts: An Empirical Study Tianlin Liu Mathieu Blondel C. Riquelme J. Puigcerver MoE 34 3 0 29 Jan 2024
Dense Hopfield Networks in the Teacher-Student Setting Robin Thériault Daniele Tantari AAML 17 3 0 08 Jan 2024
From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape Timothy R. McIntosh Teo Susnjak Tong Liu Paul Watters Malka N. Halgamuge 79 46 0 18 Dec 2023
GraphMETRO: Mitigating Complex Graph Distribution Shifts via Mixture of Aligned Experts Shirley Wu Kaidi Cao Bruno Ribeiro James Y. Zou J. Leskovec OOD 16 3 0 07 Dec 2023
A Theoretical Explanation of Activation Sparsity through Flat Minima and Adversarial Robustness Ze Peng Lei Qi Yinghuan Shi Yang Gao 15 3 0 06 Sep 2023
Robust Mixture-of-Expert Training for Convolutional Neural Networks Yihua Zhang Ruisi Cai Tianlong Chen Guanhua Zhang Huan Zhang Pin-Yu Chen Shiyu Chang Zhangyang Wang Sijia Liu MoE AAML OOD 30 16 0 19 Aug 2023
Certifying Ensembles: A General Certification Theory with S-Lipschitzness Aleksandar Petrov Francisco Eiras Amartya Sanyal Philip H. S. Torr Adel Bibi UQCV 16 1 0 25 Apr 2023
Sparsity-Constrained Optimal Transport Tianlin Liu J. Puigcerver Mathieu Blondel OT 11 21 0 30 Sep 2022
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 239 642 0 21 Apr 2021