Papers citing 'Convergence Rates for Gaussian Mixtures of Experts'

Title
Dendrograms of Mixing Measures for Softmax-Gated Gaussian Mixture of Experts: Consistency without Model Sweeps Do Tien Hai T. T. N. Mai T. Nguyen Nhat Ho Binh T. Nguyen Christopher Drovandi 108 0 0 14 Oct 2025
Limitations of refinement methods for weak to strong generalization Seamus Somerstep Yaácov Ritov Mikhail Yurochkin Subha Maity Yuekai Sun 100 1 0 23 Aug 2025
Model Selection for Gaussian-gated Gaussian Mixture of Experts Using Dendrograms of Mixing Measures Tuan Thai TrungTin Nguyen Dat Do Nhat Ho Christopher Drovandi 343 2 0 19 May 2025
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications Siyuan Mu Sen Lin MoE 961 32 0 10 Mar 2025
Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among PromptsInternational Conference on Learning Representations (ICLR), 2024 Minh Le Chau Nguyen Huy Nguyen Quyen Tran Trung Le Nhat Ho 589 12 0 03 Oct 2024
Mixture of Experts Meets Prompt-Based Continual LearningNeural Information Processing Systems (NeurIPS), 2024 Minh Le An Nguyen Huy Nguyen Trang Nguyen Trang Pham L. Ngo Nhat Ho CLL 447 32 0 23 May 2024
Statistical Advantages of Perturbing Cosine Router in Mixture of ExpertsInternational Conference on Learning Representations (ICLR), 2024 Huy Le Nguyen Pedram Akbarian Trang Pham Trang Nguyen Shujian Zhang Nhat Ho MoE 301 2 0 23 May 2024
Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts Huy Nguyen Nhat Ho Alessandro Rinaldo 297 14 0 22 May 2024
On Parameter Estimation in Deviated Gaussian Mixture of Experts Huy Nguyen Khai Nguyen Nhat Ho 186 1 0 07 Feb 2024
Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts Anastasis Kratsios Haitz Sáez de Ocáriz Borde Takashi Furuya Marc T. Law MoE 475 2 0 05 Feb 2024
On Least Square Estimation in Softmax Gating Mixture of ExpertsInternational Conference on Machine Learning (ICML), 2024 Huy Nguyen Nhat Ho Alessandro Rinaldo 219 21 0 05 Feb 2024
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion Xing Han Huy Nguyen Carl Harris Nhat Ho Suchi Saria MoE 326 45 0 05 Feb 2024
CompeteSMoE -- Effective Training of Sparse Mixture of Experts via Competition Quang Pham Giang Do Huy Nguyen TrungTin Nguyen Chenghao Liu ... Binh T. Nguyen Savitha Ramasamy Xiaoli Li Steven C. H. Hoi Nhat Ho 147 22 0 04 Feb 2024
Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts?International Conference on Machine Learning (ICML), 2024 Huy Nguyen Pedram Akbarian Nhat Ho MoE 199 17 0 25 Jan 2024
Joint Problems in Learning Multiple Dynamical Systems Mengjia Niu Xiaoyu He Petr Rysavý Quan-Gen Zhou Georgios Korpas 308 3 0 03 Nov 2023
A General Theory for Softmax Gating Multinomial Logistic Mixture of ExpertsInternational Conference on Machine Learning (ICML), 2023 Huy Nguyen Pedram Akbarian TrungTin Nguyen Nhat Ho 217 17 0 22 Oct 2023
SQ Lower Bounds for Learning Mixtures of Linear ClassifiersNeural Information Processing Systems (NeurIPS), 2023 Ilias Diakonikolas D. Kane Yuxin Sun 193 3 0 18 Oct 2023
Statistical Perspective of Top-K Sparse Softmax Gating Mixture of ExpertsInternational Conference on Learning Representations (ICLR), 2023 Huy Nguyen Pedram Akbarian Fanqi Yan Nhat Ho MoE 303 23 0 25 Sep 2023
Quantum-AI empowered Intelligent Surveillance: Advancing Public Safety Through Innovative Contraband Detection Syed Atif Ali Shah N. Algeelani N. Al-Sammarraie 167 1 0 05 Sep 2023
Towards Convergence Rates for Parameter Estimation in Gaussian-gated Mixture of ExpertsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023 Huy Nguyen TrungTin Nguyen Khai Nguyen Nhat Ho MoE 307 19 0 12 May 2023
Demystifying Softmax Gating Function in Gaussian Mixture of ExpertsNeural Information Processing Systems (NeurIPS), 2023 Huy Nguyen TrungTin Nguyen Nhat Ho 192 32 0 05 May 2023
Mixed Regression via Approximate Message PassingJournal of machine learning research (JMLR), 2023 Nelvin Tan R. Venkataramanan 254 7 0 05 Apr 2023
PanIC: consistent information criteria for general model selection problems Hien Nguyen 147 4 0 07 Mar 2023
Strong identifiability and parameter learning in regression with heterogeneous responseElectronic Journal of Statistics (EJS), 2022 Dat Do Linh Do X. Nguyen 276 5 0 08 Dec 2022
Uniform Consistency in Nonparametric Mixture ModelsAnnals of Statistics (Ann. Stat.), 2021 Bryon Aragam Ruiyi Yang 245 6 0 31 Aug 2021
Non-asymptotic model selection in block-diagonal mixture of polynomial experts models TrungTin Nguyen Faicel Chamroukhi Hien Nguyen F. Forbes 192 10 0 18 Apr 2021
A non-asymptotic approach for model selection via penalization in high-dimensional mixture of experts modelsElectronic Journal of Statistics (EJS), 2021 TrungTin Nguyen Hien Nguyen Faicel Chamroukhi F. Forbes 322 15 0 06 Apr 2021
Estimation, Confidence Intervals, and Large-Scale Hypotheses Testing for High-Dimensional Mixed Linear Regression Linjun Zhang Rong Ma T. Tony Cai Hongzhe Li 126 12 0 06 Nov 2020
Non-asymptotic oracle inequalities for the Lasso in high-dimensional mixture of experts TrungTin Nguyen Hien Nguyen Faicel Chamroukhi Geoffrey J. McLachlan 497 4 0 22 Sep 2020
On the Minimax Optimality of the EM Algorithm for Learning Two-Component Mixed Linear RegressionInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2020 Jeongyeol Kwon Nhat Ho Constantine Caramanis 216 41 0 04 Jun 2020
Estimating the Number of Components in Finite Mixture Models via the Group-Sort-Fuse Procedure Tudor Manole Abbas Khalili 194 22 0 24 May 2020
Minimax Confidence Intervals for the Sliced Wasserstein DistanceElectronic Journal of Statistics (EJS), 2019 Tudor Manole Sivaraman Balakrishnan Larry A. Wasserman 327 42 0 17 Sep 2019
Learning in Gated Neural NetworksInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2019 Ashok Vardhan Makkuva Sewoong Oh Sreeram Kannan Pramod Viswanath 167 13 0 06 Jun 2019