PMR: Prototypical Modal Rebalance for Multimodal Learning

14 November 2022

Papers citing "PMR: Prototypical Modal Rebalance for Multimodal Learning"

35 / 35 papers shown

Title
Multifaceted Evaluation of Audio-Visual Capability for MLLMs: Effectiveness, Efficiency, Generalizability and Robustness Yusheng Zhao Junyu Luo Xiao Luo Weizhi Zhang Zhiping Xiao Wei Ju Philip S. Yu Ming Zhang AuLLM 32 0 0 03 Apr 2025
Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision Xiaofeng Han Shunpeng Chen Zenghuang Fu Zhe Feng Lue Fan ... Li Guo Weiliang Meng Xiaopeng Zhang Rongtao Xu Shibiao Xu 60 0 0 03 Apr 2025
Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition Chengxiang Huang Yake Wei Zequn Yang D. Hu 37 0 0 24 Mar 2025
DecAlign: Hierarchical Cross-Modal Alignment for Decoupled Multimodal Representation Learning Chengxuan Qian Shuo Xing Shawn Li Yue Zhao Zhengzhong Tu 46 0 0 14 Mar 2025
DynCIM: Dynamic Curriculum for Imbalanced Multimodal Learning Chengxuan Qian Kai Han J. Wang Zhenlong Yuan Rui Qian Chongwen Lyu Jun Chen 37 1 0 09 Mar 2025
Rebalanced Multimodal Learning with Data-aware Unimodal Sampling Qingyuan Jiang Zhouyang Chi Xiao Ma Qirong Mao Yang Yang Jinhui Tang 54 0 0 05 Mar 2025
Attention Bootstrapping for Multi-Modal Test-Time Adaptation Yusheng Zhao Junyu Luo Xiao Luo Jinsheng Huang Jingyang Yuan Zhiping Xiao M. Zhang TTA 82 0 0 04 Mar 2025
Rethinking Multimodal Learning from the Perspective of Mitigating Classification Ability Disproportion Qingyuan Jiang Longfei Huang Yang Yang 50 0 0 27 Feb 2025
Advancing Precision Oncology Through Modeling of Longitudinal and Multimodal Data Luoting Zhuang Stephen H. Park Steven J. Skates Ashley E. Prosper Denise R. Aberle William Hsu 108 0 0 11 Feb 2025
Enhancing Scene Classification in Cloudy Image Scenarios: A Collaborative Transfer Method with Information Regulation Mechanism using Optical Cloud-Covered and SAR Remote Sensing Images Yuze Wang Rong Xiao Haifeng Li Mariana Belgiu Chao Tao 31 0 0 08 Jan 2025
Balanced Multi-view Clustering Zhenglai Li Jun Wang Chang-Fu Tang Xinzhong Zhu Wei Zhang Xinwang Liu 69 0 0 05 Jan 2025
Discrepancy-Aware Attention Network for Enhanced Audio-Visual Zero-Shot Learning RunLin Yu Yipu Gong Wenrui Li Aiwen Sun Mengren Zheng VLM 72 0 0 16 Dec 2024
Text and Image Are Mutually Beneficial: Enhancing Training-Free Few-Shot Classification with CLIP Yayuan Li Jintao Guo Lei Qi Wenbin Li Yinghuan Shi VLM CLIP 74 0 0 16 Dec 2024
Multimodal Fusion Balancing Through Game-Theoretic Regularization Konstantinos Kontras Thomas Strypsteen Christos Chatzichristos Paul P. Liang Matthew Blaschko M. D. Vos 16 0 0 11 Nov 2024
Classifier-guided Gradient Modulation for Enhanced Multimodal Learning Zirun Guo Tao Jin Jingyuan Chen Zhou Zhao 26 0 0 03 Nov 2024
Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysis Xianbing Zhao Lizhen Qu Tao Feng Jianfei Cai Buzhou Tang 31 0 0 05 Sep 2024
Detached and Interactive Multimodal Learning Yunfeng Fan Wenchao Xu Haozhao Wang Junhong Liu Song Guo 28 3 0 28 Jul 2024
Balanced Multi-Relational Graph Clustering Zhixiang Shen Haolan He Zhao Kang 22 1 0 23 Jul 2024
PASSION: Towards Effective Incomplete Multi-Modal Medical Image Segmentation with Imbalanced Missing Rates Junjie Shi Caozhi Shang Zhaobin Sun Li Yu Xin Yang Zengqiang Yan 17 1 0 20 Jul 2024
Diagnosing and Re-learning for Balanced Multimodal Learning Yake Wei Siwei Li Ruoxuan Feng Di Hu 23 3 0 12 Jul 2024
Multimodal Classification via Modal-Aware Interactive Enhancement Qing-Yuan Jiang Zhouyang Chi Yang Yang 24 0 0 05 Jul 2024
MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance Yake Wei Di Hu 16 13 0 28 May 2024
ReconBoost: Boosting Can Achieve Modality Reconcilement Cong Hua Qianqian Xu Shilong Bao Zhiyong Yang Qingming Huang 23 9 0 15 May 2024
Improving Multimodal Learning with Multi-Loss Gradient Modulation Konstantinos Kontras Christos Chatzichristos Matthew Blaschko M. D. Vos 25 3 0 13 May 2024
Multimodal Fusion on Low-quality Data: A Comprehensive Survey Qingyang Zhang Yake Wei Zongbo Han Huazhu Fu Xi Peng ... Qinghua Hu Cai Xu Jie Wen Di Hu Changqing Zhang 21 25 0 27 Apr 2024
Separate in the Speech Chain: Cross-Modal Conditional Audio-Visual Target Speech Extraction Zhaoxi Mu Xinyu Yang 14 5 0 19 Apr 2024
Learning to Rebalance Multi-Modal Optimization by Adaptively Masking Subnetworks Yang Yang Hongpeng Pan Qingjun Jiang Yi Tian Xu Jinghui Tang 19 4 0 12 Apr 2024
MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformer Jianjian Cao Peng Ye Shengze Li Chong Yu Yansong Tang Jiwen Lu Tao Chen 20 15 0 05 Mar 2024
Quantifying and Enhancing Multi-modal Robustness with Modality Preference Zequn Yang Yake Wei Ce Liang Di Hu AAML 13 9 0 09 Feb 2024
Balanced Multi-modal Federated Learning via Cross-Modal Infiltration Yunfeng Fan Wenchao Xu Haozhao Wang Jiaqi Zhu Song Guo 8 0 0 31 Dec 2023
Exploring Multi-Modal Fusion for Image Manipulation Detection and Localization Konstantinos Triaridis Vasileios Mezaris 22 4 0 04 Dec 2023
Multimodal Representation Learning by Alternating Unimodal Adaptation Xiaohui Zhang Jaehong Yoon Mohit Bansal Huaxiu Yao 21 20 0 17 Nov 2023
Improving Discriminative Multi-Modal Learning with Large-Scale Pre-Trained Models Chenzhuang Du Yue Zhao Chonghua Liao Jiacheng You Jie Fu Hang Zhao 12 2 0 08 Oct 2023
Enhancing multimodal cooperation via sample-level modality valuation Yake Wei Ruoxuan Feng Zihe Wang Di Hu 11 11 0 12 Sep 2023
Audiovisual SlowFast Networks for Video Recognition Fanyi Xiao Yong Jae Lee Kristen Grauman Jitendra Malik Christoph Feichtenhofer 181 204 0 23 Jan 2020