Balanced Multimodal Learning via On-the-fly Gradient Modulation

Balanced Multimodal Learning via On-the-fly Gradient Modulation

29 March 2022

Papers citing "Balanced Multimodal Learning via On-the-fly Gradient Modulation"

12 / 12 papers shown

Title
Advancing Precision Oncology Through Modeling of Longitudinal and Multimodal Data Luoting Zhuang Stephen H. Park Steven J. Skates Ashley E. Prosper Denise R. Aberle William Hsu 117 0 0 11 Feb 2025
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey Dianzhi Yu Xinni Zhang Yankai Chen Aiwei Liu Yifei Zhang Philip S. Yu Irwin King VLM CLL 39 9 0 07 Oct 2024
Improving Discriminative Multi-Modal Learning with Large-Scale Pre-Trained Models Chenzhuang Du Yue Zhao Chonghua Liao Jiacheng You Jie Fu Hang Zhao 12 2 0 08 Oct 2023
Boosting Multi-modal Model Performance with Adaptive Gradient Modulation Hong Li Xingyu Li Pengbo Hu Yinuo Lei Chunxiao Li Yi Zhou 22 20 0 15 Aug 2023
Variational Probabilistic Fusion Network for RGB-T Semantic Segmentation Baihong Lin Zengrong Lin Yulan Guo Yulan Zhang Jianxiao Zou Shicai Fan 14 5 0 17 Jul 2023
Looking Similar, Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learning Nikhil Singh Chih-Wei Wu Iroro Orife Mahdi M. Kalayeh 23 2 0 12 Apr 2023
Balanced Audiovisual Dataset for Imbalance Analysis Wenke Xia Xu Zhao Xincheng Pang Changqing Zhang Di Hu 8 1 0 14 Feb 2023
PMR: Prototypical Modal Rebalance for Multimodal Learning Yunfeng Fan Wenchao Xu Haozhao Wang Junxiao Wang Song Guo 19 60 0 14 Nov 2022
Play It Back: Iterative Attention for Audio Recognition Alexandros Stergiou Dima Damen 19 4 0 20 Oct 2022
Multimodal Analogical Reasoning over Knowledge Graphs Ningyu Zhang Lei Li Xiang Chen Xiaozhuan Liang Shumin Deng Huajun Chen 29 26 0 01 Oct 2022
Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module Yih-Ling Liu Ziqi Yuan Huisheng Mao Zhiyun Liang Wanqiuyue Yang Yuanzhe Qiu Tie Cheng Xiaoteng Li Hua Xu Kai Gao 18 44 0 22 Aug 2022
Audiovisual SlowFast Networks for Video Recognition Fanyi Xiao Yong Jae Lee Kristen Grauman Jitendra Malik Christoph Feichtenhofer 192 204 0 23 Jan 2020