The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation

13 June 2022

Hang Zhao

Papers citing "The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation"

21 / 21 papers shown

Title
Crossmodal Knowledge Distillation with WordNet-Relaxed Text Embeddings for Robust Image Classification Chenqi Guo Mengshuo Rong Qianli Feng Rongfan Feng Yinglong Ma VLM 63 0 0 31 Mar 2025
Towards Robust Multimodal Representation: A Unified Approach with Adaptive Experts and Alignment Nazanin Moradinasab S. Sengupta Jiebei Liu Sana Syed Donald Brown 58 0 0 12 Mar 2025
COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognition Baiyu Chen Wilson Wongso Zechen Li Yonchanok Khaokaew Hao Xue Flora D. Salim 56 0 0 10 Mar 2025
X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensing Xinyan Chen Jianfei Yang 28 1 0 14 Oct 2024
DisCoM-KD: Cross-Modal Knowledge Distillation via Disentanglement Representation and Adversarial Learning Dino Ienco C. Dantas 25 1 0 05 Aug 2024
Detached and Interactive Multimodal Learning Yunfeng Fan Wenchao Xu Haozhao Wang Junhong Liu Song Guo 41 3 0 28 Jul 2024
Learning Modality Knowledge Alignment for Cross-Modality Transfer Wenxuan Ma Shuang Li Lincan Cai Jingxuan Kang 29 1 0 27 Jun 2024
What Radio Waves Tell Us about Sleep Hao He Chao Li W. Ganglberger Kaileigh Gallagher Rumen Hristov Michail Ouroutzoglou Haoqi Sun Jimeng Sun Brandon Westover Dina Katabi 17 2 0 20 May 2024
A Generalization Theory of Cross-Modality Distillation with Contrastive Learning Hangyu Lin Chen Liu Chengming Xu Zhengqi Gao Yanwei Fu Yuan Yao VLM 36 0 0 06 May 2024
Improving Dialogue Agents by Decomposing One Global Explicit Annotation with Local Implicit Multimodal Feedback Dong Won Lee Hae Won Park Yoon Kim C. Breazeal Louis-Philippe Morency 24 0 0 17 Mar 2024
Unlocking the Potential of Multimodal Unified Discrete Representation through Training-Free Codebook Optimization and Hierarchical Alignment Hai Huang Yan Xia Shengpeng Ji Shulei Wang Hanting Wang Jieming Zhu Zhenhua Dong Zhou Zhao 22 6 0 08 Mar 2024
TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation Taeyang Yun Hyunkuk Lim Jeong-Hoon Lee Min Song 17 11 0 16 Jan 2024
Balanced Multi-modal Federated Learning via Cross-Modal Infiltration Yunfeng Fan Wenchao Xu Haozhao Wang Jiaqi Zhu Song Guo 21 0 0 31 Dec 2023
Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorld Yijun Yang Tianyi Zhou Kanxue Li Dapeng Tao Lusong Li Li Shen Xiaodong He Jing Jiang Yuhui Shi LLMAG LM&Ro 16 34 0 28 Nov 2023
Radio2Text: Streaming Speech Recognition Using mmWave Radio Signals Running Zhao Jiang-Tao Luca Yu H. Zhao Edith C. H. Ngai 19 4 0 16 Aug 2023
Vision-Language Dataset Distillation Xindi Wu Byron Zhang Zhiwei Deng Olga Russakovsky DD VLM 21 8 0 15 Aug 2023
Understanding and Constructing Latent Modality Structures in Multi-modal Representation Learning Qian Jiang Changyou Chen Han Zhao Liqun Chen Q. Ping S. D. Tran Yi Xu Belinda Zeng Trishul M. Chilimbi 41 38 0 10 Mar 2023
TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models Sucheng Ren Fangyun Wei Zheng-Wei Zhang Han Hu 22 34 0 03 Jan 2023
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 16 60 0 07 Sep 2022
Omnivore: A Single Model for Many Visual Modalities Rohit Girdhar Mannat Singh Nikhil Ravi L. V. D. van der Maaten Armand Joulin Ishan Misra 211 225 0 20 Jan 2022
Feature Importance Ranking for Deep Learning Maksymilian Wojtas Ke Chen 126 116 0 18 Oct 2020