Decoupling Common and Unique Representations for Multimodal
Self-supervised Learning

Decoupling Common and Unique Representations for Multimodal Self-supervised Learning

11 September 2023

Nassim Ait Ali Braham

Zhitong Xiong

Papers citing "Decoupling Common and Unique Representations for Multimodal Self-supervised Learning"

18 / 18 papers shown

Title
A Plasticity-Aware Method for Continual Self-Supervised Learning in Remote Sensing Lars Möllenbrok Behnood Rasti Begum Demir CLL 36 0 0 31 Mar 2025
TerraTorch: The Geospatial Foundation Models Toolkit Carlos Gomes Benedikt Blumenstiel Joao Lucas de Sousa Almeida Pedro Henrique de Oliveira P. Fraccaro Francesc Marti Escofet Daniela Szwarcman Naomi Simumba Romeo Kienzler Bianca Zadrozny 61 1 0 26 Mar 2025
On What Depends the Robustness of Multi-source Models to Missing Data in Earth Observation? Francisco Mena Diego Arenas Miro Miranda A. Dengel 35 0 0 25 Mar 2025
HiRes-FusedMIM: A High-Resolution RGB-DSM Pre-trained Model for Building-Level Remote Sensing Applications Guneet Mutreja Philipp Schuegraf Ksenia Bittner AI4CE 46 0 0 24 Mar 2025
Robust Multimodal Learning for Ophthalmic Disease Grading via Disentangled Representation X. Wang Yifang Wang Senwei Liang Feilong Tang Chengzhi Liu Ming Hu Chao Hu Junjun He Zongyuan Ge Imran Razzak 52 0 0 07 Mar 2025
Global and Dense Embeddings of Earth: Major TOM Floating in the Latent Space Mikolaj Czerkawski Marcin Kluczek Jędrzej S. Bojanowski 73 1 0 07 Dec 2024
Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applications Daniela Szwarcman Sujit Roy P. Fraccaro Þorsteinn Elí Gíslason Benedikt Blumenstiel ... Rahul Ramachandran Juan Bernabé-Moreno Manil Maskey Rahul Ramachandran Juan Bernabe Moreno VLM 67 12 0 03 Dec 2024
On the Foundations of Earth and Climate Foundation Models Xiao Xiang Zhu Zhitong Xiong Yi Wang Adam J. Stewart Konrad Heidler Yuanyuan Wang Zhenghang Yuan Thomas Dujardin Qingsong Xu Yilei Shi AI4Cl AI4CE 26 21 0 07 May 2024
CromSS: Cross-modal pre-training with noisy labels for remote sensing image segmentation Chenying Liu C. Albrecht Yi Wang Xiao Xiang Zhu 48 2 0 02 May 2024
Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observation Zhitong Xiong Yi Wang Fahong Zhang Adam J. Stewart Joelle Hanna Damian Borth Ioannis Papoutsis B. L. Saux Gustau Camps-Valls Xiao Xiang Zhu AI4CE 69 12 0 22 Mar 2024
MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretraining Di Wang Jing Zhang Minqiang Xu Lin Liu Dongsheng Wang ... Chengxi Han Haonan Guo Bo Du Dacheng Tao L. Zhang 29 44 0 20 Mar 2024
CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoders A. Fuller K. Millard James R. Green 15 60 0 01 Nov 2023
A Billion-scale Foundation Model for Remote Sensing Images Keumgang Cha Junghoon Seo Taekyung Lee 30 62 0 11 Apr 2023
Omnivore: A Single Model for Many Visual Modalities Rohit Girdhar Mannat Singh Nikhil Ravi L. V. D. van der Maaten Armand Joulin Ishan Misra 209 225 0 20 Jan 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,412 0 11 Nov 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 292 5,761 0 29 Apr 2021
Multimodal Self-Supervised Learning of General Audio Representations Luyu Wang Pauline Luc Adrià Recasens Jean-Baptiste Alayrac Aaron van den Oord SSL 70 41 0 26 Apr 2021
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text Hassan Akbari Liangzhe Yuan Rui Qian Wei-Hong Chuang Shih-Fu Chang Yin Cui Boqing Gong ViT 240 577 0 22 Apr 2021