To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review

19 April 2023

Papers citing "To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review"

16 / 16 papers shown

Title
Modality Interactive Mixture-of-Experts for Fake News Detection Yifan Liu Y. Liu Z. Li Ruichen Yao Yang Zhang Dong Wang MoE 31 0 0 21 Jan 2025
"Efficient Complexity": a Constrained Optimization Approach to the Evolution of Natural Intelligence Serge Dolgikh 31 0 0 31 Dec 2024
An Information Criterion for Controlled Disentanglement of Multimodal Data Chenyu Wang Sharut Gupta Xinyi Zhang Sana Tonekaboni Stefanie Jegelka Tommi Jaakkola Caroline Uhler DRL 32 1 0 31 Oct 2024
Training Foundation Models as Data Compression: On Information, Model Weights and Copyright Law Giorgio Franceschelli Claudia Cevenini Mirco Musolesi 39 0 0 18 Jul 2024
Nonlinear time-series embedding by monotone variational inequality Jonathan Y. Zhou Yao Xie AI4TS 29 0 0 11 Jun 2024
High-Dimension Human Value Representation in Large Language Models Samuel Cahyawijaya Delong Chen Yejin Bang Leila Khalatbari Bryan Wilie Ziwei Ji Etsuko Ishii Pascale Fung 63 5 0 11 Apr 2024
A self-supervised framework for learning whole slide representations X. Hou Cheng Jiang A. Kondepudi Yiwei Lyu Asadur Chowdury Honglak Lee Todd C. Hollon MedIm 26 5 0 09 Feb 2024
TURBO: The Swiss Knife of Auto-Encoders Guillaume Quétant Yury Belousov Vitaliy Kinakh S. Voloshynovskiy 19 6 0 11 Nov 2023
Large Language Models at Work in China's Labor Market Qin Chen Jinfeng Ge Huaqing Xie Xingcheng Xu Yanqing Yang 39 1 0 17 Aug 2023
Conditional Graph Information Bottleneck for Molecular Relational Learning Namkyeong Lee Dongmin Hyun Gyoung S. Na Sungwon Kim Junseok Lee Chanyoung Park 30 22 0 29 Apr 2023
Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priors Ravid Shwartz-Ziv Micah Goldblum Hossein Souri Sanyam Kapoor Chen Zhu Yann LeCun A. Wilson UQCV BDL 56 43 0 20 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,337 0 11 Nov 2021
Compressive Visual Representations Kuang-Huei Lee Anurag Arnab S. Guadarrama John F. Canny Ian S. Fischer SSL 57 48 0 27 Sep 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 283 5,723 0 29 Apr 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 236 206 0 17 Feb 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,359 0 09 Mar 2020