No Reason for No Supervision: Improved Generalization in Supervised Models

30 June 2022

Mert Bulent Sariyildiz

Papers citing "No Reason for No Supervision: Improved Generalization in Supervised Models"

26 / 26 papers shown

Title
A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text? Julio Silva-Rodríguez Jose Dolz Ismail ben Ayed VLM MedIm 31 0 0 07 Apr 2025
Projection Head is Secretly an Information Bottleneck Zhuo Ouyang Kaiwen Hu Qi Zhang Yifei Wang Yisen Wang 37 0 0 01 Mar 2025
MaxSup: Overcoming Representation Collapse in Label Smoothing Yuxuan Zhou Heng Li Zhi-Qi Cheng Xudong Yan Mario Fritz M. Keuper 41 0 0 18 Feb 2025
MoTE: Reconciling Generalization with Specialization for Visual-Language to Video Knowledge Transfer Minghao Zhu Zhengpu Wang Mengxian Hu Ronghao Dang Xiao Lin Xun Zhou Chengju Liu Qijun Chen 30 1 0 14 Oct 2024
UNIC: Universal Classification Models via Multi-teacher Distillation Mert Bulent Sariyildiz Philippe Weinzaepfel Thomas Lucas Diane Larlus Yannis Kalantidis 29 6 0 09 Aug 2024
DualFed: Enjoying both Generalization and Personalization in Federated Learning via Hierachical Representations Guogang Zhu Xuefeng Liu Jianwei Niu Shaojie Tang Xinghao Wu Jiayuan Zhang AI4CE 45 1 0 25 Jul 2024
UDON: Universal Dynamic Online distillatioN for generic image representations Nikolaos-Antonios Ypsilantis Kaifeng Chen André Araujo Ondřej Chum 30 3 0 12 Jun 2024
Mind the Gap Between Synthetic and Real: Utilizing Transfer Learning to Probe the Boundaries of Stable Diffusion Generated Data Leonhard Hennicke C. Adriano Holger Giese Jan Mathias Koehler Lukas Schott DiffM 34 2 0 06 May 2024
Weatherproofing Retrieval for Localization with Generative AI and Geometric Consistency Yannis Kalantidis Mert Bulent Sariyildiz Rafael Sampaio de Rezende Philippe Weinzaepfel Diane Larlus G. Csurka 17 0 0 14 Feb 2024
Revisiting Supervision for Continual Representation Learning Daniel Marczak Sebastian Cygert Tomasz Trzciñski Bartlomiej Twardowski SSL CLL 23 0 0 22 Nov 2023
From Alexnet to Transformers: Measuring the Non-linearity of Deep Neural Networks with Affine Optimal Transport Quentin Bouniot I. Redko Anton Mallasto Charlotte Laclau Karol Arndt Oliver Struckmeier Markus Heinonen Ville Kyrki Samuel Kaski 54 2 0 17 Oct 2023
Plasticity-Optimized Complementary Networks for Unsupervised Continual Learning Alex Gomez-Villa Bartlomiej Twardowski Kai Wang Joost van de Weijer SSL CLL 18 8 0 12 Sep 2023
A General-Purpose Self-Supervised Model for Computational Pathology Richard J. Chen Tong Ding Ming Y. Lu Drew F. K. Williamson Guillaume Jaume ... Judy J. Wang Walt Williams L. Le Georg Gerber Faisal Mahmood MedIm 20 42 0 29 Aug 2023
Category Adaptation Meets Projected Distillation in Generalized Continual Category Discovery Grzegorz Rype'sć Daniel Marczak Sebastian Cygert Tomasz Trzciñski Bartlomiej Twardowski VLM CLL 28 2 0 23 Aug 2023
Self-Supervised Learning with Lie Symmetries for Partial Differential Equations Grégoire Mialon Q. Garrido Hannah Lawrence Danyal Rehman Yann LeCun B. Kiani SSL 14 24 0 11 Jul 2023
Quantifying the Variability Collapse of Neural Networks Jing-Xue Xu Haoxiong Liu 29 4 0 06 Jun 2023
Towards In-context Scene Understanding Ivana Balazevic David Steiner Nikhil Parthasarathy Relja Arandjelović Olivier J. Hénaff 15 28 0 02 Jun 2023
Improved baselines for vision-language pre-training Enrico Fini Pietro Astolfi Adriana Romero Soriano Jakob Verbeek M. Drozdzal SSL CLIP VLM 45 22 0 15 May 2023
Revisiting the Encoding of Satellite Image Time Series Xin Cai Y. Bi Peter Nicholl Roy Sterritt AI4TS 24 3 0 03 May 2023
Guillotine Regularization: Why removing layers is needed to improve generalization in Self-Supervised Learning Florian Bordes Randall Balestriero Q. Garrido Adrien Bardes Pascal Vincent 16 22 0 27 Jun 2022
Rethinking Supervised Pre-training for Better Downstream Transferring Yutong Feng Jianwen Jiang Mingqian Tang R. L. Jin Yue Gao SSL 43 39 0 12 Oct 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 207 484 0 01 Oct 2021
On the importance of cross-task features for class-incremental learning Albin Soutif--Cormerais Marc Masana Joost van de Weijer Bartlomiej Twardowski CLL 22 19 0 22 Jun 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 292 5,761 0 29 Apr 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,359 0 09 Mar 2020
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 282 39,170 0 01 Sep 2014