An Empirical Study of Training Self-Supervised Vision Transformers

5 April 2021

Papers citing "An Empirical Study of Training Self-Supervised Vision Transformers"

50 / 389 papers shown

Title
Token Turing Machines are Efficient Vision Models Purvish Jajal Nick Eliopoulos Benjamin Shiue-Hal Chou George K. Thiravathukal James C. Davis Yung-Hsiang Lu 88 0 0 11 Sep 2024
Label-free Monitoring of Self-Supervised Learning Progress Isaac Xu Scott Lowe Thomas Trappenberg 32 1 0 10 Sep 2024
DetailCLIP: Detail-Oriented CLIP for Fine-Grained Tasks Amin Karimi Monsefi Kishore Prakash Sailaja Ali Alilooee Ser-Nam Lim R. Ramnath VLM 35 6 0 10 Sep 2024
Tissue Concepts: supervised foundation models in computational pathology Till Nicke Jan Raphael Schaefer Henning Hoefener Friedrich Feuerhake Dorit Merhof Fabian Kiessling Johannes Lotz MedIm 44 0 0 05 Sep 2024
iConFormer: Dynamic Parameter-Efficient Tuning with Input-Conditioned Adaptation Hayeon Jo Hyesong Choi Minhee Cho Dongbo Min 34 1 0 04 Sep 2024
A Survey of the Self Supervised Learning Mechanisms for Vision Transformers Asifullah Khan A. Sohail M. Fiaz Mehdi Hassan Tariq Habib Afridi ... Muhammad Zaigham Zaheer Kamran Ali Tangina Sultana Ziaurrehman Tanoli Naeem Akhter 45 3 0 30 Aug 2024
Snuffy: Efficient Whole Slide Image Classifier Hossein Jafarinia Alireza Alipanah Danial Hamdi Saeed Razavi Nahal Mirzaie M. Rohban 3DH 40 1 0 15 Aug 2024
HiLo: A Learning Framework for Generalized Category Discovery Robust to Domain Shifts Hongjun Wang S. Vaze Kai Han 72 4 0 08 Aug 2024
Unsupervised Representation Learning by Balanced Self Attention Matching Daniel Shalam Simon Korman SSL 33 0 0 04 Aug 2024
Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathology Eric Zimmermann Eugene Vorontsov Julian Viret Adam Casson Michal Zelechowski ... Razik Yousfi Thomas J. Fuchs Nicolò Fusi Siqi Liu Kristen Severson MedIm 31 27 0 01 Aug 2024
Scaling Backwards: Minimal Synthetic Pre-training? Ryo Nakamura Ryu Tadokoro Ryosuke Yamada Tim Puhlfürß Iro Laina Christian Rupprecht Walid Maalej Rio Yokota Hirokatsu Kataoka DD 16 2 0 01 Aug 2024
MILAN: Milli-Annotations for Lidar Semantic Segmentation Nermin Samet Gilles Puy Oriane Siméoni Renaud Marlet 3DPC 32 0 0 22 Jul 2024
Relational Representation Distillation Nikolaos Giakoumoglou Tania Stathaki 32 0 0 16 Jul 2024
Fine-grained Classes and How to Find Them Matej Grcić Artyom Gadetsky Maria Brbić 26 1 0 16 Jun 2024
A deep cut into Split Federated Self-supervised Learning Marcin Przewiȩźlikowski Marcin Osial Bartosz Zieliñski Marek 'Smieja FedML 40 0 0 12 Jun 2024
BAKU: An Efficient Transformer for Multi-Task Policy Learning Siddhant Haldar Zhuoran Peng Lerrel Pinto OffRL 32 26 0 11 Jun 2024
Visual Representation Learning with Stochastic Frame Prediction Huiwon Jang Dongyoung Kim Junsu Kim Jinwoo Shin Pieter Abbeel Younggyo Seo 34 2 0 11 Jun 2024
NeuroMoCo: A Neuromorphic Momentum Contrast Learning Method for Spiking Neural Networks Yuqi Ma Huamin Wang Hangchi Shen Xuemei Chen Shukai Duan Shiping Wen 54 0 0 10 Jun 2024
An Empirical Study into Clustering of Unseen Datasets with Self-Supervised Encoders Scott C. Lowe Joakim Bruslund Haurum Sageev Oore T. Moeslund Graham W. Taylor SSL 46 3 0 04 Jun 2024
Relation Modeling and Distillation for Learning with Noisy Labels Xiaming Chen Junlin Zhang Zhuang Qi Xin Qi NoLa 24 0 0 30 May 2024
Dinomaly: The Less Is More Philosophy in Multi-Class Unsupervised Anomaly Detection Jia Guo Shuai Lu Weihang Zhang Huiqi Li Huiqi Li Hongen Liao ViT 61 7 0 23 May 2024
OpenESS: Event-based Semantic Scene Understanding with Open Vocabularies Lingdong Kong You-Chen Liu Lai Xing Ng Benoit R. Cottereau Wei Tsang Ooi VLM 29 12 0 08 May 2024
$${M^2D}$NeRF: Multi-Modal Decomposition NeRF with 3D Feature Fields$ ${M^2D}$ NeRF: Multi-Modal Decomposition NeRF with 3D Feature Fields N. Wang Lefei Zhang Angel X Chang 46 0 0 08 May 2024
A Review on Discriminative Self-supervised Learning Methods in Computer Vision Nikolaos Giakoumoglou Tania Stathaki Athanasios Gkelias SSL 59 1 0 08 May 2024
BenthicNet: A global compilation of seafloor images for deep learning applications Scott C. Lowe B. Misiuk Isaac Xu Shakhboz Abdulazizov A. R. Baroi ... Jordan A. Thomson Brittany R. Wilson Melisa C. Wong Craig J. Brown Thomas Trappenberg 49 3 0 08 May 2024
Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Survey Guoping Xu Xiaxia Wang Xinglong Wu Xuesong Leng Yongchao Xu 3DPC 32 8 0 02 May 2024
Learning Discriminative Spatio-temporal Representations for Semi-supervised Action Recognition Yu Wang Sanpin Zhou Kun Xia Le Wang 29 0 0 25 Apr 2024
MiM: Mask in Mask Self-Supervised Pre-Training for 3D Medical Image Analysis Jiaxin Zhuang Linshan Wu Qiong Wang V. Vardhanabhuti Lin Luo Hao Chen Hao Chen 51 4 0 24 Apr 2024
AMU-Tuning: Effective Logit Bias for CLIP-based Few-shot Learning Yuwei Tang Zhenyi Lin Qilong Wang Pengfei Zhu Qinghua Hu 26 11 0 13 Apr 2024
Multi Positive Contrastive Learning with Pose-Consistent Generated Images Sho Inayoshi Aji Resindra Widya Satoshi Ozaki Junji Otsuka Takeshi Ohashi 3DH 44 1 0 04 Apr 2024
Training-Free Semantic Segmentation via LLM-Supervision Wenfang Sun Yingjun Du Gaowen Liu Ramana Rao Kompella Cees G. M. Snoek VLM 44 2 0 31 Mar 2024
NTK-Guided Few-Shot Class Incremental Learning Jingren Liu Zhong Ji Yanwei Pang Yunlong Yu CLL 34 3 0 19 Mar 2024
Advancing COVID-19 Detection in 3D CT Scans Qingqiu Li Runtian Yuan Junlin Hou Jilan Xu Yuejie Zhang Rui Feng Hao Chen 16 1 0 18 Mar 2024
GET: Unlocking the Multi-modal Potential of CLIP for Generalized Category Discovery Enguang Wang Zhimao Peng Zhengyuan Xie Fei Yang Xialei Liu Ming-Ming Cheng 56 3 0 15 Mar 2024
A Decade's Battle on Dataset Bias: Are We There Yet? Zhuang Liu Kaiming He 40 28 0 13 Mar 2024
Joint-Embedding Masked Autoencoder for Self-supervised Learning of Dynamic Functional Connectivity from the Human Brain Jungwon Choi Hyungi Lee Byung-Hoon Kim Juho Lee 72 0 0 11 Mar 2024
Poly-View Contrastive Learning Amitis Shidani Devon Hjelm Jason Ramapuram Russ Webb Eeshan Gunesh Dhekane Dan Busbridge VLM SSL 34 4 0 08 Mar 2024
Unsupervised Contrastive Learning for Robust RF Device Fingerprinting Under Time-Domain Shift Jun Chen Weng-Keen Wong B. Hamdaoui 47 3 0 06 Mar 2024
Incorporating simulated spatial context information improves the effectiveness of contrastive learning models Lizhen Zhu James Z. Wang Wonseuk Lee Bradley P. Wyble 37 2 0 26 Jan 2024
Deconstructing Denoising Diffusion Models for Self-Supervised Learning Xinlei Chen Zhuang Liu Saining Xie Kaiming He DiffM 32 53 0 25 Jan 2024
Rethinking Patch Dependence for Masked Autoencoders Letian Fu Long Lian Renhao Wang Baifeng Shi Xudong Wang Adam Yala Trevor Darrell Alexei A. Efros Ken Goldberg 26 14 0 25 Jan 2024
LW-FedSSL: Resource-efficient Layer-wise Federated Self-supervised Learning Ye Lin Tun Chu Myaet Thwal Le Quang Huy Minh N. H. Nguyen Choong Seon Hong FedML 38 2 0 22 Jan 2024
LDReg: Local Dimensionality Regularized Self-Supervised Learning Hanxun Huang R. Campello S. Erfani Xingjun Ma Michael E. Houle James Bailey 28 5 0 19 Jan 2024
Collaboratively Self-supervised Video Representation Learning for Action Recognition Jie M. Zhang Zhifan Wan Lanqing Hu Stephen Lin Shuzhe Wu Shiguang Shan TTA 64 1 0 15 Jan 2024
A Study on Self-Supervised Pretraining for Vision Problems in Gastrointestinal Endoscopy Edward Sanderson B. Matuszewski 21 2 0 11 Jan 2024
Morphing Tokens Draw Strong Masked Image Models Taekyung Kim Byeongho Heo Dongyoon Han 49 3 0 30 Dec 2023
Learning Anatomically Consistent Embedding for Chest Radiography Ziyu Zhou Haozhe Luo Jiaxuan Pang Xiaowei Ding Michael B. Gotway Jianming Liang SSL 9 5 0 01 Dec 2023
Text Attribute Control via Closed-Loop Disentanglement Lei Sha Thomas Lukasiewicz DRL 30 2 0 01 Dec 2023
FALCON: Fairness Learning via Contrastive Attention Approach to Continual Semantic Scene Understanding Thanh-Dat Truong Utsav Prabhu Bhiksha Raj Jackson Cothren Khoa Luu CLL 35 3 0 27 Nov 2023
CUCL: Codebook for Unsupervised Continual Learning Chen Cheng Jingkuan Song Xiaosu Zhu Junchen Zhu Lianli Gao H. Shen CLL 23 2 0 25 Nov 2023