data2vec: A General Framework for Self-supervised Learning in Speech,
Vision and Language

v1v2v3 (latest)

data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language

International Conference on Machine Learning (ICML), 2022

7 February 2022

ArXiv (abs)PDF HTML

Papers citing "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language"

7 / 607 papers shown

Title
Adversarial Masking for Self-Supervised LearningInternational Conference on Machine Learning (ICML), 2022 Yuge Shi N. Siddharth Juil Sock Adam R. Kosiorek SSL 387 99 0 31 Jan 2022
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers Xiaoyi Dong Jianmin Bao Ting Zhang Dongdong Chen Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu Baining Guo ViT 336 271 0 24 Nov 2021
A Survey of Visual TransformersIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2021 Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Peng Wang Jianping Fan Zhiqiang He 3DGS ViT 390 461 0 11 Nov 2021
GenURL: A General Framework for Unsupervised Representation Learning Siyuan Li Zicheng Liu Z. Zang Di Wu Zhiyuan Chen Stan Z. Li OOD 3DGS OffRL 252 12 0 27 Oct 2021
Wav2vec-S: Semi-Supervised Pre-Training for Low-Resource ASRInterspeech (Interspeech), 2021 Hanjing Zhu Li Wang Yongfeng Zhang Gaofeng Cheng Pengyuan Zhang Yonghong Yan SSL VLM 238 10 0 09 Oct 2021
Using Self-Supervised Auxiliary Tasks to Improve Fine-Grained Facial RepresentationSocial Science Research Network (SSRN), 2021 Mahdi Pourmirzaei G. Montazer Farzaneh Esmaili CVBM 225 34 0 13 May 2021
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 1.2K 4,635 0 17 Jun 2020