v1v2 (latest)

Towards Understanding Why FixMatch Generalizes Better Than Supervised Learning

15 October 2024

Papers citing "Towards Understanding Why FixMatch Generalizes Better Than Supervised Learning"

37 / 37 papers shown

Title
Can semi-supervised learning use all the data effectively? A lower bound perspective Alexandru cTifrea Gizem Yüce Amartya Sanyal Fanny Yang 130 4 0 30 Nov 2023
Toolformer: Language Models Can Teach Themselves to Use Tools Timo Schick Jane Dwivedi-Yu Roberto Dessì Roberta Raileanu Maria Lomeli Luke Zettlemoyer Nicola Cancedda Thomas Scialom SyDa RALM 248 1,976 0 09 Feb 2023
SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learning Hao Chen R. Tao Yue Fan Yidong Wang Jindong Wang Bernt Schiele Xingxu Xie Bhiksha Raj Marios Savvides 132 166 0 26 Jan 2023
USB: A Unified Semi-supervised Learning Benchmark for Classification Yidong Wang Hao Chen Yue Fan Wangbin Sun R. Tao ... T. Shinozaki Bernt Schiele Jindong Wang Xingxu Xie Yue Zhang 174 121 0 12 Aug 2022
Towards Understanding Why Mask-Reconstruction Pretraining Helps in Downstream Tasks Jia Pan Pan Zhou Shuicheng Yan SSL 138 19 0 08 Jun 2022
FreeMatch: Self-adaptive Thresholding for Semi-supervised Learning Yidong Wang Hao Chen Qiang Heng Wenxin Hou Yue Fan ... Marios Savvides T. Shinozaki Bhiksha Raj Bernt Schiele Xing Xie 271 299 0 15 May 2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning Zixin Wen Yuanzhi Li SSL 140 36 0 12 May 2022
Don't fear the unlabelled: safe semi-supervised learning via simple debiasing Hugo Schmutz O. Humbert Pierre-Alexandre Mattei 116 9 0 14 Mar 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 1.5K 14,340 0 04 Mar 2022
FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labeling Bowen Zhang Yidong Wang Wenxin Hou Hao Wu Jindong Wang Manabu Okumura T. Shinozaki AAML 481 957 0 15 Oct 2021
Information-Theoretic Characterization of the Generalization Error for Iterative Semi-Supervised Learning Haiyun He Hanshu Yan Vincent Y. F. Tan 155 12 0 03 Oct 2021
Dash: Semi-Supervised Learning with Dynamic Thresholding Yi Tian Xu Lei Shang Jinxing Ye Qi Qian Yu-Feng Li Baigui Sun Hao Li Rong Jin 132 236 0 01 Sep 2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning Zixin Wen Yuanzhi Li SSL MLT 189 138 0 31 May 2021
Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning Zeyuan Allen-Zhu Yuanzhi Li FedML 262 389 0 17 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 941 44,908 0 22 Oct 2020
Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Data Colin Wei Kendrick Shen Yining Chen Tengyu Ma SSL 149 235 0 07 Oct 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 1.8K 20,536 0 19 Jun 2020
An Overview of Deep Semi-Supervised Learning Yassine Ouali C´eline Hudelot Myriam Tami SSL HAI 159 310 0 09 Jun 2020
Feature Purification: How Adversarial Training Performs Robust Deep Learning Zeyuan Allen-Zhu Yuanzhi Li MLT AAML 166 158 0 20 May 2020
fastai: A Layered API for Deep Learning Jeremy Howard Sylvain Gugger AI4CE 175 902 0 11 Feb 2020
FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence Kihyuk Sohn David Berthelot Chun-Liang Li Zizhao Zhang Nicholas Carlini E. D. Cubuk Alexey Kurakin Han Zhang Colin Raffel AAML 207 3,754 0 21 Jan 2020
ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring David Berthelot Nicholas Carlini E. D. Cubuk Alexey Kurakin Kihyuk Sohn Han Zhang Colin Raffel 224 696 0 21 Nov 2019
RandAugment: Practical automated data augmentation with a reduced search space E. D. Cubuk Barret Zoph Jonathon Shlens Quoc V. Le MQ 489 3,614 0 30 Sep 2019
MixMatch: A Holistic Approach to Semi-Supervised Learning David Berthelot Nicholas Carlini Ian Goodfellow Nicolas Papernot Avital Oliver Colin Raffel 326 3,109 0 06 May 2019
Unsupervised Data Augmentation for Consistency Training Qizhe Xie Zihang Dai Eduard H. Hovy Minh-Thang Luong Quoc V. Le 317 2,371 0 29 Apr 2019
Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks Sanjeev Arora S. Du Wei Hu Zhiyuan Li Ruosong Wang MLT 363 986 0 24 Jan 2019
Improved Regularization of Convolutional Neural Networks with Cutout Terrance Devries Graham W. Taylor 337 3,860 0 15 Aug 2017
Adversarial Dropout for Supervised and Semi-supervised Learning Sungrae Park Jun-Keon Park Su-Jin Shin Il-Chul Moon GAN 113 176 0 12 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 1.5K 139,401 0 12 Jun 2017
Convergence Analysis of Two-layer Neural Networks with ReLU Activation Yuanzhi Li Yang Yuan MLT 232 663 0 28 May 2017
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju Michael Cogswell Abhishek Das Ramakrishna Vedantam Devi Parikh Dhruv Batra FAtt 696 21,159 0 07 Oct 2016
Temporal Ensembling for Semi-Supervised Learning S. Laine Timo Aila UQCV 368 2,614 0 07 Oct 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 503 8,548 0 13 Aug 2016
Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learning Mehdi S. M. Sajjadi Mehran Javanmardi Tolga Tasdizen BDL 258 1,138 0 14 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 708 8,151 0 23 May 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 3.0K 199,698 0 10 Dec 2015
Learning with Pseudo-Ensembles Philip Bachman O. Alsharif Doina Precup 187 613 0 16 Dec 2014