Rethinking Pre-training and Self-training

11 June 2020

Papers citing "Rethinking Pre-training and Self-training"

50 / 112 papers shown

Title
Revisiting Multi-Scale Feature Fusion for Semantic Segmentation Tianjian Meng Golnaz Ghiasi Reza Mahjorian Quoc V. Le Mingxing Tan SSeg 20 2 0 23 Mar 2022
Learning Self-Supervised Low-Rank Network for Single-Stage Weakly and Semi-Supervised Semantic Segmentation Junwen Pan Pengfei Zhu Kaihua Zhang Bing Cao Yu Wang Dingwen Zhang Junwei Han Q. Hu 13 60 0 19 Mar 2022
Semi-Supervised Learning with Mutual Distillation for Monocular Depth Estimation Jongbeom Baek Gyeongnyeon Kim Seung Wook Kim FedML MDE 19 12 0 18 Mar 2022
Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy Yuanhan Zhang Qi Sun Yichun Zhou Zexin He Zhen-fei Yin Kunze Wang Lu Sheng Yu Qiao Jing Shao Ziwei Liu ObjD VLM 19 19 0 15 Mar 2022
Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective Quan Cui Bingchen Zhao Zhao-Min Chen Borui Zhao Renjie Song Jiajun Liang Boyan Zhou Osamu Yoshie 13 18 0 08 Mar 2022
Catch Me if You Can: A Novel Task for Detection of Covert Geo-Locations (CGL) Binoy Saha Sukhendu Das 8 1 0 05 Feb 2022
How Low Can We Go? Pixel Annotation for Semantic Segmentation Daniel Kigli Ariel Shamir S. Avidan VLM 16 1 0 25 Jan 2022
How does unlabeled data improve generalization in self-training? A one-hidden-layer theoretical analysis Shuai Zhang M. Wang Sijia Liu Pin-Yu Chen Jinjun Xiong SSL MLT 31 22 0 21 Jan 2022
Gait Recognition Based on Deep Learning: A Survey Claudio Filipi Gonçalves dos Santos Diego de Souza Oliveira Leandro A. Passos Rafael Gonçalves Pires Daniel Felipe Silva Santos ... Thierry Pinheiro Moreira Marcos Cleison S. Santana Mateus Roder Jo Paulo Papa Danilo Colombo CVBM 16 70 0 10 Jan 2022
A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentation Wuyang Chen Xianzhi Du Fan Yang Lucas Beyer Xiaohua Zhai ... Huizhong Chen Jing Li Xiaodan Song Zhangyang Wang Denny Zhou ViT 21 20 0 17 Dec 2021
RegionCLIP: Region-based Language-Image Pretraining Yiwu Zhong Jianwei Yang Pengchuan Zhang Chunyuan Li Noel Codella ... Luowei Zhou Xiyang Dai Lu Yuan Yin Li Jianfeng Gao VLM CLIP 32 551 0 16 Dec 2021
PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics Zudi Lin D. Wei J. Lichtman Hanspeter Pfister 21 22 0 10 Dec 2021
ConDA: Unsupervised Domain Adaptation for LiDAR Segmentation via Regularized Domain Concatenation Lingdong Kong N. Quader Venice Erin Liong 8 48 0 30 Nov 2021
Semi-Supervised Learning with Taxonomic Labels Jong-Chyi Su Subhransu Maji 21 10 0 23 Nov 2021
DP-SSL: Towards Robust Semi-supervised Learning with A Few Labeled Samples Yi Xu Jiandong Ding Lu Zhang Shuigeng Zhou 31 32 0 26 Oct 2021
Unsupervised Finetuning Suichan Li Dongdong Chen Yinpeng Chen Lu Yuan Lei Zhang Qi Chu B. Liu Nenghai Yu 17 8 0 18 Oct 2021
Self-Supervised Representation Learning: Introduction, Advances and Challenges Linus Ericsson H. Gouk Chen Change Loy Timothy M. Hospedales SSL OOD AI4TS 27 268 0 18 Oct 2021
Improving Fractal Pre-training Connor Anderson Ryan Farrell 80 27 0 06 Oct 2021
Using Psuedolabels for training Sentiment Classifiers makes the model generalize better across datasets N. Reddy Muktabh Mayank Srivastava 19 0 0 05 Oct 2021
Exploring the Limits of Large Scale Pre-training Samira Abnar Mostafa Dehghani Behnam Neyshabur Hanie Sedghi AI4CE 50 114 0 05 Oct 2021
Task-adaptive Pre-training and Self-training are Complementary for Natural Language Understanding Shiyang Li Semih Yavuz Wenhu Chen Xifeng Yan 18 12 0 14 Sep 2021
Learning 3D Mineral Prospectivity from 3D Geological Models Using Convolutional Neural Networks: Application to a Structure-controlled Hydrothermal Gold Deposit Hao Deng Yang Zheng Jin Chen Shuyang Yu K. Xiao Xiancheng Mao 8 44 0 02 Sep 2021
Benchmarking the Robustness of Instance Segmentation Models Said Fahri Altindis Yusuf Dalva Hamza Pehlivan Aysegül Dündar VLM OOD 29 11 0 02 Sep 2021
Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems Fei Mi Wanhao Zhou Feng Cai Lingjing Kong Minlie Huang Boi Faltings 27 32 0 28 Aug 2021
Reducing Label Effort: Self-Supervised meets Active Learning Javad Zolfaghari Bengar Joost van de Weijer Bartlomiej Twardowski Bogdan Raducanu VLM 14 60 0 25 Aug 2021
Multi-Task Self-Training for Learning General Representations Golnaz Ghiasi Barret Zoph E. D. Cubuk Quoc V. Le Tsung-Yi Lin SSL 13 100 0 25 Aug 2021
A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective? Hiroaki Mikami Kenji Fukumizu Shogo Murai Shuji Suzuki Yuta Kikuchi Taiji Suzuki S. Maeda Kohei Hayashi 38 12 0 25 Aug 2021
Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation Yuanyi Zhong Bodi Yuan Hong Wu Zhiqiang Yuan Jian Peng Yu-xiong Wang 30 167 0 20 Aug 2021
Enhancing MR Image Segmentation with Realistic Adversarial Data Augmentation C. L. P. Chen C. Qin C. Ouyang Zeju Li Shuo Wang Huaqi Qiu Liang Chen G. Tarroni Wenjia Bai Daniel Rueckert GAN MedIm 54 40 0 07 Aug 2021
Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigation Ruifei He Jihan Yang Xiaojuan Qi 13 115 0 23 Jul 2021
Semi-supervised Semantic Segmentation with Directional Context-aware Consistency Xin Lai Zhuotao Tian Li Jiang Shu-Lin Liu Hengshuang Zhao Liwei Wang Jiaya Jia 27 206 0 27 Jun 2021
Humble Teachers Teach Better Students for Semi-Supervised Object Detection Yihe Tang Weifeng Chen Yijun Luo Yuting Zhang 34 177 0 19 Jun 2021
End-to-End Semi-Supervised Object Detection with Soft Teacher Mengde Xu Zheng-Wei Zhang Han Hu Jianfeng Wang Lijuan Wang Fangyun Wei X. Bai Zicheng Liu 13 487 0 16 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 24 811 0 14 Jun 2021
Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absent Samira Abnar Rianne van den Berg Golnaz Ghiasi Mostafa Dehghani Nal Kalchbrenner Hanie Sedghi OOD CLL TTA 13 20 0 10 Jun 2021
Knowledge distillation: A good teacher is patient and consistent Lucas Beyer Xiaohua Zhai Amelie Royer L. Markeeva Rohan Anil Alexander Kolesnikov VLM 15 287 0 09 Jun 2021
Rethinking Training from Scratch for Object Detection Yang Li Hong Zhang Yu Zhang VLM OnRL ObjD 14 5 0 06 Jun 2021
Robust Mutual Learning for Semi-supervised Semantic Segmentation Pan Zhang Bo Zhang Ting Zhang Dong Chen Fang Wen 17 17 0 01 Jun 2021
Empirical Analysis of Image Caption Generation using Deep Learning Aditya R. Bhattacharya Eshwar Shamanna Girishekar Padmakar Anil Deshpande 9 1 0 14 May 2021
Improving Cross-Lingual Reading Comprehension with Self-Training Wei Huang Chien-yu Huang Hung-yi Lee LRM 20 1 0 08 May 2021
Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samples Mahmoud Assran Mathilde Caron Ishan Misra Piotr Bojanowski Armand Joulin Nicolas Ballas Michael G. Rabbat SSL 11 147 0 28 Apr 2021
Large-Scale Self- and Semi-Supervised Learning for Speech Translation Changhan Wang Anne Wu J. Pino Alexei Baevski Michael Auli Alexis Conneau SSL 31 44 0 14 Apr 2021
A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification Jong-Chyi Su Zezhou Cheng Subhransu Maji 15 57 0 01 Apr 2021
The GIST and RIST of Iterative Self-Training for Semi-Supervised Segmentation Eu Wern Teh Terrance Devries Brendan Duke R. Jiang P. Aarabi Graham W. Taylor VLM 23 8 0 31 Mar 2021
Factors of Influence for Transfer Learning across Diverse Appearance Domains and Task Types Thomas Mensink J. Uijlings Alina Kuznetsova Michael Gygli V. Ferrari VLM 15 80 0 24 Mar 2021
Dilated SpineNet for Semantic Segmentation Abdullah M. Rashwan Xianzhi Du Xiaoqi Yin Jing Li SSeg 13 7 0 23 Mar 2021
Revisiting ResNets: Improved Training and Scaling Strategies Irwan Bello W. Fedus Xianzhi Du E. D. Cubuk A. Srinivas Tsung-Yi Lin Jonathon Shlens Barret Zoph 27 297 0 13 Mar 2021
Probabilistic two-stage detection Xingyi Zhou V. Koltun Philipp Krahenbuhl ObjD 25 224 0 12 Mar 2021
Cycle Self-Training for Domain Adaptation Hong Liu Jianmin Wang Mingsheng Long 15 174 0 05 Mar 2021
Can Pretext-Based Self-Supervised Learning Be Boosted by Downstream Data? A Theoretical Analysis Jiaye Teng Weiran Huang Haowei He SSL 19 11 0 05 Mar 2021