ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1910.10699
  4. Cited By
Contrastive Representation Distillation
v1v2v3 (latest)

Contrastive Representation Distillation

International Conference on Learning Representations (ICLR), 2019
23 October 2019
Yonglong Tian
Dilip Krishnan
Phillip Isola
ArXiv (abs)PDFHTMLGithub (2336★)

Papers citing "Contrastive Representation Distillation"

36 / 686 papers shown
Title
SuperMix: Supervising the Mixing Data Augmentation
SuperMix: Supervising the Mixing Data AugmentationComputer Vision and Pattern Recognition (CVPR), 2020
Ali Dabouei
Sobhan Soleymani
Fariborz Taherkhani
Nasser M. Nasrabadi
305
116
0
10 Mar 2020
Knowledge distillation via adaptive instance normalization
Knowledge distillation via adaptive instance normalization
Jing Yang
Brais Martínez
Adrian Bulat
Georgios Tzimiropoulos
115
28
0
09 Mar 2020
Knapsack Pruning with Inner Distillation
Knapsack Pruning with Inner Distillation
Y. Aflalo
Asaf Noy
Ming Lin
Itamar Friedman
Lihi Zelnik-Manor
3DPC
161
36
0
19 Feb 2020
Subclass Distillation
Subclass Distillation
Rafael Müller
Simon Kornblith
Geoffrey E. Hinton
138
35
0
10 Feb 2020
The State of Knowledge Distillation for Classification
The State of Knowledge Distillation for Classification
Fabian Ruffy
K. Chahal
154
21
0
20 Dec 2019
QUEST: Quantized embedding space for transferring knowledge
QUEST: Quantized embedding space for transferring knowledgeEuropean Conference on Computer Vision (ECCV), 2019
Himalaya Jain
Spyros Gidaris
N. Komodakis
P. Pérez
Matthieu Cord
167
14
0
03 Dec 2019
Similarity-Preserving Knowledge Distillation
Similarity-Preserving Knowledge DistillationIEEE International Conference on Computer Vision (ICCV), 2019
Frederick Tung
Greg Mori
403
1,123
0
23 Jul 2019
Contrastive Multiview Coding
Contrastive Multiview CodingEuropean Conference on Computer Vision (ECCV), 2019
Yonglong Tian
Dilip Krishnan
Phillip Isola
SSL
571
2,592
0
13 Jun 2019
Variational Information Distillation for Knowledge Transfer
Variational Information Distillation for Knowledge Transfer
SungSoo Ahn
S. Hu
Andreas C. Damianou
Neil D. Lawrence
Zhenwen Dai
314
687
0
11 Apr 2019
Relational Knowledge Distillation
Relational Knowledge Distillation
Wonpyo Park
Dongju Kim
Yan Lu
Minsu Cho
429
1,679
0
10 Apr 2019
Correlation Congruence for Knowledge Distillation
Correlation Congruence for Knowledge Distillation
Baoyun Peng
Xiao Jin
Jiaheng Liu
Shunfeng Zhou
Yichao Wu
Yu Liu
Dongsheng Li
Zhaoning Zhang
252
587
0
03 Apr 2019
A Theoretical Analysis of Contrastive Unsupervised Representation
  Learning
A Theoretical Analysis of Contrastive Unsupervised Representation Learning
Sanjeev Arora
H. Khandeparkar
M. Khodak
Orestis Plevrakis
Nikunj Saunshi
SSL
227
847
0
25 Feb 2019
ExpandNets: Linear Over-parameterization to Train Compact Convolutional
  Networks
ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks
Shuxuan Guo
J. Álvarez
Mathieu Salzmann
349
85
0
26 Nov 2018
Knowledge Transfer via Distillation of Activation Boundaries Formed by
  Hidden Neurons
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden NeuronsAAAI Conference on Artificial Intelligence (AAAI), 2018
Byeongho Heo
Minsik Lee
Sangdoo Yun
J. Choi
177
581
0
08 Nov 2018
Learning deep representations by mutual information estimation and
  maximization
Learning deep representations by mutual information estimation and maximization
R. Devon Hjelm
A. Fedorov
Samuel Lavoie-Marchildon
Karan Grewal
Phil Bachman
Adam Trischler
Yoshua Bengio
SSLDRL
775
2,870
0
20 Aug 2018
MnasNet: Platform-Aware Neural Architecture Search for Mobile
MnasNet: Platform-Aware Neural Architecture Search for Mobile
Mingxing Tan
Bo Chen
Ruoming Pang
Vijay Vasudevan
Mark Sandler
Andrew G. Howard
Quoc V. Le
MQ
291
3,254
0
31 Jul 2018
Representation Learning with Contrastive Predictive Coding
Representation Learning with Contrastive Predictive Coding
Aaron van den Oord
Yazhe Li
Oriol Vinyals
DRLSSL
1.6K
11,962
0
10 Jul 2018
Knowledge Distillation by On-the-Fly Native Ensemble
Knowledge Distillation by On-the-Fly Native Ensemble
Xu Lan
Xiatian Zhu
S. Gong
446
523
0
12 Jun 2018
Unsupervised Feature Learning via Non-Parametric Instance-level
  Discrimination
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination
Zhirong Wu
Yuanjun Xiong
Stella X. Yu
Dahua Lin
SSL
874
3,747
0
05 May 2018
Learning Deep Representations with Probabilistic Knowledge Transfer
Learning Deep Representations with Probabilistic Knowledge Transfer
Nikolaos Passalis
Anastasios Tefas
309
462
0
28 Mar 2018
Paraphrasing Complex Network: Network Compression via Factor Transfer
Paraphrasing Complex Network: Network Compression via Factor Transfer
Jangho Kim
Seonguk Park
Nojun Kwak
274
612
0
14 Feb 2018
MobileNetV2: Inverted Residuals and Linear Bottlenecks
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Mark Sandler
Andrew G. Howard
Menglong Zhu
A. Zhmoginov
Liang-Chieh Chen
1.6K
22,215
0
13 Jan 2018
ShuffleNet: An Extremely Efficient Convolutional Neural Network for
  Mobile Devices
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Xiangyu Zhang
Xinyu Zhou
Mengxiao Lin
Jian Sun
AI4TS
698
7,798
0
04 Jul 2017
Deep Mutual Learning
Deep Mutual Learning
Ying Zhang
Tao Xiang
Timothy M. Hospedales
Huchuan Lu
FedML
492
1,840
0
01 Jun 2017
Paying More Attention to Attention: Improving the Performance of
  Convolutional Neural Networks via Attention Transfer
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer
Sergey Zagoruyko
N. Komodakis
414
2,862
0
12 Dec 2016
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel
  Prediction
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction
Richard Y. Zhang
Phillip Isola
Alexei A. Efros
SSLDRL
329
687
0
29 Nov 2016
SoundNet: Learning Sound Representations from Unlabeled Video
SoundNet: Learning Sound Representations from Unlabeled Video
Y. Aytar
Carl Vondrick
Antonio Torralba
SSL
305
1,082
0
27 Oct 2016
Understanding intermediate layers using linear classifier probes
Understanding intermediate layers using linear classifier probesInternational Conference on Learning Representations (ICLR), 2016
Guillaume Alain
Yoshua Bengio
FAtt
419
1,139
0
05 Oct 2016
Wide Residual Networks
Wide Residual Networks
Sergey Zagoruyko
N. Komodakis
857
8,537
0
23 May 2016
Deep Residual Learning for Image Recognition
Deep Residual Learning for Image Recognition
Kaiming He
Xinming Zhang
Shaoqing Ren
Jian Sun
MedIm
3.5K
214,123
0
10 Dec 2015
Cross Modal Distillation for Supervision Transfer
Cross Modal Distillation for Supervision Transfer
Saurabh Gupta
Judy Hoffman
Jitendra Malik
399
567
0
02 Jul 2015
Distilling the Knowledge in a Neural Network
Distilling the Knowledge in a Neural Network
Geoffrey E. Hinton
Oriol Vinyals
J. Dean
FedML
753
22,073
0
09 Mar 2015
FitNets: Hints for Thin Deep Nets
FitNets: Hints for Thin Deep NetsInternational Conference on Learning Representations (ICLR), 2014
Adriana Romero
Nicolas Ballas
Samira Ebrahimi Kahou
Antoine Chassang
C. Gatta
Yoshua Bengio
FedML
1.2K
4,318
0
19 Dec 2014
On distinguishability criteria for estimating generative models
On distinguishability criteria for estimating generative modelsInternational Conference on Learning Representations (ICLR), 2014
Ian Goodfellow
GAN
304
141
0
19 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition
Very Deep Convolutional Networks for Large-Scale Image RecognitionInternational Conference on Learning Representations (ICLR), 2014
Karen Simonyan
Andrew Zisserman
FAttMDE
3.3K
107,446
0
04 Sep 2014
Do Deep Nets Really Need to be Deep?
Do Deep Nets Really Need to be Deep?Neural Information Processing Systems (NeurIPS), 2013
Lei Jimmy Ba
R. Caruana
525
2,193
0
21 Dec 2013
Previous
123...121314