ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1904.03624
  4. Cited By
Learning Metrics from Teachers: Compact Networks for Image Embedding

Learning Metrics from Teachers: Compact Networks for Image Embedding

7 April 2019
Lu Yu
V. O. Yazici
Xialei Liu
Joost van de Weijer
Yongmei Cheng
Arnau Ramisa
ArXiv (abs)PDFHTMLGithub (76★)

Papers citing "Learning Metrics from Teachers: Compact Networks for Image Embedding"

50 / 53 papers shown
Global Multiple Extraction Network for Low-Resolution Facial Expression Recognition
Global Multiple Extraction Network for Low-Resolution Facial Expression Recognition
Jingyi Shi
CVBM
145
0
0
08 Nov 2025
Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks
Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep NetworksInternational Conference on Learning Representations (ICLR), 2024
S. Joshi
Jiayi Ni
Baharan Mirzasoleiman
DD
721
4
0
03 Oct 2024
Look Through Masks: Towards Masked Face Recognition with De-Occlusion
  Distillation
Look Through Masks: Towards Masked Face Recognition with De-Occlusion DistillationACM Multimedia (ACM MM), 2020
Chenyu Li
Shiming Ge
Daichi Zhang
Jia Li
CVBM
246
66
0
19 Sep 2024
Look One and More: Distilling Hybrid Order Relational Knowledge for
  Cross-Resolution Image Recognition
Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image RecognitionAAAI Conference on Artificial Intelligence (AAAI), 2020
Shiming Ge
Kangkai Zhang
Haolin Liu
Yingying Hua
Shengwei Zhao
Xin Jin
Hao Wen
266
30
0
09 Sep 2024
Exploiting the Semantic Knowledge of Pre-trained Text-Encoders for Continual Learning
Exploiting the Semantic Knowledge of Pre-trained Text-Encoders for Continual Learning
Lu Yu
Hesong Li
Ying Fu
Joost van de Weijer
Bartłomiej Twardowski
Joost van de Weijer
Changsheng Xu
CLL
359
2
0
02 Aug 2024
AMD: Automatic Multi-step Distillation of Large-scale Vision Models
AMD: Automatic Multi-step Distillation of Large-scale Vision Models
Cheng Han
Qifan Wang
S. Dianat
Majid Rabbani
Raghuveer M. Rao
Yi Fang
Qiang Guan
Lifu Huang
Dongfang Liu
VLM
209
14
0
05 Jul 2024
Exploring Dark Knowledge under Various Teacher Capacities and Addressing Capacity Mismatch
Exploring Dark Knowledge under Various Teacher Capacities and Addressing Capacity Mismatch
Wen-Shu Fan
Xin-Chun Li
Bowen Tao
315
4
0
21 May 2024
Deep Boosting Learning: A Brand-new Cooperative Approach for Image-Text
  Matching
Deep Boosting Learning: A Brand-new Cooperative Approach for Image-Text Matching
Haiwen Diao
Ying Zhang
Shang Gao
Xiang Ruan
Huchuan Lu
311
4
0
28 Apr 2024
Robust feature knowledge distillation for enhanced performance of
  lightweight crack segmentation models
Robust feature knowledge distillation for enhanced performance of lightweight crack segmentation models
Zhaohui Chen
Elyas Asadi Shamsabadi
Sheng Jiang
Luming Shen
Daniel Dias-da-Costa
195
2
0
09 Apr 2024
SnapCap: Efficient Snapshot Compressive Video Captioning
SnapCap: Efficient Snapshot Compressive Video Captioning
Jianqiao Sun
Yudi Su
Hao Zhang
Ziheng Cheng
Zequn Zeng
Zhengjue Wang
Bo Chen
Xin Yuan
404
2
0
10 Jan 2024
Learning Using Generated Privileged Information by Text-to-Image
  Diffusion Models
Learning Using Generated Privileged Information by Text-to-Image Diffusion ModelsInternational Conference on Pattern Recognition (ICPR), 2023
Rafael-Edy Menadil
Mariana-Iuliana Georgescu
Radu Tudor Ionescu
VLMDiffM
215
0
0
26 Sep 2023
A Sentence Speaks a Thousand Images: Domain Generalization through
  Distilling CLIP with Language Guidance
A Sentence Speaks a Thousand Images: Domain Generalization through Distilling CLIP with Language GuidanceIEEE International Conference on Computer Vision (ICCV), 2023
Zeyi Huang
Andy Zhou
Zijian Lin
Mu Cai
Haohan Wang
Yong Jae Lee
VLMOOD
237
52
0
21 Sep 2023
Audio Embeddings as Teachers for Music Classification
Audio Embeddings as Teachers for Music ClassificationInternational Society for Music Information Retrieval Conference (ISMIR), 2023
Yiwei Ding
Alexander Lerch
147
5
0
30 Jun 2023
Lightning Fast Video Anomaly Detection via Adversarial Knowledge
  Distillation
Lightning Fast Video Anomaly Detection via Adversarial Knowledge DistillationComputer Vision and Image Understanding (CVIU), 2022
Florinel-Alin Croitoru
Nicolae-Cătălin Ristea
D. Dascalescu
Radu Tudor Ionescu
Fahad Shahbaz Khan
M. Shah
330
6
0
28 Nov 2022
Cross-Modal Fusion Distillation for Fine-Grained Sketch-Based Image
  Retrieval
Cross-Modal Fusion Distillation for Fine-Grained Sketch-Based Image RetrievalBritish Machine Vision Conference (BMVC), 2022
Abhra Chaudhuri
Goran Frehse
Yanbei Chen
Zeynep Akata
Anjan Dutta
237
7
0
19 Oct 2022
Asymmetric Temperature Scaling Makes Larger Networks Teach Well Again
Asymmetric Temperature Scaling Makes Larger Networks Teach Well AgainNeural Information Processing Systems (NeurIPS), 2022
Xin-Chun Li
Wenxuan Fan
Shaoming Song
Yinchuan Li
Bingshuai Li
Yunfeng Shao
De-Chuan Zhan
247
34
0
10 Oct 2022
Coded Residual Transform for Generalizable Deep Metric Learning
Coded Residual Transform for Generalizable Deep Metric LearningNeural Information Processing Systems (NeurIPS), 2022
Shichao Kan
Yixiong Liang
Min Li
Yigang Cen
Jianxin Wang
Z. He
267
2
0
09 Oct 2022
Attention Distillation: self-supervised vision transformer students need
  more guidance
Attention Distillation: self-supervised vision transformer students need more guidanceBritish Machine Vision Conference (BMVC), 2022
Kai Wang
Fei Yang
Joost van de Weijer
ViT
162
21
0
03 Oct 2022
Utilizing Expert Features for Contrastive Learning of Time-Series
  Representations
Utilizing Expert Features for Contrastive Learning of Time-Series RepresentationsInternational Conference on Machine Learning (ICML), 2022
Manuel Nonnenmacher
Lukas Oldenburg
Ingo Steinwart
David Reeb
AI4TS
199
25
0
23 Jun 2022
ProtoCLIP: Prototypical Contrastive Language Image Pretraining
ProtoCLIP: Prototypical Contrastive Language Image PretrainingIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022
Delong Chen
Zhao Wu
Fan Liu
Zaiquan Yang
Huaxi Huang
Ying Tan
Erjin Zhou
VLMCLIP
265
28
0
22 Jun 2022
Continual Learning for Visual Search with Backward Consistent Feature
  Embedding
Continual Learning for Visual Search with Backward Consistent Feature EmbeddingComputer Vision and Pattern Recognition (CVPR), 2022
Timmy S. T. Wan
Jun-Cheng Chen
Tzer-Yi Wu
Chu-Song Chen
CLLVLM
211
28
0
26 May 2022
Improving the Latent Space of Image Style Transfer
Improving the Latent Space of Image Style Transfer
Yun-Hao Bai
Cairong Wang
C. Yuan
Yanbo Fan
Jue Wang
DRL
181
0
0
24 May 2022
Generalized Knowledge Distillation via Relationship Matching
Generalized Knowledge Distillation via Relationship MatchingIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Han-Jia Ye
Su Lu
De-Chuan Zhan
FedML
185
25
0
04 May 2022
Universal Representations: A Unified Look at Multiple Task and Domain
  Learning
Universal Representations: A Unified Look at Multiple Task and Domain LearningInternational Journal of Computer Vision (IJCV), 2022
Wei-Hong Li
Xialei Liu
Hakan Bilen
SSLOOD
426
34
0
06 Apr 2022
Weak Augmentation Guided Relational Self-Supervised Learning
Weak Augmentation Guided Relational Self-Supervised LearningIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Mingkai Zheng
Shan You
Fei Wang
Chao Qian
Changshui Zhang
Xiaogang Wang
Chang Xu
328
6
0
16 Mar 2022
Pixel Distillation: A New Knowledge Distillation Scheme for
  Low-Resolution Image Recognition
Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
Guangyu Guo
Dingwen Zhang
Longfei Han
Nian Liu
Ming-Ming Cheng
Junwei Han
236
2
0
17 Dec 2021
Teacher-Student Training and Triplet Loss to Reduce the Effect of
  Drastic Face Occlusion
Teacher-Student Training and Triplet Loss to Reduce the Effect of Drastic Face OcclusionMachine Vision and Applications (MVA), 2021
Mariana-Iuliana Georgescu
Georgian-Emilian Duta
Radu Tudor Ionescu
3DHCVBM
192
21
0
20 Nov 2021
Distilling Object Detectors with Feature Richness
Distilling Object Detectors with Feature RichnessNeural Information Processing Systems (NeurIPS), 2021
Zhixing Du
Rui Zhang
Ming-Fang Chang
Xishan Zhang
Shaoli Liu
Tianshi Chen
Yunji Chen
ObjD
219
91
0
01 Nov 2021
Semi-Supervised Domain Generalizable Person Re-Identification
Semi-Supervised Domain Generalizable Person Re-Identification
Lingxiao He
Wu Liu
Jian Liang
Kecheng Zheng
Xingyu Liao
Peng Cheng
Tao Mei
OOD
156
19
0
11 Aug 2021
Dual-Tuning: Joint Prototype Transfer and Structure Regularization for
  Compatible Feature Learning
Dual-Tuning: Joint Prototype Transfer and Structure Regularization for Compatible Feature LearningIEEE transactions on multimedia (IEEE Trans. Multimedia), 2021
Yan Bai
J. Jiao
Shengsen Wu
Yihang Lou
Jun Liu
Xuetao Feng
Ling-yu Duan
236
8
0
06 Aug 2021
Embedding Transfer with Label Relaxation for Improved Metric Learning
Embedding Transfer with Label Relaxation for Improved Metric LearningComputer Vision and Pattern Recognition (CVPR), 2021
Sungyeon Kim
Dongwon Kim
Minsu Cho
Suha Kwak
215
42
0
27 Mar 2021
Deep Ensemble Collaborative Learning by using Knowledge-transfer Graph
  for Fine-grained Object Classification
Deep Ensemble Collaborative Learning by using Knowledge-transfer Graph for Fine-grained Object Classification
Naoki Okamoto
Soma Minami
Tsubasa Hirakawa
Takayoshi Yamashita
H. Fujiyoshi
FedML
140
2
0
27 Mar 2021
Universal Representation Learning from Multiple Domains for Few-shot
  Classification
Universal Representation Learning from Multiple Domains for Few-shot ClassificationIEEE International Conference on Computer Vision (ICCV), 2021
Weihong Li
Xialei Liu
Hakan Bilen
SSLOODVLM
261
109
0
25 Mar 2021
Compacting Deep Neural Networks for Internet of Things: Methods and
  Applications
Compacting Deep Neural Networks for Internet of Things: Methods and ApplicationsIEEE Internet of Things Journal (IEEE IoT Journal), 2021
Ke Zhang
Hanbo Ying
Hongning Dai
Lin Li
Yuangyuang Peng
Keyi Guo
Hongfang Yu
283
46
0
20 Mar 2021
Collaborative Teacher-Student Learning via Multiple Knowledge Transfer
Collaborative Teacher-Student Learning via Multiple Knowledge Transfer
Liyuan Sun
Jianping Gou
Baosheng Yu
Lan Du
Dacheng Tao
229
13
0
21 Jan 2021
CompRess: Self-Supervised Learning by Compressing Representations
CompRess: Self-Supervised Learning by Compressing RepresentationsNeural Information Processing Systems (NeurIPS), 2020
Soroush Abbasi Koohpayegani
Ajinkya Tejankar
Hamed Pirsiavash
SSL
256
98
0
28 Oct 2020
Less is more: Faster and better music version identification with
  embedding distillation
Less is more: Faster and better music version identification with embedding distillation
Furkan Yesiler
Joan Serrà
E. Gómez
149
13
0
07 Oct 2020
S2SD: Simultaneous Similarity-based Self-Distillation for Deep Metric
  Learning
S2SD: Simultaneous Similarity-based Self-Distillation for Deep Metric LearningInternational Conference on Machine Learning (ICML), 2020
Karsten Roth
Timo Milbich
Bjorn Ommer
Joseph Paul Cohen
Marzyeh Ghassemi
FedML
372
16
0
17 Sep 2020
Diversified Mutual Learning for Deep Metric Learning
Diversified Mutual Learning for Deep Metric Learning
Wonpyo Park
Wonjae Kim
Kihyun You
Minsu Cho
FedML
198
6
0
09 Sep 2020
Teacher-Student Training and Triplet Loss for Facial Expression
  Recognition under Occlusion
Teacher-Student Training and Triplet Loss for Facial Expression Recognition under Occlusion
Mariana-Iuliana Georgescu
Radu Tudor Ionescu
CVBM
292
26
0
03 Aug 2020
Universal Model for Multi-Domain Medical Image Retrieval
Universal Model for Multi-Domain Medical Image Retrieval
Yang Feng
Yubao Liu
Jiebo Luo
102
2
0
14 Jul 2020
Asymmetric metric learning for knowledge transfer
Asymmetric metric learning for knowledge transfer
Mateusz Budnik
Yannis Avrithis
182
41
0
29 Jun 2020
Knowledge Distillation: A Survey
Knowledge Distillation: A Survey
Jianping Gou
B. Yu
Stephen J. Maybank
Dacheng Tao
VLM
2.0K
3,768
0
09 Jun 2020
Heterogeneous Knowledge Distillation using Information Flow Modeling
Heterogeneous Knowledge Distillation using Information Flow ModelingComputer Vision and Pattern Recognition (CVPR), 2020
Nikolaos Passalis
Maria Tzelepi
Anastasios Tefas
199
161
0
02 May 2020
Generative Feature Replay For Class-Incremental Learning
Generative Feature Replay For Class-Incremental Learning
Xialei Liu
Chenshen Wu
Mikel Menta
Luis Herranz
Bogdan Raducanu
Andrew D. Bagdanov
Shangling Jui
Joost van de Weijer
CLL
212
173
0
20 Apr 2020
Towards Efficient Unconstrained Palmprint Recognition via Deep
  Distillation Hashing
Towards Efficient Unconstrained Palmprint Recognition via Deep Distillation Hashing
Huikai Shao
Dexing Zhong
Xuefeng Du
189
10
0
07 Apr 2020
Semantic Drift Compensation for Class-Incremental Learning
Semantic Drift Compensation for Class-Incremental LearningComputer Vision and Pattern Recognition (CVPR), 2020
Lu Yu
Bartlomiej Twardowski
Xialei Liu
Luis Herranz
Kai Wang
Yongmei Cheng
Shangling Jui
Joost van de Weijer
CLL
377
386
0
01 Apr 2020
Creating Something from Nothing: Unsupervised Knowledge Distillation for
  Cross-Modal Hashing
Creating Something from Nothing: Unsupervised Knowledge Distillation for Cross-Modal HashingComputer Vision and Pattern Recognition (CVPR), 2020
Hengtong Hu
Lingxi Xie
Richang Hong
Qi Tian
148
126
0
01 Apr 2020
Collaborative Distillation for Ultra-Resolution Universal Style Transfer
Collaborative Distillation for Ultra-Resolution Universal Style TransferComputer Vision and Pattern Recognition (CVPR), 2020
Huan Wang
Yijun Li
Yuehai Wang
Haoji Hu
Ming-Hsuan Yang
366
112
0
18 Mar 2020
Unifying Specialist Image Embedding into Universal Image Embedding
Unifying Specialist Image Embedding into Universal Image Embedding
Yang Feng
Futang Peng
Xu-Yao Zhang
Wei-wei Zhu
Shanfeng Zhang
Howard Zhou
Zhen Li
Tom Duerig
Shih-Fu Chang
Jiebo Luo
SSL
198
5
0
08 Mar 2020
12
Next
Page 1 of 2