Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales

Home
Papers

All Papers

0 / 0 papers shown

Terms and Conditions

Twitter GitHub LinkedIn Bluesky Youtube

© 2026 ResearchTrend.AI, All rights reserved.

Home
Papers
2110.15946
Cited By

Estimating and Maximizing Mutual Information for Knowledge Distillation

v1v2v3 (latest)

Estimating and Maximizing Mutual Information for Knowledge Distillation

29 October 2021

Vicente Ordonez

ArXiv (abs)PDF HTML

Papers citing "Estimating and Maximizing Mutual Information for Knowledge Distillation"

6 / 6 papers shown

Information-Theoretic Criteria for Knowledge Distillation in Multimodal Learning

Information-Theoretic Criteria for Knowledge Distillation in Multimodal Learning

Guido Sanguinetti

116

0

0

15 Oct 2025

The Hidden Link Between RLHF and Contrastive Learning

The Hidden Link Between RLHF and Contrastive Learning

Kehai Chen

214

2

0

27 Jun 2025

Why does Knowledge Distillation Work? Rethink its Attention and Fidelity
Mechanism

Why does Knowledge Distillation Work? Rethink its Attention and Fidelity Mechanism

222

4

0

30 Apr 2024

Bayes Conditional Distribution Estimation for Knowledge Distillation
Based on Conditional Mutual Information

Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual InformationInternational Conference on Learning Representations (ICLR), 2024

Shayan Mohajer Hamidi

305

23

0

16 Jan 2024

Teacher-Student Architecture for Knowledge Distillation: A Survey

Teacher-Student Architecture for Knowledge Distillation: A Survey

Xue Liu

296

39

0

08 Aug 2023

Contrastive Representation Distillation

Contrastive Representation DistillationInternational Conference on Learning Representations (ICLR), 2019

1.3K

1,207

0

23 Oct 2019