ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2002.12597
  4. Cited By
An Efficient Method of Training Small Models for Regression Problems
  with Knowledge Distillation

An Efficient Method of Training Small Models for Regression Problems with Knowledge Distillation

Conference on Multimedia Information Processing and Retrieval (MIPR), 2020
28 February 2020
M. Takamoto
Yusuke Morishita
Terumi Umematsu
ArXiv (abs)PDFHTML

Papers citing "An Efficient Method of Training Small Models for Regression Problems with Knowledge Distillation"

14 / 14 papers shown
Fast and accurate neural reflectance transformation imaging through knowledge distillation
Fast and accurate neural reflectance transformation imaging through knowledge distillation
Tinsae G. Dulecha
Leonardo Righetto
Ruggero Pintus
Enrico Gobbetti
Andrea Giachetti
3DH
275
2
0
28 Oct 2025
TimeDistill: Efficient Long-Term Time Series Forecasting with MLP via Cross-Architecture Distillation
TimeDistill: Efficient Long-Term Time Series Forecasting with MLP via Cross-Architecture Distillation
Juntong Ni
Ziqiang Liu
Shiyu Wang
Ming Jin
Wei Jin
AI4TS
276
15
0
20 Feb 2025
Knowledge boosting during low-latency inference
Knowledge boosting during low-latency inference
Vidya Srinivas
Malek Itani
Tuochao Chen
Sefik Emre Eskimez
Takuya Yoshioka
Shyamnath Gollakota
290
3
0
09 Jul 2024
Heterogeneous Transfer Learning for Building High-Dimensional
  Generalized Linear Models with Disparate Datasets
Heterogeneous Transfer Learning for Building High-Dimensional Generalized Linear Models with Disparate Datasets
Ruzhang Zhao
P. Kundu
Arkajyoti Saha
Nilanjan Chatterjee
175
2
0
20 Dec 2023
Teacher-Student Architecture for Knowledge Distillation: A Survey
Teacher-Student Architecture for Knowledge Distillation: A Survey
Chengming Hu
Xuan Li
Danyang Liu
Haolun Wu
Xi Chen
Ju Wang
Xue Liu
306
41
0
08 Aug 2023
Continual Learning in Predictive Autoscaling
Continual Learning in Predictive AutoscalingInternational Conference on Information and Knowledge Management (CIKM), 2023
Hongyan Hao
Zhixuan Chu
Shiyi Zhu
Gangwei Jiang
Yan Wang
Caigao Jiang
James Y. Zhang
Wei Jiang
Siqiao Xue
Junqing Zhou
168
6
0
29 Jul 2023
LightCTS: A Lightweight Framework for Correlated Time Series Forecasting
LightCTS: A Lightweight Framework for Correlated Time Series Forecasting
Zhichen Lai
Dalin Zhang
Huan Li
Christian S. Jensen
Hua Lu
Yan Zhao
AI4TS
209
51
0
23 Feb 2023
Synthetic data generation method for data-free knowledge distillation in
  regression neural networks
Synthetic data generation method for data-free knowledge distillation in regression neural networksExpert systems with applications (ESWA), 2023
Tianxun Zhou
K. Chiam
289
10
0
11 Jan 2023
Teacher-Student Architecture for Knowledge Learning: A Survey
Teacher-Student Architecture for Knowledge Learning: A Survey
Chengming Hu
Xuan Li
Dan Liu
Xi Chen
Ju Wang
Xue Liu
283
43
0
28 Oct 2022
Using Knowledge Distillation to improve interpretable models in a retail
  banking context
Using Knowledge Distillation to improve interpretable models in a retail banking context
Maxime Biehler
Mohamed Guermazi
Célim Starck
245
2
0
30 Sep 2022
Federated Distillation based Indoor Localization for IoT Networks
Federated Distillation based Indoor Localization for IoT NetworksIEEE Sensors Journal (IEEE Sens. J.), 2022
Yaya Etiabi
Marwa Chafii
El-Mehdi Amhoud
FedML
223
20
0
23 May 2022
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metricsfor
  Automatic Text Generation
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metricsfor Automatic Text Generation
Moussa Kamal Eddine
Guokan Shang
A. Tixier
Michalis Vazirgiannis
149
35
0
16 Oct 2021
Knowledge Distillation for Quality Estimation
Knowledge Distillation for Quality Estimation
Amit Gajbhiye
M. Fomicheva
Fernando Alva-Manchego
Frédéric Blain
A. Obamuyide
Nikolaos Aletras
Lucia Specia
244
11
0
01 Jul 2021
Steering a Historical Disease Forecasting Model Under a Pandemic: Case
  of Flu and COVID-19
Steering a Historical Disease Forecasting Model Under a Pandemic: Case of Flu and COVID-19AAAI Conference on Artificial Intelligence (AAAI), 2020
Alexander Rodríguez
Nikhil Muralidhar
B. Adhikari
Anika Tabassum
Naren Ramakrishnan
B. Prakash
LLMSV
137
28
0
23 Sep 2020
1
Page 1 of 1