Data Distillation: A Survey

11 January 2023

Papers citing "Data Distillation: A Survey"

24 / 24 papers shown

Title
Transferable text data distillation by trajectory matching Rong Yao Hailin Hu Yifei Fu Hanting Chen Wenyi Fang Fanyi Du Kai Han Yunhe Wang 26 0 0 14 Apr 2025
Graph Condensation: A Survey Xin Gao Junliang Yu Wei Jiang Tong Chen Wentao Zhang Hongzhi Yin DD 83 19 0 28 Jan 2025
Distilling Long-tailed Datasets Zhenghao Zhao Haoxuan Wang Yuzhang Shang Kai Wang Yan Yan DD 46 2 0 24 Aug 2024
Breaking Class Barriers: Efficient Dataset Distillation via Inter-Class Feature Compensator Xin Zhang Jiawei Du Ping Liu Joey Tianyi Zhou DD 42 2 0 13 Aug 2024
A Label is Worth a Thousand Images in Dataset Distillation Tian Qin Zhiwei Deng David Alvarez-Melis DD 84 10 0 15 Jun 2024
CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Models Xuechen Liang Meiling Tao Yinghui Xia Yiting Xie Jun Wang JingSong Yang LLMAG 21 12 0 02 Apr 2024
Towards Adversarially Robust Dataset Distillation by Curvature Regularization Eric Xue Yijiang Li Haoyang Liu Yifan Shen Haohan Wang Haohan Wang DD 59 8 0 15 Mar 2024
Frequency Domain-based Dataset Distillation DongHyeok Shin Seungjae Shin Il-Chul Moon DD 23 18 0 15 Nov 2023
AST: Effective Dataset Distillation through Alignment with Smooth and High-Quality Expert Trajectories Jiyuan Shen Wenzhuo Yang Kwok-Yan Lam DD 23 1 0 16 Oct 2023
Farzi Data: Autoregressive Data Distillation Noveen Sachdeva Zexue He Wang-Cheng Kang Jianmo Ni D. Cheng Julian McAuley DD 17 3 0 15 Oct 2023
Relax and penalize: a new bilevel approach to mixed-binary hyperparameter optimization M. D. Santis Jordan Frécon Francesco Rinaldi Saverio Salzo Martin Schmidt Martin Schmidt 44 0 0 21 Aug 2023
Distilled Pruning: Using Synthetic Data to Win the Lottery Luke McDermott Daniel Cummings SyDa DD 25 1 0 07 Jul 2023
A Comprehensive Survey of Dataset Distillation Shiye Lei Dacheng Tao DD 31 87 0 13 Jan 2023
Dataset Distillation via Factorization Songhua Liu Kai Wang Xingyi Yang Jingwen Ye Xinchao Wang DD 124 137 0 30 Oct 2022
Efficient Dataset Distillation Using Random Feature Approximation Noel Loo Ramin Hasani Alexander Amini Daniela Rus DD 64 95 0 21 Oct 2022
Graph Condensation via Receptive Field Distribution Matching Mengyang Liu Shanchuan Li Xinshi Chen Le Song DD 69 45 0 28 Jun 2022
Dataset Condensation via Efficient Synthetic-Data Parameterization Jang-Hyun Kim Jinuk Kim Seong Joon Oh Sangdoo Yun Hwanjun Song Joonhyun Jeong Jung-Woo Ha Hyun Oh Song DD 378 155 0 30 May 2022
GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Training Krishnateja Killamsetty D. Sivasubramanian Ganesh Ramakrishnan A. De Rishabh K. Iyer OOD 83 184 0 27 Feb 2021
Dataset Condensation with Differentiable Siamese Augmentation Bo-Lu Zhao Hakan Bilen DD 189 288 0 16 Feb 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,424 0 23 Jan 2020
Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Data Sergio Casas Cole Gulino Renjie Liao R. Urtasun AI4CE 160 211 0 18 Oct 2019
A Survey on Bias and Fairness in Machine Learning Ninareh Mehrabi Fred Morstatter N. Saxena Kristina Lerman Aram Galstyan SyDa FaML 294 4,143 0 23 Aug 2019
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 99 714 0 13 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 243 11,568 0 09 Mar 2017