Dataset Distillation: A Comprehensive Review

17 January 2023

Songhua Liu

Papers citing "Dataset Distillation: A Comprehensive Review"

46 / 96 papers shown

Title
Rethinking Backdoor Attacks on Dataset Distillation: A Kernel Method Perspective Ming-Yu Chung Sheng-Yen Chou Chia-Mu Yu Pin-Yu Chen Sy-Yen Kuo Tsung-Yi Ho DD 29 6 0 28 Nov 2023
Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruning Xin Zhang Jiawei Du Yunsong Li Weiying Xie Joey Tianyi Zhou 25 6 0 22 Nov 2023
Fair Wasserstein Coresets Zikai Xiong Niccolò Dalmasso Shubham Sharma Freddy Lecue Daniele Magazzeni Vamsi K. Potluru T. Balch Manuela Veloso 8 2 0 09 Nov 2023
Sequential Subset Matching for Dataset Distillation Jiawei Du Qin Shi Joey Tianyi Zhou DD 23 25 0 02 Nov 2023
Function Space Bayesian Pseudocoreset for Bayesian Neural Networks Balhae Kim Hyungi Lee Juho Lee BDL 11 1 0 27 Oct 2023
Data Optimization in Deep Learning: A Survey Ou Wu Rujing Yao 25 1 0 25 Oct 2023
AST: Effective Dataset Distillation through Alignment with Smooth and High-Quality Expert Trajectories Jiyuan Shen Wenzhuo Yang Kwok-Yan Lam DD 13 1 0 16 Oct 2023
Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching Ziyao Guo Kai Wang George Cazenavette Hui Li Kaipeng Zhang Yang You DD 16 61 0 09 Oct 2023
Can pre-trained models assist in dataset distillation? Yao Lu Xuguang Chen Yuchen Zhang Jianyang Gu Tianle Zhang Yifan Zhang Xiaoniu Yang Qi Xuan Kai Wang Yang You DD 26 7 0 05 Oct 2023
Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI Dustin Wright Christian Igel Gabrielle Samuel Raghavendra Selvan 15 12 0 05 Sep 2023
Towards Clip-Free Quantized Super-Resolution Networks: How to Tame Representative Images Alperen Kalay Bahri Batuhan Bilecen Mustafa Ayazoglu SupR MQ 17 0 0 22 Aug 2023
Platypus: Quick, Cheap, and Powerful Refinement of LLMs Ariel N. Lee Cole J. Hunter Nataniel Ruiz ALM ObjD 13 134 0 14 Aug 2023
Rethinking Data Distillation: Do Not Overlook Calibration Dongyao Zhu Bowen Lei Jie M. Zhang Yanbo Fang Ruqi Zhang Yiqun Xie Dongkuan Xu DD FedML 11 14 0 24 Jul 2023
Towards Trustworthy Dataset Distillation Shijie Ma Fei Zhu Zhen Cheng Xu-Yao Zhang DD 24 9 0 18 Jul 2023
Dataset Distillation Meets Provable Subset Selection M. Tukan Alaa Maalouf Margarita Osadchy DD 11 4 0 16 Jul 2023
Too Large; Data Reduction for Vision-Language Pre-Training Alex Jinpeng Wang Kevin Qinghong Lin David Junhao Zhang Stan Weixian Lei Mike Zheng Shou VLM 15 16 0 31 May 2023
Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization Kaixuan Chen Shunyu Liu Tongtian Zhu Tongya Zheng Haofei Zhang Zunlei Feng Jingwen Ye Mingli Song 26 14 0 31 May 2023
BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level Optimization Chen Fan Gaspard Choné-Ducasse Mark W. Schmidt Christos Thrampoulidis 17 3 0 30 May 2023
Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learning Patrik Okanovic R. Waleffe Vasilis Mageirakos Konstantinos E. Nikolakakis Amin Karbasi Dionysis Kalogerias Nezihe Merve Gürel Theodoros Rekatsinas DD 22 12 0 28 May 2023
Generalizing Dataset Distillation via Deep Generative Prior George Cazenavette Tongzhou Wang Antonio Torralba Alexei A. Efros Jun-Yan Zhu DD 88 44 0 02 May 2023
Deep Graph Reprogramming Yongcheng Jing Chongbin Yuan Li Ju Yiding Yang Xinchao Wang Dacheng Tao 75 35 0 28 Apr 2023
Master: Meta Style Transformer for Controllable Zero-Shot and Few-Shot Artistic Style Transfer Hao Tang Songhua Liu Tianwei Lin Shaoli Huang Fu Li Dongliang He Xinchao Wang 17 5 0 24 Apr 2023
Propheter: Prophetic Teacher Guided Long-Tailed Distribution Learning Wenxiang Xu Lin Chen Linyun Zhou Jie Lei Lechao Cheng Zunlei Feng Min-Gyoo Song 15 1 0 09 Apr 2023
Bayesian Pseudo-Coresets via Contrastive Divergence Piyush Tiwary Kumar Shubham V. Kashyap Prathosh A.P. 14 3 0 20 Mar 2023
Schema Inference for Interpretable Image Classification Haofei Zhang Mengqi Xue Xiaokang Liu Kaixuan Chen Jie Song Mingli Song OCL 26 3 0 12 Mar 2023
DepGraph: Towards Any Structural Pruning Gongfan Fang Xinyin Ma Mingli Song Michael Bi Mi Xinchao Wang GNN 79 245 0 30 Jan 2023
Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networks Qihan Huang Mengqi Xue Wenqi Huang Haofei Zhang Jie Song Yongcheng Jing Mingli Song AAML 16 25 0 12 Dec 2022
Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation Jiawei Du Yiding Jiang Vincent Y. F. Tan Joey Tianyi Zhou Haizhou Li DD 21 104 0 20 Nov 2022
Dataset Distillation via Factorization Songhua Liu Kai Wang Xingyi Yang Jingwen Ye Xinchao Wang DD 124 137 0 30 Oct 2022
Efficient Dataset Distillation Using Random Feature Approximation Noel Loo Ramin Hasani Alexander Amini Daniela Rus DD 64 95 0 21 Oct 2022
Similarity of Neural Architectures using Adversarial Attack Transferability Jaehui Hwang Dongyoon Han Byeongho Heo Song Park Sanghyuk Chun Jong-Seok Lee AAML 17 1 0 20 Oct 2022
Dataset Distillation Using Parameter Pruning Guang Li Ren Togo Takahiro Ogawa Miki Haseyama DD 23 20 0 29 Sep 2022
Graph Condensation via Receptive Field Distribution Matching Mengyang Liu Shanchuan Li Xinshi Chen Le Song DD 69 32 0 28 Jun 2022
Dataset Condensation via Efficient Synthetic-Data Parameterization Jang-Hyun Kim Jinuk Kim Seong Joon Oh Sangdoo Yun Hwanjun Song Joonhyun Jeong Jung-Woo Ha Hyun Oh Song DD 375 155 0 30 May 2022
StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets Axel Sauer Katja Schwarz Andreas Geiger 182 485 0 01 Feb 2022
Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error Ondrej Bohdal Yongxin Yang Timothy M. Hospedales UQCV OOD 20 13 0 17 Jun 2021
Distilling Knowledge via Knowledge Review Pengguang Chen Shu-Lin Liu Hengshuang Zhao Jiaya Jia 147 308 0 19 Apr 2021
Dataset Condensation with Differentiable Siamese Augmentation Bo-Lu Zhao Hakan Bilen DD 186 219 0 16 Feb 2021
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 172 1,018 0 06 Mar 2020
Threats to Federated Learning: A Survey Lingjuan Lyu Han Yu Qiang Yang FedML 186 427 0 04 Mar 2020
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 262 10,183 0 12 Dec 2018
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 96 714 0 13 Jun 2018
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 948 20,214 0 17 Apr 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 237 11,568 0 09 Mar 2017
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 112 370 0 06 Mar 2017
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 279 39,083 0 01 Sep 2014