Soft-Label Dataset Distillation and Text Dataset Distillation

6 October 2019

Papers citing "Soft-Label Dataset Distillation and Text Dataset Distillation"

50 / 94 papers shown

Title
Transferable text data distillation by trajectory matching Rong Yao Hailin Hu Yifei Fu Hanting Chen Wenyi Fang Fanyi Du Kai Han Yunhe Wang 28 0 0 14 Apr 2025
Distilling Dataset into Neural Field DongHyeok Shin Heesun Bae Gyuwon Sim Wanmo Kang Il-Chul Moon DD 69 1 0 05 Mar 2025
Synthetic Text Generation for Training Large Language Models via Gradient Matching Dang Nguyen Zeman Li M. Bateni Vahab Mirrokni Meisam Razaviyayn Baharan Mirzasoleiman 42 0 0 24 Feb 2025
On Learning Representations for Tabular Data Distillation Inwon Kang Parikshit Ram Yi Zhou Horst Samulowitz Oshani Seneviratne DD 69 0 0 23 Jan 2025
Towards Mitigating Architecture Overfitting on Distilled Datasets Xuyang Zhong Chen Liu DD 55 2 0 08 Jan 2025
FairDD: Fair Dataset Distillation via Synchronized Matching Qihang Zhou Shenhao Fang Shibo He Wenchao Meng Jiming Chen FedML DD 79 1 0 29 Nov 2024
Quantifying Knowledge Distillation Using Partial Information Decomposition Pasan Dissanayake Faisal Hamman Barproda Halder Ilia Sucholutsky Qiuyi Zhang Sanghamitra Dutta 36 0 0 12 Nov 2024
Privacy-Preserving Federated Learning via Dataset Distillation ShiMao Xu Xiaopeng Ke Xing Su Shucheng Li Hao Wu Sheng Zhong Fengyuan Xu FedML 34 0 0 25 Oct 2024
Emphasizing Discriminative Features for Dataset Distillation in Complex Scenarios Kai Wang Zekai Li Zhi-Qi Cheng Samir Khaki A. Sajedi Ramakrishna Vedantam Konstantinos N. Plataniotis Alexander G. Hauptmann Yang You DD 70 4 0 22 Oct 2024
What's New in My Data? Novelty Exploration via Contrastive Generation Masaru Isonuma Ivan Titov 28 0 0 18 Oct 2024
DistDD: Distributed Data Distillation Aggregation through Gradient Matching Peiran Wang Haohan Wang FedML DD 31 1 0 11 Oct 2024
Teddy: Efficient Large-Scale Dataset Distillation via Taylor-Approximated Matching Ruonan Yu Songhua Liu Jingwen Ye Xinchao Wang DD 37 4 0 10 Oct 2024
Dataset Distillation-based Hybrid Federated Learning on Non-IID Data Xiufang Shi Wei Zhang Mincheng Wu Guangyi Liu Z. Wen Shibo He Tejal Shah R. Ranjan DD FedML 34 1 0 26 Sep 2024
Applications of Knowledge Distillation in Remote Sensing: A Survey Yassine Himeur N. Aburaed O. Elharrouss Iraklis Varlamis Shadi Atalla W. Mansoor Hussain Al Ahmad 45 4 0 18 Sep 2024
UDD: Dataset Distillation via Mining Underutilized Regions Shiguang Wang Zhongyu Zhang Jian Cheng DD 36 0 0 29 Aug 2024
Heavy Labels Out! Dataset Distillation with Label Space Lightening Ruonan Yu Songhua Liu Zigeng Chen Jingwen Ye Xinchao Wang DD 42 1 0 15 Aug 2024
One-Shot Collaborative Data Distillation William Holland Chandra Thapa Sarah Ali Siddiqui Wei Shao S. Çamtepe DD FedML 32 0 0 05 Aug 2024
Dataset Distillation by Automatic Training Trajectories Dai Liu Jindong Gu Hu Cao Carsten Trinitis Martin Schulz DD 41 10 0 19 Jul 2024
TinyGraph: Joint Feature and Node Condensation for Graph Neural Networks Yezi Liu Yanning Shen DD 37 5 0 10 Jul 2024
Speech Emotion Recognition under Resource Constraints with Data Distillation Yi Chang Zhao Ren Zhonghao Zhao Thanh Tam Nguyen Kun Qian Tanja Schultz Björn W. Schuller 31 0 0 21 Jun 2024
A Label is Worth a Thousand Images in Dataset Distillation Tian Qin Zhiwei Deng David Alvarez-Melis DD 94 10 0 15 Jun 2024
GIFT: Unlocking Full Potential of Labels in Distilled Dataset at Near-zero Cost Xinyi Shang Peng Sun Tao Lin 50 2 0 23 May 2024
Generative Dataset Distillation: Balancing Global Structure and Local Details Longzhen Li Guang Li Ren Togo Keisuke Maeda Takahiro Ogawa Miki Haseyama DD 42 5 0 26 Apr 2024
Brain-Inspired Continual Learning-Robust Feature Distillation and Re-Consolidation for Class Incremental Learning Hikmat Khan N. Bouaynaya Ghulam Rasool CLL 38 1 0 22 Apr 2024
Distilled Datamodel with Reverse Gradient Matching Jingwen Ye Ruonan Yu Songhua Liu Xinchao Wang DD 41 3 0 22 Apr 2024
DiLM: Distilling Dataset into Language Model for Text-level Dataset Distillation Aru Maekawa Satoshi Kosugi Kotaro Funakoshi Manabu Okumura DD 43 10 0 30 Mar 2024
Exploring the potential of prototype-based soft-labels data distillation for imbalanced data classification Radu Rosu Mihaela Breaban H. Luchian DD 22 0 0 25 Mar 2024
DD-RobustBench: An Adversarial Robustness Benchmark for Dataset Distillation Yifan Wu Jiawei Du Ping Liu Yuewei Lin Wenqing Cheng Wei-ping Xu DD AAML 40 5 0 20 Mar 2024
Distilling Datasets Into Less Than One Image Asaf Shul Eliahu Horwitz Yedid Hoshen DD 37 2 0 18 Mar 2024
Automated data processing and feature engineering for deep learning and big data applications: a survey A. Mumuni F. Mumuni TPM 43 48 0 18 Mar 2024
Towards Adversarially Robust Dataset Distillation by Curvature Regularization Eric Xue Yijiang Li Haoyang Liu Yifan Shen Haohan Wang Haohan Wang DD 61 8 0 15 Mar 2024
Two Trades is not Baffled: Condensing Graph via Crafting Rational Gradient Matching Tianle Zhang Yuchen Zhang Kun Wang Kai Wang Beining Yang Kaipeng Zhang Wenqi Shao Ping Liu Qiufeng Wang Yang You DD 71 13 0 07 Feb 2024
Importance-Aware Adaptive Dataset Distillation Guang Li Ren Togo Takahiro Ogawa Miki Haseyama DD 28 6 0 29 Jan 2024
MIM4DD: Mutual Information Maximization for Dataset Distillation Yuzhang Shang Zhihang Yuan Yan Yan DD 37 13 0 27 Dec 2023
Graph Coarsening via Convolution Matching for Scalable Graph Neural Network Training Charles Dickens E-Wen Huang Aishwarya N. Reganti Jiong Zhu Karthik Subbian Danai Koutra 27 6 0 24 Dec 2023
Towards Model-Based Data Acquisition for Subjective Multi-Task NLP Problems Kamil Kanclerz Julita Bielaniewicz Marcin Gruza Jan Kocoñ Stanislaw Wo'zniak Przemyslaw Kazienko 29 3 0 13 Dec 2023
Boosting the Cross-Architecture Generalization of Dataset Distillation through an Empirical Study Lirui Zhao Yuxin Zhang Rongrong Ji Rongrong Ji 32 1 0 09 Dec 2023
Unlocking the Potential of Federated Learning: The Symphony of Dataset Distillation via Deep Generative Latents Yuqi Jia Saeed Vahidian Jingwei Sun Jianyi Zhang Vyacheslav Kungurtsev Neil Zhenqiang Gong Yiran Chen FedML DD 25 6 0 03 Dec 2023
Topology-Preserving Adversarial Training Xiaoyue Mi Fan Tang Yepeng Weng Danding Wang Juan Cao Sheng Tang Peng Li Yang Liu 54 1 0 29 Nov 2023
Embarassingly Simple Dataset Distillation Yunzhen Feng Ramakrishna Vedantam Julia Kempe DD 36 5 0 13 Nov 2023
Label Poisoning is All You Need Rishi Jha J. Hayase Sewoong Oh AAML 22 28 0 29 Oct 2023
Getting aligned on representational alignment Ilia Sucholutsky Lukas Muttenthaler Adrian Weller Andi Peng Andreea Bobu ... Thomas Unterthiner Andrew Kyle Lampinen Klaus-Robert Muller M. Toneva Thomas L. Griffiths 64 74 0 18 Oct 2023
AST: Effective Dataset Distillation through Alignment with Smooth and High-Quality Expert Trajectories Jiyuan Shen Wenzhuo Yang Kwok-Yan Lam DD 29 1 0 16 Oct 2023
Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching Ziyao Guo Kai Wang George Cazenavette Hui Li Kaipeng Zhang Yang You DD 32 62 0 09 Oct 2023
Dataset Condensation via Generative Model David Junhao Zhang Heng Wang Chuhui Xue Rui Yan Wenqing Zhang Song Bai Mike Zheng Shou DD 26 11 0 14 Sep 2023
Vision-Language Dataset Distillation Xindi Wu Byron Zhang Zhiwei Deng Olga Russakovsky DD VLM 33 8 0 15 Aug 2023
Exploring Multilingual Text Data Distillation Shivam Sahni Harsh Patel DD 19 2 0 09 Aug 2023
Label Inference Attacks against Node-level Vertical Federated GNNs Marco Arazzi Mauro Conti Stefanos Koffas Marina Krček Antonino Nocera S. Picek Jing Xu FedML AAML 18 1 0 04 Aug 2023
Rethinking Data Distillation: Do Not Overlook Calibration Dongyao Zhu Bowen Lei Jie M. Zhang Yanbo Fang Ruqi Zhang Yiqun Xie Dongkuan Xu DD FedML 23 15 0 24 Jul 2023
Improved Distribution Matching for Dataset Condensation Ganlong Zhao Guanbin Li Yipeng Qin Yizhou Yu DD 28 80 0 19 Jul 2023