DataDAM: Efficient Dataset Distillation with Attention Matching

29 September 2023

Konstantinos N. Plataniotis

ArXiv PDF HTML

Papers citing "DataDAM: Efficient Dataset Distillation with Attention Matching"

43 / 43 papers shown

Title
Permutation-Invariant and Orientation-Aware Dataset Distillation for 3D Point Clouds Jae-Young Yim Dongwook Kim Jae-Young Sim DD 3DPC 47 0 0 28 Mar 2025
Robust Dataset Distillation by Matching Adversarial Trajectories Wei Lai Tianyu Ding ren dongdong Lei Wang Jing Huo Yang Gao Wenbin Li AAML DD 57 0 0 15 Mar 2025
Dataset Distillation with Neural Characteristic Function: A Minmax Perspective Shaobo Wang Yicun Yang Z. Liu Chenghao Sun Xuming Hu Conghui He L. Zhang DD 44 2 0 28 Feb 2025
Elucidating the Design Space of Dataset Condensation Shitong Shao Zikai Zhou Huanran Chen Zhiqiang Shen DD 54 7 0 20 Jan 2025
Dataset Distillation via Committee Voting Jiacheng Cui Zhaoyi Li Xiaochen Ma Xinyue Bi Yaxin Luo Zhiqiang Shen DD FedML 49 1 0 13 Jan 2025
Decomposed Distribution Matching in Dataset Condensation Sahar Rahimi Malakshan Mohammad Saeed Ebrahimi Saadabadi Ali Dabouei Nasser M. Nasrabadi DD 69 1 0 06 Dec 2024
Color-Oriented Redundancy Reduction in Dataset Distillation Bowen Yuan Zijian Wang Mahsa Baktashmotlagh Yadan Luo Zi Huang DD 74 2 0 18 Nov 2024
Emphasizing Discriminative Features for Dataset Distillation in Complex Scenarios Kai Wang Zekai Li Zhi-Qi Cheng Samir Khaki A. Sajedi Ramakrishna Vedantam Konstantinos N. Plataniotis Alexander G. Hauptmann Yang You DD 62 4 0 22 Oct 2024
Hybrid Memory Replay: Blending Real and Distilled Data for Class Incremental Learning Jiangtao Kong Jiacheng Shi Ashley Gao Shaohan Hu Tianyi Zhou Huajie Shao VLM DD 30 1 0 20 Oct 2024
MetaDD: Boosting Dataset Distillation with Neural Network Architecture-Invariant Generalization Yunlong Zhao Xiaoheng Deng Xiu Su Hongyan Xu Xiuxing Li Yijing Liu Shan You FedML DD 24 1 0 07 Oct 2024
Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks S. Joshi Jiayi Ni Baharan Mirzasoleiman DD 65 2 0 03 Oct 2024
DRUPI: Dataset Reduction Using Privileged Information Shaobo Wang Yantai Yang Shuaiyu Zhang Chenghao Sun Weiya Li Xuming Hu Linfeng Zhang 27 0 0 02 Oct 2024
Diversity-Driven Synthesis: Enhancing Dataset Distillation through Directed Weight Adjustment Jiawei Du Xin Zhang Juncheng Hu Wenxin Huang Joey Tianyi Zhou DD 31 6 0 26 Sep 2024
Label-Augmented Dataset Distillation Seoungyoon Kang Youngsun Lim Hyunjung Shim DD 30 2 0 24 Sep 2024
Data-Efficient Generation for Dataset Distillation Zhe Li Weitong Zhang Sarah Cechnicka Bernhard Kainz DD 32 0 0 05 Sep 2024
Dataset Distillation from First Principles: Integrating Core Information Extraction and Purposeful Learning Vyacheslav Kungurtsev Yuanfang Peng Jianyang Gu Saeed Vahidian Anthony Quinn Fadwa Idlahcen Yiran Chen FedML DD 33 2 0 02 Sep 2024
Dataset Distillation for Histopathology Image Classification Cong Cong Shiyu Xuan Sidong Liu M. Pagnucco Shiliang Zhang Yang Song DD 28 0 0 19 Aug 2024
Generative Dataset Distillation Based on Diffusion Model Duo Su Junjie Hou Guang Li Ren Togo Rui Song Takahiro Ogawa Miki Haseyama VGen DD 28 4 0 16 Aug 2024
Heavy Labels Out! Dataset Distillation with Label Space Lightening Ruonan Yu Songhua Liu Zigeng Chen Jingwen Ye Xinchao Wang DD 24 1 0 15 Aug 2024
Breaking Class Barriers: Efficient Dataset Distillation via Inter-Class Feature Compensator Xin Zhang Jiawei Du Ping Liu Joey Tianyi Zhou DD 42 2 0 13 Aug 2024
Prioritize Alignment in Dataset Distillation Zekai Li Ziyao Guo Wangbo Zhao Tianle Zhang Zhi-Qi Cheng ... Kaipeng Zhang A. Sajedi Konstantinos N Plataniotis Kai Wang Yang You DD 40 2 0 06 Aug 2024
FYI: Flip Your Images for Dataset Distillation Byunggwan Son Youngmin Oh Donghyeon Baek Bumsub Ham DD 32 3 0 11 Jul 2024
Dataset Condensation with Latent Quantile Matching Wei Wei Tom De Schepper Kevin Mets DD 21 2 0 14 Jun 2024
Hierarchical Features Matter: A Deep Exploration of Progressive Parameterization Method for Dataset Distillation Xinhao Zhong Hao Fang Bin Chen Xulin Gu Tao Dai Meikang Qiu Shu-Tao Xia DD 33 0 0 09 Jun 2024
Mitigating Bias in Dataset Distillation Justin Cui Ruochen Wang Yuanhao Xiong Cho-Jui Hsieh DD 29 1 0 06 Jun 2024
CondTSF: One-line Plugin of Dataset Condensation for Time Series Forecasting Jianrong Ding Zhanyu Liu Guanjie Zheng Haiming Jin Linghe Kong AI4TS DD 32 3 0 04 Jun 2024
DANCE: Dual-View Distribution Alignment for Dataset Condensation Hansong Zhang Shikun Li Fanzhao Lin Weiping Wang Zhenxing Qian Shiming Ge DD 29 4 0 03 Jun 2024
ATOM: Attention Mixer for Efficient Dataset Distillation Samir Khaki A. Sajedi Kai Wang Lucy Z. Liu Y. Lawryshyn Konstantinos N. Plataniotis 28 3 0 02 May 2024
Generative Dataset Distillation: Balancing Global Structure and Local Details Longzhen Li Guang Li Ren Togo Keisuke Maeda Takahiro Ogawa Miki Haseyama DD 42 5 0 26 Apr 2024
Exploiting Inter-sample and Inter-feature Relations in Dataset Distillation Wenxiao Deng Wenbin Li Tianyu Ding Lei Wang Hongguang Zhang Kuihua Huang Jing Huo Yang Gao DD 45 14 0 31 Mar 2024
The Need for Speed: Pruning Transformers with One Recipe Samir Khaki Konstantinos N. Plataniotis 24 9 0 26 Mar 2024
Exploring the Impact of Dataset Bias on Dataset Distillation Yao Lu Jianyang Gu Xuguang Chen Saeed Vahidian Qi Xuan DD 30 3 0 24 Mar 2024
Graph Data Condensation via Self-expressive Graph Structure Reconstruction Zhanyu Liu Chaolv Zeng Guanjie Zheng DD 52 10 0 12 Mar 2024
Dataset Condensation for Time Series Classification via Dual Domain Matching Zhanyu Liu Ke Hao Guanjie Zheng Yanwei Yu DD 55 5 0 12 Mar 2024
Distributional Dataset Distillation with Subtask Decomposition Tian Qin Zhiwei Deng David Alvarez-Melis DD 85 4 0 01 Mar 2024
Group Distributionally Robust Dataset Distillation with Risk Minimization Saeed Vahidian Mingyu Wang Jianyang Gu Vyacheslav Kungurtsev Wei Jiang Yiran Chen OOD DD 31 6 0 07 Feb 2024
ProbMCL: Simple Probabilistic Contrastive Learning for Multi-label Visual Classification A. Sajedi Samir Khaki Y. Lawryshyn Konstantinos N. Plataniotis VLM 21 2 0 02 Jan 2024
Dataset Distillation via the Wasserstein Metric Haoyang Liu Yijiang Li Tiancheng Xing Vibhu Dalal Luwei Li Jingrui He Haohan Wang DD 41 11 0 30 Nov 2023
Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching Shitong Shao Zeyuan Yin Muxin Zhou Xindong Zhang Zhiqiang Shen DD 18 20 0 29 Nov 2023
Efficient Dataset Distillation via Minimax Diffusion Jianyang Gu Saeed Vahidian Vyacheslav Kungurtsev Haonan Wang Wei Jiang Yang You Yiran Chen DD 35 26 0 27 Nov 2023
InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning Ziheng Qin K. Wang Zangwei Zheng Jianyang Gu Xiang Peng ... Daquan Zhou Lei Shang Baigui Sun Xuansong Xie Yang You 108 44 0 08 Mar 2023
CONetV2: Efficient Auto-Channel Size Optimization for CNNs Yi Ru Wang Samir Khaki Weihang Zheng Mahdi S. Hosseini Konstantinos N. Plataniotis 26 6 0 13 Oct 2021
Dataset Condensation with Differentiable Siamese Augmentation Bo-Lu Zhao Hakan Bilen DD 189 288 0 16 Feb 2021