Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2407.20021
Cited By
v1
v2
v3
v4 (latest)
MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity
AAAI Conference on Artificial Intelligence (AAAI), 2024
29 July 2024
Kanghyun Choi
Hyeyoon Lee
Dain Kwon
Sunjong Park
Kyuyeun Kim
Noseong Park
Jinho Lee
Jinho Lee
MQ
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity"
49 / 49 papers shown
D4C: Data-free Quantization for Contrastive Language-Image Pre-training Models
Wenlun Zhang
Yunshan Zhong
Zihao Ding
Xinyu Li
Kentaro Yoshioka
MQ
CLIP
VLM
217
0
0
19 Nov 2025
Patch Rebirth: Toward Fast and Transferable Model Inversion of Vision Transformers
Seongsoo Heo
Dong-Wan Choi
275
0
0
27 Sep 2025
Enhancing Generalization in Data-free Quantization via Mixup-class Prompting
Jiwoong Park
Chaeun Lee
Yongseok Choi
Sein Park
Deokki Hong
Jungwook Choi
MQ
210
1
0
29 Jul 2025
Semantic Alignment and Reinforcement for Data-Free Quantization of Vision Transformers
Mingliang Xu
Yuyao Zhou
Yuxin Zhang
Shen Li
Shen Li
Jiayi Ji
Zhanpeng Zeng
Rongrong Ji
MQ
889
0
0
21 Dec 2024
CLAMP-ViT: Contrastive Data-Free Learning for Adaptive Post-Training Quantization of ViTs
Akshat Ramachandran
Souvik Kundu
Tushar Krishna
MQ
305
20
0
07 Jul 2024
Adaptive Data-Free Quantization
Computer Vision and Pattern Recognition (CVPR), 2023
Biao Qian
Yang Wang
Richang Hong
Meng Wang
MQ
335
53
0
13 Mar 2023
RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformers
IEEE International Conference on Computer Vision (ICCV), 2022
Zhikai Li
Junrui Xiao
Lianwei Yang
Qingyi Gu
MQ
373
151
0
16 Dec 2022
Q-ViT: Accurate and Fully Quantized Low-bit Vision Transformer
Neural Information Processing Systems (NeurIPS), 2022
Yanjing Li
Sheng Xu
Baochang Zhang
Xianbin Cao
Penglei Gao
Guodong Guo
MQ
ViT
234
138
0
13 Oct 2022
PSAQ-ViT V2: Towards Accurate and General Data-Free Quantization for Vision Transformers
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022
Zhikai Li
Mengjuan Chen
Junrui Xiao
Qingyi Gu
ViT
MQ
279
61
0
13 Sep 2022
I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference
IEEE International Conference on Computer Vision (ICCV), 2022
Zhikai Li
Qingyi Gu
MQ
463
164
0
04 Jul 2022
It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher
Computer Vision and Pattern Recognition (CVPR), 2022
Kanghyun Choi
Hye Yoon Lee
Deokki Hong
Joonsang Yu
Noseong Park
Youngsok Kim
Jinho Lee
MQ
366
36
0
31 Mar 2022
Patch Similarity Aware Data-Free Quantization for Vision Transformers
European Conference on Computer Vision (ECCV), 2022
Zhikai Li
Liping Ma
Mengjuan Chen
Junrui Xiao
Qingyi Gu
MQ
ViT
400
75
0
04 Mar 2022
SPViT: Enabling Faster Vision Transformers via Soft Token Pruning
European Conference on Computer Vision (ECCV), 2021
Zhenglun Kong
Zhaoyang Han
Xiaolong Ma
Xin Meng
Mengshu Sun
...
Geng Yuan
Bin Ren
Minghai Qin
Hao Tang
Yanzhi Wang
ViT
339
204
0
27 Dec 2021
A Unified Pruning Framework for Vision Transformers
Hao Yu
Jianxin Wu
ViT
205
71
0
30 Nov 2021
FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer
International Joint Conference on Artificial Intelligence (IJCAI), 2021
Yang Lin
Tianyu Zhang
Peiqin Sun
Zheng Li
Shuchang Zhou
ViT
MQ
544
225
0
27 Nov 2021
PTQ4ViT: Post-training quantization for vision transformers with twin uniform quantization
Zhihang Yuan
Chenhao Xue
Yiqi Chen
Qiang Wu
Guangyu Sun
ViT
MQ
282
210
0
24 Nov 2021
IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Shot Network Quantization
Mingliang Xu
Mingbao Lin
Gongrui Nan
Jianzhuang Liu
Baochang Zhang
Yonghong Tian
Rongrong Ji
MQ
886
92
0
17 Nov 2021
Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples
Neural Information Processing Systems (NeurIPS), 2021
Kanghyun Choi
Deokki Hong
Noseong Park
Youngsok Kim
Jinho Lee
MQ
216
81
0
04 Nov 2021
Post-Training Quantization for Vision Transformer
Neural Information Processing Systems (NeurIPS), 2021
Zhenhua Liu
Yunhe Wang
Kai Han
Siwei Ma
Wen Gao
ViT
MQ
403
460
0
27 Jun 2021
A White Paper on Neural Network Quantization
Markus Nagel
Marios Fournarakis
Rana Ali Amjad
Yelysei Bondarenko
M. V. Baalen
Tijmen Blankevoort
MQ
316
781
0
15 Jun 2021
AutoReCon: Neural Architecture Search-based Reconstruction for Data-free Compression
International Joint Conference on Artificial Intelligence (IJCAI), 2021
Baozhou Zhu
P. Hofstee
J. Peltenburg
Jinho Lee
Zaid Al-Ars
230
25
0
25 May 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
IEEE International Conference on Computer Vision (ICCV), 2021
Ze Liu
Yutong Lin
Yue Cao
Han Hu
Yixuan Wei
Zheng Zhang
Stephen Lin
B. Guo
ViT
5.3K
29,908
0
25 Mar 2021
Training data-efficient image transformers & distillation through attention
International Conference on Machine Learning (ICML), 2020
Hugo Touvron
Matthieu Cord
Matthijs Douze
Francisco Massa
Alexandre Sablayrolles
Edouard Grave
ViT
694
8,581
0
23 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Alexey Dosovitskiy
Lucas Beyer
Alexander Kolesnikov
Dirk Weissenborn
Xiaohua Zhai
...
Matthias Minderer
G. Heigold
Sylvain Gelly
Jakob Uszkoreit
N. Houlsby
ViT
1.5K
58,124
0
22 Oct 2020
Language Models are Few-Shot Learners
Neural Information Processing Systems (NeurIPS), 2020
Tom B. Brown
Benjamin Mann
Nick Ryder
Melanie Subbiah
Jared Kaplan
...
Christopher Berner
Sam McCandlish
Alec Radford
Ilya Sutskever
Dario Amodei
BDL
2.2K
54,992
0
28 May 2020
Up or Down? Adaptive Rounding for Post-Training Quantization
Markus Nagel
Rana Ali Amjad
M. V. Baalen
Christos Louizos
Tijmen Blankevoort
MQ
627
775
0
22 Apr 2020
Generative Low-bitwidth Data Free Quantization
European Conference on Computer Vision (ECCV), 2020
Shoukai Xu
Haokun Li
Bohan Zhuang
Jing Liu
Jingyun Liang
Chuangrun Liang
Zhuliang Yu
MQ
264
151
0
07 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations
International Conference on Machine Learning (ICML), 2020
Ting-Li Chen
Simon Kornblith
Mohammad Norouzi
Geoffrey E. Hinton
SSL
1.3K
23,200
0
13 Feb 2020
ZeroQ: A Novel Zero Shot Quantization Framework
Computer Vision and Pattern Recognition (CVPR), 2020
Yaohui Cai
Z. Yao
Zhen Dong
A. Gholami
Michael W. Mahoney
Kurt Keutzer
MQ
352
469
0
01 Jan 2020
Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion
Computer Vision and Pattern Recognition (CVPR), 2019
Hongxu Yin
Pavlo Molchanov
Zhizhong Li
J. Álvarez
Arun Mallya
Derek Hoiem
N. Jha
Jan Kautz
543
670
0
18 Dec 2019
MMDetection: Open MMLab Detection Toolbox and Benchmark
Kai-xiang Chen
Yuan Liu
Jiangmiao Pang
Yuhang Cao
Yu Xiong
...
Jingdong Wang
Jianping Shi
Wanli Ouyang
Chen Change Loy
Dahua Lin
VOS
590
3,309
0
17 Jun 2019
Data-Free Quantization Through Weight Equalization and Bias Correction
IEEE International Conference on Computer Vision (ICCV), 2019
Markus Nagel
M. V. Baalen
Tijmen Blankevoort
Max Welling
MQ
436
599
0
11 Jun 2019
Learned Step Size Quantization
S. K. Esser
J. McKinstry
Deepika Bablani
R. Appuswamy
D. Modha
MQ
847
996
0
21 Feb 2019
Low-bit Quantization of Neural Networks for Efficient Inference
Yoni Choukroun
Eli Kravchik
Fan Yang
P. Kisilev
MQ
366
436
0
18 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin
Ming-Wei Chang
Kenton Lee
Kristina Toutanova
VLM
SSL
SSeg
3.0K
111,154
0
11 Oct 2018
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
Benoit Jacob
S. Kligys
Bo Chen
Menglong Zhu
Matthew Tang
Andrew G. Howard
Hartwig Adam
Dmitry Kalenichenko
MQ
727
3,946
0
15 Dec 2017
Attention Is All You Need
Neural Information Processing Systems (NeurIPS), 2017
Ashish Vaswani
Noam M. Shazeer
Niki Parmar
Jakob Uszkoreit
Llion Jones
Aidan Gomez
Lukasz Kaiser
Illia Polosukhin
3DV
8.0K
168,453
0
12 Jun 2017
Mask R-CNN
Kaiming He
Georgia Gkioxari
Piotr Dollár
Ross B. Girshick
ObjD
1.1K
31,120
0
20 Mar 2017
Deep Learning with Low Precision by Half-wave Gaussian Quantization
Computer Vision and Pattern Recognition (CVPR), 2017
Zhaowei Cai
Xiaodong He
Jian Sun
Nuno Vasconcelos
MQ
385
530
0
03 Feb 2017
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
International Journal of Computer Vision (IJCV), 2016
Ramprasaath R. Selvaraju
Michael Cogswell
Abhishek Das
Ramakrishna Vedantam
Devi Parikh
Dhruv Batra
FAtt
946
25,130
0
07 Oct 2016
Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations
Itay Hubara
Matthieu Courbariaux
Daniel Soudry
Ran El-Yaniv
Yoshua Bengio
MQ
483
2,041
0
22 Sep 2016
Semantic Understanding of Scenes through the ADE20K Dataset
International Journal of Computer Vision (IJCV), 2016
Bolei Zhou
Hang Zhao
Xavier Puig
Tete Xiao
Sanja Fidler
Adela Barriuso
Antonio Torralba
SSeg
868
2,220
0
18 Aug 2016
DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients
Shuchang Zhou
Yuxin Wu
Zekun Ni
Xinyu Zhou
He Wen
Yuheng Zou
MQ
713
2,220
0
20 Jun 2016
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Mohammad Rastegari
Vicente Ordonez
Joseph Redmon
Ali Farhadi
MQ
751
4,637
0
16 Mar 2016
Resiliency of Deep Neural Networks under Quantization
Wonyong Sung
Sungho Shin
Kyuyeon Hwang
MQ
243
168
0
20 Nov 2015
Fixed Point Quantization of Deep Convolutional Networks
D. Lin
S. Talathi
V. Annapureddy
MQ
406
853
0
19 Nov 2015
BinaryConnect: Training Deep Neural Networks with binary weights during propagations
Matthieu Courbariaux
Yoshua Bengio
J. David
MQ
700
3,163
0
02 Nov 2015
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
Song Han
Huizi Mao
W. Dally
3DGS
1.3K
9,747
0
01 Oct 2015
Microsoft COCO: Common Objects in Context
European Conference on Computer Vision (ECCV), 2014
Nayeon Lee
Michael Maire
Serge J. Belongie
Lubomir Bourdev
Ross B. Girshick
James Hays
Pietro Perona
Deva Ramanan
C. L. Zitnick
Piotr Dollár
ObjD
26.1K
50,866
0
01 May 2014
1
Page 1 of 1
