Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2012.13113
Cited By
v1
v2 (latest)
FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training
Neural Information Processing Systems (NeurIPS), 2020
24 December 2020
Y. Fu
Haoran You
Yang Zhao
Yue Wang
Chaojian Li
K. Gopalakrishnan
Zinan Lin
Yingyan Lin
MQ
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training"
20 / 20 papers shown
Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models
ACM Computing Surveys (ACM Comput. Surv.), 2025
Xubin Wang
Zhiqing Tang
Jianxiong Guo
Tianhui Meng
Chenhao Wang
Tian-sheng Wang
Weijia Jia
421
90
0
08 Mar 2025
Cognitive Edge Computing: A Comprehensive Survey on Optimizing Large Models and AI Agents for Pervasive Deployment
International Conference on Artificial Neural Networks (ICANN), 2025
Xubin Wang
Weijia Jia
Weijia Jia
548
21
0
04 Jan 2025
CycleBNN: Cyclic Precision Training in Binary Neural Networks
Federico Fontana
Romeo Lanzino
Anxhelo Diko
G. Foresti
Luigi Cinque
MQ
386
0
0
28 Sep 2024
A General and Efficient Training for Transformer via Token Expansion
Hao Wu
Chunjiang Ge
Jiao Xie
Baochang Zhang
Gaoqi He
Ke Li
Xing Sun
Shaohui Lin
274
9
0
31 Mar 2024
Better Schedules for Low Precision Training of Deep Neural Networks
Cameron R. Wolfe
Anastasios Kyrillidis
216
2
0
04 Mar 2024
Dynamic Stashing Quantization for Efficient Transformer Training
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Guofu Yang
Daniel Lo
Robert D. Mullins
Yiren Zhao
MQ
212
10
0
09 Mar 2023
Accuracy Booster: Enabling 4-bit Fixed-point Arithmetic for DNN Training
Simla Burcu Harma
Canberk Sonmez
Nicholas Sperry
Babak Falsafi
Martin Jaggi
Yunho Oh
MQ
370
5
0
19 Nov 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks
International Conference on Machine Learning (ICML), 2022
Y. Fu
Haichuan Yang
Jiayi Yuan
Meng Li
Cheng Wan
Raghuraman Krishnamoorthi
Vikas Chandra
Yingyan Lin
381
26
0
02 Jun 2022
LDP: Learnable Dynamic Precision for Efficient Deep Neural Network Training and Inference
Zhongzhi Yu
Y. Fu
Shang Wu
Mengquan Li
Haoran You
Yingyan Lin
209
2
0
15 Mar 2022
Auto-scaling Vision Transformers without Training
International Conference on Learning Representations (ICLR), 2022
Wuyang Chen
Wei-Ping Huang
Xianzhi Du
Xiaodan Song
Zinan Lin
Denny Zhou
ViT
165
27
0
24 Feb 2022
F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization
International Conference on Learning Representations (ICLR), 2022
Qing Jin
Jian Ren
Richard Zhuang
Sumant Hanumante
Zhengang Li
Zhiyu Chen
Yanzhi Wang
Kai-Min Yang
Sergey Tulyakov
MQ
391
55
0
10 Feb 2022
Overview frequency principle/spectral bias in deep learning
Communication on Applied Mathematics and Computation (CAMC), 2022
Z. Xu
Yaoyu Zhang
Yaoyu Zhang
FaML
471
131
0
19 Jan 2022
MIA-Former: Efficient and Robust Vision Transformers via Multi-grained Input-Adaptation
AAAI Conference on Artificial Intelligence (AAAI), 2021
Zhongzhi Yu
Y. Fu
Sicheng Li
Chaojian Li
Yingyan Lin
ViT
215
19
0
21 Dec 2021
DAdaQuant: Doubly-adaptive quantization for communication-efficient Federated Learning
International Conference on Machine Learning (ICML), 2021
Robert Hönig
Yiren Zhao
Robert D. Mullins
FedML
395
80
0
31 Oct 2021
Shift-BNN: Highly-Efficient Probabilistic Bayesian Neural Network Training via Memory-Friendly Pattern Retrieving
Qiyu Wan
Haojun Xia
Xingyao Zhang
Lening Wang
Shuaiwen Leon Song
Xin Fu
OOD
201
10
0
07 Oct 2021
2-in-1 Accelerator: Enabling Random Precision Switch for Winning Both Adversarial Robustness and Efficiency
Yonggan Fu
Yang Zhao
Qixuan Yu
Chaojian Li
Yingyan Lin
AAML
410
16
0
11 Sep 2021
InstantNet: Automated Generation and Deployment of Instantaneously Switchable-Precision Networks
Design Automation Conference (DAC), 2021
Yonggan Fu
Zhongzhi Yu
Yongan Zhang
Lezhi Li
Chaojian Li
Yongyuan Liang
Mingchao Jiang
Zinan Lin
Yingyan Lin
306
4
0
22 Apr 2021
"BNN - BN = ?": Training Binary Neural Networks without Batch Normalization
Tianlong Chen
Zhenyu Zhang
Xu Ouyang
Zechun Liu
Zhiqiang Shen
Zinan Lin
MQ
233
41
0
16 Apr 2021
Enabling Design Methodologies and Future Trends for Edge AI: Specialization and Co-design
IEEE design & test (DT), 2021
Cong Hao
Jordan Dotzel
Jinjun Xiong
Luca Benini
Zhiru Zhang
Deming Chen
252
43
0
25 Mar 2021
SmartDeal: Re-Modeling Deep Network Weights for Efficient Inference and Training
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2021
Xiaohan Chen
Yang Zhao
Yue Wang
Pengfei Xu
Haoran You
Chaojian Li
Y. Fu
Yingyan Lin
Zinan Lin
310
1
0
04 Jan 2021
1
Page 1 of 1
