Adaptive Sparsity Level during Training for Efficient Time Series Forecasting with Transformers

28 May 2023

Papers citing "Adaptive Sparsity Level during Training for Efficient Time Series Forecasting with Transformers"

6 / 6 papers shown

Title
Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structures T. Zhang Yizhuo Zhang Wei Cao Jiang Bian Xiaohan Yi Shun Zheng Jian Li BDL AI4TS 95 145 0 04 Jul 2022
Domain Adaptation for Time Series Forecasting via Attention Sharing Xiaoyong Jin Youngsuk Park Danielle C. Maddix Bernie Wang Xifeng Yan TTA OOD AI4TS 96 74 0 13 Feb 2021
Truly Sparse Neural Networks at Scale Selima Curci D. Mocanu Mykola Pechenizkiy 16 17 0 02 Feb 2021
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 128 679 0 31 Jan 2021
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting Haoyi Zhou Shanghang Zhang J. Peng Shuai Zhang Jianxin Li Hui Xiong Wan Zhang AI4TS 161 3,799 0 14 Dec 2020
The Lottery Ticket Hypothesis for Pre-trained BERT Networks Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Zhangyang Wang Michael Carbin 148 345 0 23 Jul 2020