SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modeling

2 February 2023

Li Zhang

Papers citing "SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modeling"

50 / 59 papers shown

Title
TSRM: A Lightweight Temporal Feature Encoding Architecture for Time Series Forecasting and Imputation Robert Leppich Michael Stenger Daniel Grillmeyer Vanessa Borst Samuel Kounev AI4TS AI4CE 62 0 0 26 Apr 2025
Bridging Distribution Gaps in Time Series Foundation Model Pretraining with Prototype-Guided Normalization Peiliang Gong Emadeldeen Eldele Min Wu Zhenghua Chen Xiaoli Li Daoqiang Zhang AI4TS AI4CE 44 0 0 15 Apr 2025
CITRAS: Covariate-Informed Transformer for Time Series Forecasting Yosuke Yamaguchi Issei Suemitsu Wenpeng Wei AI4TS 48 0 0 31 Mar 2025
Enhancing Time Series Forecasting via Logic-Inspired Regularization Jianqi Zhang Jingyao Wang Xingchen Shen Wenwen Qiang AI4TS 39 0 0 10 Mar 2025
SeqFusion: Sequential Fusion of Pre-Trained Models for Zero-Shot Time-Series Forecasting Ting Huang Xu-Yang Chen Han-Jia Ye AI4TS 45 1 0 04 Mar 2025
TimesBERT: A BERT-Style Foundation Model for Time Series Understanding Haoran Zhang Yong Liu Yunzhong Qiu Haixuan Liu Zhongyi Pei Jianmin Wang Mingsheng Long AI4TS 40 0 0 28 Feb 2025
Are foundation models useful feature extractors for electroencephalography analysis? Özgün Turgut Felix S. Bott Markus Ploner Daniel Rueckert 38 0 0 28 Feb 2025
ReFocus: Reinforcing Mid-Frequency and Key-Frequency Modeling for Multivariate Time Series Forecasting Guoqi Yu Yaoming Li Juncheng Wang Xiaoyu Guo Angelica I. Aviles-Rivero Tong Yang Shujun Wang AI4TS 44 0 0 24 Feb 2025
TimeDART: A Diffusion Autoregressive Transformer for Self-Supervised Time Series Representation Daoyu Wang Mingyue Cheng Z. Liu Q. Liu Enhong Chen AI4TS DiffM 45 1 0 24 Feb 2025
Mitigating Data Scarcity in Time Series Analysis: A Foundation Model with Series-Symbol Data Generation Wenxuan Wang K. Wu Yujian Betterest Li Dan Wang X. Zhang J. Liu AI4TS 63 0 0 24 Feb 2025
Masking the Gaps: An Imputation-Free Approach to Time Series Modeling with Missing Data Abhilash Neog Arka Daw Sepideh Fatemi Khorasgani Anuj Karpatne AI4TS 33 0 0 18 Feb 2025
Temporal Dynamics Decoupling with Inverse Processing for Enhancing Human Motion Prediction Jiexin Wang Yiju Guo Bing-Huang Su 42 0 0 03 Jan 2025
PreMixer: MLP-Based Pre-training Enhanced MLP-Mixers for Large-scale Traffic Forecasting Tongtong Zhang Zhiyong Cui Bingzhang Wang Yilong Ren Haiyang Yu Pan Deng Yinhai Wang AI4TS 70 0 0 18 Dec 2024
DisenTS: Disentangled Channel Evolving Pattern Modeling for Multivariate Time Series Forecasting Zhiding Liu Jiqian Yang Qingyang Mao Yuze Zhao Mingyue Cheng Zhi Li Qi Liu Enhong Chen AI4TS 22 0 0 30 Oct 2024
Dynamic Contrastive Learning for Time Series Representation Abdul-Kazeem Shamba Kerstin Bach Gavin Taylor AI4TS 29 0 0 20 Oct 2024
Generalizable autoregressive modeling of time series through functional narratives Ran Liu Wenrui Ma Ellen L. Zippi Hadi Pouransari Jingyun Xiao ... Behrooz Mahasseni Juri Minxha Erdrin Azemi Eva L. Dyer Ali Moin AI4TS 30 1 0 10 Oct 2024
Towards Generalisable Time Series Understanding Across Domains Özgün Turgut Philip Muller M. Menten Daniel Rueckert AI4TS 41 1 0 09 Oct 2024
Toward Physics-guided Time Series Embedding Jiaxi Hu Bowen Zhang Qingsong Wen Fugee Tsung Yuxuan Liang AI4TS AI4CE 34 3 0 09 Oct 2024
Masked Autoencoder with Swin Transformer Network for Mitigating Electrode Shift in HD-EMG-based Gesture Recognition Kasra Laamerad Mehran Shabanpour Md. Rabiul Islam Arash Mohammadi 21 0 0 07 Oct 2024
Metadata Matters for Time Series: Informative Forecasting with Transformers Jiaxiang Dong Haixu Wu Yuxuan Wang Li Zhang Jianmin Wang Mingsheng Long AI4TS 24 0 0 04 Oct 2024
Rethinking the Power of Timestamps for Robust Time Series Forecasting: A Global-Local Fusion Perspective Chengsen Wang Qi Qi Jingyu Wang Haifeng Sun Zirui Zhuang Jinming Wu Jianxin Liao AI4TS 26 8 0 27 Sep 2024
EMIT- Event-Based Masked Auto Encoding for Irregular Time Series Hrishikesh Patel Ruihong Qiu Adam Irwin Shazia Sadiq Sen Wang AI4TS 30 1 0 25 Sep 2024
Towards Universal Large-Scale Foundational Model for Natural Gas Demand Forecasting Xinxing Zhou Jiaqi Ye Shubao Zhao Ming Jin Zhaoxiang Hou Chengyi Yang Zengxiang Li Yanlong Wen Xiaojie Yuan AI4TS 31 0 0 24 Sep 2024
Towards Open Respiratory Acoustic Foundation Models: Pretraining and Benchmarking Yuwei Zhang Tong Xia Jing Han Yu Wu Georgios Rizos Yang Liu Mohammed Mosuily Jagmohan Chauhan Cecilia Mascolo AI4CE 36 6 0 23 Jun 2024
Denoising-Aware Contrastive Learning for Noisy Time Series Shuang Zhou Daochen Zha Xiao Shen Xiao Shi Huang Rui Zhang Fu-Lai Chung AI4TS 32 0 0 07 Jun 2024
ROSE: Register Assisted General Time Series Forecasting with Decomposed Frequency Learning Yihang Wang Yuying Qiu Peng Chen Kai Zhao Yang Shu Zhongwen Rao Lujia Pan Bin Yang Chenjuan Guo AI4TS AI4CE 36 10 0 24 May 2024
Towards a General Time Series Anomaly Detector with Adaptive Bottlenecks and Dual Adversarial Decoders Qichao Shentu Beibu Li Kai Zhao Yang Shu Zhongwen Rao Lujia Pan Bin Yang Chenjuan Guo AI4TS 53 5 0 24 May 2024
LaT-PFN: A Joint Embedding Predictive Architecture for In-context Time-series Forecasting Stijn Verdenius Andrea Zerio Roy L.M. Wang BDL AI4TS AI4CE 34 2 0 16 May 2024
One Masked Model is All You Need for Sensor Fault Detection, Isolation and Accommodation Yiwei Fu Weizhong Yan 26 0 0 24 Mar 2024
ComS2T: A complementary spatiotemporal learning system for data-adaptive model evolution Zhen-Qiang Zhou Qihe Huang Binwu Wang Jianpeng Hou Kuo Yang Yuxuan Liang Yang Wang AI4TS 30 2 0 04 Mar 2024
UNITS: A Unified Multi-Task Time Series Model Shanghua Gao Teddy Koker Owen Queen Thomas Hartvigsen Theodoros Tsiligkaridis Marinka Zitnik AI4TS 38 15 0 29 Feb 2024
United We Pretrain, Divided We Fail! Representation Learning for Time Series by Pretraining on 75 Datasets at Once Maurice Kraus Felix Divo David Steinmann D. Dhami Kristian Kersting AI4TS 36 0 0 23 Feb 2024
Revitalizing Multivariate Time Series Forecasting: Learnable Decomposition with Inter-Series Dependencies and Intra-Series Variations Modeling Guoqi Yu Jing Zou Xiaowei Hu Angelica I. Aviles-Rivero Jing Qin Shujun Wang AI4TS 27 13 0 20 Feb 2024
Multi-Patch Prediction: Adapting LLMs for Time Series Representation Learning Yuxuan Bian Xu Ju Jiangtong Li Zhijian Xu Dawei Cheng Qiang Xu AI4TS KELM 30 19 0 07 Feb 2024
MOMENT: A Family of Open Time-series Foundation Models Mononito Goswami Konrad Szafer Arjun Choudhry Yifu Cai Shuo Li Artur Dubrawski AIFin AI4TS 66 109 0 06 Feb 2024
Unified Training of Universal Time Series Forecasting Transformers Gerald Woo Chenghao Liu Akshat Kumar Caiming Xiong Silvio Savarese Doyen Sahoo AI4TS 109 161 0 04 Feb 2024
TimeSiam: A Pre-Training Framework for Siamese Time-Series Modeling Jiaxiang Dong Haixu Wu Yuxuan Wang Yunzhong Qiu Li Zhang Jianmin Wang Mingsheng Long AI4TS 18 13 0 04 Feb 2024
Timer: Generative Pre-trained Transformers Are Large Time Series Models Yong Liu Haoran Zhang Chenyu Li Xiangdong Huang Jianmin Wang Mingsheng Long AIFin AI4TS AI4CE 29 48 0 04 Feb 2024
Rethinking the Starting Point: Collaborative Pre-Training for Federated Downstream Tasks Yun-Wei Chu Dong-Jun Han Seyyedali Hosseinalipour Christopher G. Brinton AI4CE FedML 27 1 0 03 Feb 2024
Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models Weijiao Zhang Jindong Han Zhao Xu Hang Ni Hao Liu Hui Xiong Hui Xiong AI4CE 77 15 0 30 Jan 2024
HiMTM: Hierarchical Multi-Scale Masked Time Series Modeling for Long-Term Forecasting Shubao Zhao Ming Jin Zhaoxiang Hou Che-Sheng Yang Zengxiang Li Qingsong Wen Yi Wang 22 2 0 10 Jan 2024
Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Series Vijay Ekambaram Arindam Jati Pankaj Dayama Sumanta Mukherjee Nam H. Nguyen Wesley M. Gifford Chandra Reddy Jayant Kalagnanam AI4TS VLM 30 16 0 08 Jan 2024
Universal Time-Series Representation Learning: A Survey Patara Trirat Yooju Shin Junhyeok Kang Youngeun Nam Jihye Na Minyoung Bae Joeun Kim Byunghyun Kim Jae-Gil Lee AI4TS 65 14 0 08 Jan 2024
Learning to Embed Time Series Patches Independently Seunghan Lee Taeyoung Park Kibok Lee SSL AI4TS 20 27 0 27 Dec 2023
Soft Contrastive Learning for Time Series Seunghan Lee Taeyoung Park Kibok Lee AI4TS 27 19 0 27 Dec 2023
ImputeFormer: Low Rankness-Induced Transformers for Generalizable Spatiotemporal Imputation Tong Nie Guoyang Qin Wei Ma Yuewen Mei Jiangming Sun AI4TS AI4CE 26 23 0 04 Dec 2023
Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook Ming Jin Qingsong Wen Yuxuan Liang Chaoli Zhang Siqiao Xue ... Shirui Pan Vincent S. Tseng Yu Zheng Lei Chen Hui Xiong AI4TS SyDa 33 117 0 16 Oct 2023
NuTime: Numerically Multi-Scaled Embedding for Large-Scale Time-Series Pretraining Chenguo Lin Xumeng Wen Wei Cao Congrui Huang Jiang Bian Stephen Lin Zhirong Wu AI4TS 36 4 0 11 Oct 2023
iTransformer: Inverted Transformers Are Effective for Time Series Forecasting Yong Liu Tengge Hu Haoran Zhang Haixu Wu Shiyu Wang Lintao Ma Mingsheng Long AI4TS 24 434 0 10 Oct 2023
Frequency-Aware Masked Autoencoders for Multimodal Pretraining on Biosignals Ran Liu Ellen L. Zippi Hadi Pouransari Chris Sandino Jingping Nie Hanlin Goh Erdrin Azemi Ali Moin 31 12 0 12 Sep 2023