Flowformer: Linearizing Transformers with Conservation Flows

13 February 2022

Papers citing "Flowformer: Linearizing Transformers with Conservation Flows"

49 / 49 papers shown

Title
Learning Advanced Self-Attention for Linear Transformers in the Singular Value Domain Hyowon Wi Jeongwhan Choi Noseong Park 33 0 0 13 May 2025
OLinear: A Linear Model for Time Series Forecasting in Orthogonally Transformed Domain Wenzhen Yue Y. Liu Haoxuan Li Hao Wang Xianghua Ying Ruohao Guo Bowei Xing Ji Shi AI4TS OOD 28 0 0 12 May 2025
SCFormer: Structured Channel-wise Transformer with Cumulative Historical State for Multivariate Time Series Forecasting Shiwei Guo Z. Chen Yupeng Ma Yunfei Han Yi Wang AI4TS 130 0 0 05 May 2025
Pets: General Pattern Assisted Architecture For Time Series Analysis Xiangkai Ma Xiaobin Hong Wenzhong Li Sanglu Lu AI4TS 32 0 0 19 Apr 2025
TVNet: A Novel Time Series Analysis Method Based on Dynamic Convolution and 3D-Variation Chenghan Li Mingchen Li Ruisheng Diao AI4TS 55 0 0 10 Mar 2025
TimesBERT: A BERT-Style Foundation Model for Time Series Understanding Haoran Zhang Yong Liu Yunzhong Qiu Haixuan Liu Zhongyi Pei Jianmin Wang Mingsheng Long AI4TS 42 0 0 28 Feb 2025
TOTEM: TOkenized Time Series EMbeddings for General Time Series Analysis Sabera Talukder Yisong Yue Georgia Gkioxari AI4TS 40 12 0 03 Jan 2025
A Full-History Network Dataset for BTC Asset Decentralization Profiling Ling Cheng Qian Shao Fengzhu Zeng Feida Zhu 59 0 0 19 Nov 2024
Peri-midFormer: Periodic Pyramid Transformer for Time Series Analysis Qiang Wu Gechang Yao Zhixi Feng Shuyuan Yang AI4TS 21 1 0 07 Nov 2024
Predictor-Corrector Enhanced Transformers with Exponential Moving Average Coefficient Learning B. Li Tong Zheng R. Wang Jiahao Liu Qingyan Guo ... Xu Tan Tong Xiao Jingbo Zhu J. Wang Xunliang Cai 45 1 0 05 Nov 2024
TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysis Shiyu Wang Jiawei Li X. Shi Zhou Ye Baichuan Mo Wenze Lin Shengtong Ju Zhixuan Chu Ming Jin AI4TS 38 9 0 21 Oct 2024
UmambaTSF: A U-shaped Multi-Scale Long-Term Time Series Forecasting Method Using Mamba Li Wu Wenbin Pei Jiulong Jiao Qiang Zhang Mamba AI4TS 30 2 0 15 Oct 2024
DiffFluid: Plain Diffusion Models are Effective Predictors of Flow Dynamics Dongyu Luo Jianyu Wu Jing Wang Hairun Xie Xiangyu Yue Shixiang Tang DiffM AI4CE 33 0 0 20 Sep 2024
CorrAdaptor: Adaptive Local Context Learning for Correspondence Pruning Wei Zhu Yicheng Liu Yuping He Tangfei Liao Kang Zheng Xiaoqiu Xu Tao Wang Tong Lu 13 0 0 15 Aug 2024
LETS-C: Leveraging Language Embedding for Time Series Classification Rachneet Kaur Zhen Zeng T. Balch Manuela Veloso AI4TS 33 0 0 09 Jul 2024
A Primal-Dual Framework for Transformers and Neural Networks Tan M. Nguyen Tam Nguyen Nhat Ho Andrea L. Bertozzi Richard G. Baraniuk Stanley J. Osher ViT 21 13 0 19 Jun 2024
Cross-Modal Learning for Anomaly Detection in Fused Magnesium Smelting Process: Methodology and Benchmark Gaochang Wu Yapeng Zhang Lan Deng Jingxin Zhang Tianyou Chai 33 1 0 13 Jun 2024
CorrMAE: Pre-training Correspondence Transformers with Masked Autoencoder Tangfei Liao Xiaoqin Zhang Guobao Xiao Min Li Tao Wang Mang Ye 35 1 0 09 Jun 2024
Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Models Ali Behrouz Michele Santacatterina Ramin Zabih Mamba AI4TS 40 4 0 06 Jun 2024
TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification Md. Atik Ahamed Qiang Cheng Mamba 63 1 0 06 Jun 2024
TimeMIL: Advancing Multivariate Time Series Classification via a Time-aware Multiple Instance Learning Xiwen Chen Peijie Qiu Wenhui Zhu Huayu Li Hao Wang Aristeidis Sotiras Yalin Wang Abolfazl Razi AI4TS 29 7 0 06 May 2024
Scene Adaptive Sparse Transformer for Event-based Object Detection Yansong Peng Hebei Li Yueyi Zhang Xiaoyan Sun Feng Wu ViT 35 11 0 02 Apr 2024
Is Mamba Effective for Time Series Forecasting? Zihan Wang Fanheng Kong Shi Feng Ming Wang Xiaocui Yang Han Zhao Daling Wang Yifei Zhang Mamba AI4TS 27 55 0 17 Mar 2024
TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting Md. Atik Ahamed Qiang Cheng Mamba AI4TS 55 47 0 14 Mar 2024
UNITS: A Unified Multi-Task Time Series Model Shanghua Gao Teddy Koker Owen Queen Thomas Hartvigsen Theodoros Tsiligkaridis Marinka Zitnik AI4TS 38 15 0 29 Feb 2024
Transolver: A Fast Transformer Solver for PDEs on General Geometries Haixu Wu Huakun Luo Haowen Wang Jianmin Wang Mingsheng Long AI4CE 38 40 0 04 Feb 2024
Minusformer: Improving Time Series Forecasting by Progressively Learning Residuals Daojun Liang Haixia Zhang Dongfeng Yuan Bingzheng Zhang Minggao Zhang AI4TS 19 4 0 04 Feb 2024
FreDF: Learning to Forecast in the Frequency Domain Hao Wang Licheng Pan Zhichao Chen Degui Yang Sen Zhang Yifei Yang Xinggao Liu Haoxuan Li Dacheng Tao AI4TS 57 13 0 04 Feb 2024
Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processes Yingyi Chen Qinghua Tao F. Tonin Johan A. K. Suykens 22 1 0 02 Feb 2024
Investigating Recurrent Transformers with Dynamic Halt Jishnu Ray Chowdhury Cornelia Caragea 39 1 0 01 Feb 2024
Computation and Parameter Efficient Multi-Modal Fusion Transformer for Cued Speech Recognition Lei Liu Li Liu Haizhou Li 21 6 0 31 Jan 2024
Artificial Intelligence for Digital and Computational Pathology Andrew H. Song Guillaume Jaume Drew F. K. Williamson Ming Y. Lu Anurag J. Vaidya Tiffany R. Miller Faisal Mahmood AI4CE 30 129 0 13 Dec 2023
OptScaler: A Collaborative Framework for Robust Autoscaling in the Cloud Ding Zou Wei Lu Zhibo Zhu Xingyu Lu Jun-ping Zhou Xiaojin Wang Kangyu Liu Haiqing Wang Kefan Wang Renen Sun 19 0 0 26 Oct 2023
iTransformer: Inverted Transformers Are Effective for Time Series Forecasting Yong Liu Tengge Hu Haoran Zhang Haixu Wu Shiyu Wang Lintao Ma Mingsheng Long AI4TS 24 434 0 10 Oct 2023
Transformers as Support Vector Machines Davoud Ataee Tarzanagh Yingcong Li Christos Thrampoulidis Samet Oymak 45 43 0 31 Aug 2023
Primal-Attention: Self-attention through Asymmetric Kernel SVD in Primal Representation Yingyi Chen Qinghua Tao F. Tonin Johan A. K. Suykens 31 19 0 31 May 2023
Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Prediction Guillaume Jaume Anurag J. Vaidya Richard J. Chen Drew F. K. Williamson Paul Pu Liang Faisal Mahmood 33 41 0 13 Apr 2023
FormerTime: Hierarchical Multi-Scale Representations for Multivariate Time Series Classification Mingyue Cheng Qi Liu Zhiding Liu Zhi Li Yucong Luo Enhong Chen AI4TS 16 31 0 20 Feb 2023
Efficient Attention via Control Variates Lin Zheng Jianbo Yuan Chong-Jun Wang Lingpeng Kong 26 18 0 09 Feb 2023
DBA: Efficient Transformer with Dynamic Bilinear Low-Rank Attention Bosheng Qin Juncheng Li Siliang Tang Yueting Zhuang 17 2 0 24 Nov 2022
MogaNet: Multi-order Gated Aggregation Network Siyuan Li Zedong Wang Zicheng Liu Cheng Tan Haitao Lin Di Wu Zhiyuan Chen Jiangbin Zheng Stan Z. Li 26 56 0 07 Nov 2022
Linear Video Transformer with Feature Fixation Kaiyue Lu Zexia Liu Jianyuan Wang Weixuan Sun Zhen Qin ... Xuyang Shen Huizhong Deng Xiaodong Han Yuchao Dai Yiran Zhong 30 4 0 15 Oct 2022
CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling Jinchao Zhang Shuyang Jiang Jiangtao Feng Lin Zheng Lingpeng Kong 3DV 39 9 0 14 Oct 2022
Designing Robust Transformers using Robust Kernel Density Estimation Xing Han Tongzheng Ren T. Nguyen Khai Nguyen Joydeep Ghosh Nhat Ho 21 6 0 11 Oct 2022
TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis Haixu Wu Teng Hu Yong Liu Hang Zhou Jianmin Wang Mingsheng Long AI4TS AIFin 45 700 0 05 Oct 2022
Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning Cheng Tan Zhangyang Gao Lirong Wu Yongjie Xu Jun-Xiong Xia Siyuan Li Stan Z. Li 31 107 0 24 Jun 2022
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting Haoyi Zhou Shanghang Zhang J. Peng Shuai Zhang Jianxin Li Hui Xiong Wan Zhang AI4TS 169 3,876 0 14 Dec 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 257 2,013 0 28 Jul 2020
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems Sergey Levine Aviral Kumar George Tucker Justin Fu OffRL GP 329 1,951 0 04 May 2020