Continual Transformers: Redundancy-Free Attention for Online Inference

Continual Transformers: Redundancy-Free Attention for Online Inference

17 January 2022

Lukas Hedegaard

Arian Bakhtiarnia

Alexandros Iosifidis

Papers citing "Continual Transformers: Redundancy-Free Attention for Online Inference"

12 / 12 papers shown

Title
Learning Streaming Video Representation via Multitask Training Yibin Yan Jilan Xu Shangzhe Di Yikun Liu Yudi Shi Qirui Chen Zeqian Li Yifei Huang Weidi Xie CLL 76 0 0 28 Apr 2025
Online hand gesture recognition using Continual Graph Transformers Rim Slama Wael Rabah Hazem Wannous SLR 51 0 0 20 Feb 2025
Efficient Online Processing with Deep Neural Networks Lukas Hedegaard 16 0 0 23 Jun 2023
Structured Pruning Adapters Lukas Hedegaard Aman Alok Juby Jose Alexandros Iosifidis 25 10 0 17 Nov 2022
Effective Audio Classification Network Based on Paired Inverse Pyramid Structure and Dense MLP Block Yunhao Chen Yunjie Zhu Zihui Yan Yifan Huang Zhen Ren Jianlu Shen Lifang Chen 20 7 0 05 Nov 2022
Efficient High-Resolution Deep Learning: A Survey Arian Bakhtiarnia Qi Zhang Alexandros Iosifidis MedIm 11 8 0 26 Jul 2022
Continual Inference: A Library for Efficient Online Inference with Deep Neural Networks in PyTorch Lukas Hedegaard Alexandros Iosifidis BDL 3DV CLL 11 6 0 07 Apr 2022
Continual Spatio-Temporal Graph Convolutional Networks Lukas Hedegaard Negar Heidari Alexandros Iosifidis 3DH GNN 8 22 0 21 Mar 2022
Self-attention fusion for audiovisual emotion recognition with incomplete data K. Chumachenko Alexandros Iosifidis M. Gabbouj 68 37 0 26 Jan 2022
Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformer Yining Ma Jingwen Li Zhiguang Cao Wen Song Le Zhang Zhenghua Chen Jing Tang 72 128 0 06 Oct 2021
SHAPE: Shifted Absolute Position Embedding for Transformers Shun Kiyono Sosuke Kobayashi Jun Suzuki Kentaro Inui 221 44 0 13 Sep 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 239 2,554 0 04 May 2021