SummaryMixing: A Linear-Complexity Alternative to Self-Attention for
Speech Recognition and Understanding

v1v2v3 (latest)

SummaryMixing: A Linear-Complexity Alternative to Self-Attention for Speech Recognition and Understanding

Interspeech (Interspeech), 2023

12 July 2023

Titouan Parcollet

Rogier van Dalen

Shucong Zhang

S. Bhattacharya

ArXiv (abs)PDF HTML

Papers citing "SummaryMixing: A Linear-Complexity Alternative to Self-Attention for Speech Recognition and Understanding"

6 / 6 papers shown

Title
TF-MLPNet: Tiny Real-Time Neural Speech Separation Malek Itani Tuochao Chen Shyamnath Gollakota 98 1 0 05 Aug 2025
Benchmarking Rotary Position Embeddings for Automatic Speech Recognition Shucong Zhang Titouan Parcollet Rogier van Dalen Sourav Bhattacharya 236 1 0 10 Jan 2025
Lina-Speech: Gated Linear Attention and Initial-State Tuning for Multi-Sample Prompting Text-To-Speech Synthesis Théodor Lemerle Harrison Vanderbyl Vaibhav Srivastav Nicolas Obin 140 4 0 30 Oct 2024
An Analysis of Linear Complexity Attention Substitutes with BEST-RQSpoken Language Technology Workshop (SLT), 2024 Ryan Whetten Titouan Parcollet Adel Moumen Marco Dinarelli Yannick Esteve 217 1 0 04 Sep 2024
Linear-Complexity Self-Supervised Learning for Speech Processing Shucong Zhang Titouan Parcollet Rogier van Dalen Sourav Bhattacharya 247 1 0 18 Jul 2024
Exploring the Capability of Mamba in Speech Applications Koichi Miyazaki Yoshiki Masuyama Masato Murata Mamba 268 28 0 24 Jun 2024