State Space Models as Foundation Models: A Control Theoretic Overview

25 March 2024

Papers citing "State Space Models as Foundation Models: A Control Theoretic Overview"

6 / 6 papers shown

Title
Observability conditions for neural state-space models with eigenvalues and their roots of unity Andrew Gracyk 27 0 0 22 Apr 2025
A Unified Framework for Neural Computation and Learning Over Time S. Melacci Alessandro Betti Michele Casoni Tommaso Guidi Matteo Tiezzi Marco Gori AI4TS 13 0 0 18 Sep 2024
Understanding the differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks Jerome Sieber Carmen Amo Alonso A. Didier M. Zeilinger Antonio Orvieto AAML 31 7 0 24 May 2024
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models Soham De Samuel L. Smith Anushan Fernando Aleksandar Botev George-Christian Muraru ... David Budden Yee Whye Teh Razvan Pascanu Nando de Freitas Çağlar Gülçehre Mamba 51 116 0 29 Feb 2024
Resurrecting Recurrent Neural Networks for Long Sequences Antonio Orvieto Samuel L. Smith Albert Gu Anushan Fernando Çağlar Gülçehre Razvan Pascanu Soham De 83 258 0 11 Mar 2023
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 246 1,982 0 28 Jul 2020