Toward a realistic model of speech processing in the brain with
self-supervised learning

Toward a realistic model of speech processing in the brain with self-supervised learning

3 June 2022

Juliette Millet

Charlotte Caucheteux

Alexandre Gramfort

Christophe Pallier

Papers citing "Toward a realistic model of speech processing in the brain with self-supervised learning"

17 / 17 papers shown

Title
Triple Phase Transitions: Understanding the Learning Dynamics of Large Language Models from a Neuroscience Perspective Yuko Nakagi Keigo Tada Sota Yoshino Shinji Nishimoto Yu Takagi LRM 37 0 0 28 Feb 2025
BrainWavLM: Fine-tuning Speech Representations with Brain Responses to Language Nishitha Vattikonda A. Vaidya Richard Antonello Alexander G. Huth 101 0 0 13 Feb 2025
Deep Neural Networks and Brain Alignment: Brain Encoding and Decoding (Survey) S. Oota Zijiao Chen Manish Gupta R. Bapi G. Jobard F. Alexandre X. Hinaut 3DV AI4CE 49 11 0 31 Dec 2024
Improving Semantic Understanding in Speech Language Models via Brain-tuning Omer Moussa Dietrich Klakow Mariya Toneva 44 3 0 11 Oct 2024
Measuring Sound Symbolism in Audio-visual Models Wei-Cheng Tseng Yi-Jen Shih David Harwath Raymond Mooney 32 0 0 18 Sep 2024
Identifying Influential nodes in Brain Networks via Self-Supervised Graph-Transformer Yanqing Kang Di Zhu Haiyang Zhang Enze Shi Sigang Yu ... Xuan Liu Geng Chen Xi Jiang Tuo Zhang Shu Zhang 20 0 0 17 Sep 2024
Mapping Brains with Language Models: A Survey Antonia Karamolegkou Mostafa Abdou Anders Søgaard 16 9 0 08 Jun 2023
Scaling laws for language encoding models in fMRI Richard Antonello Aditya R. Vaidya Alexander G. Huth MedIm 22 55 0 19 May 2023
The Multiscale Surface Vision Transformer Simon Dahan Logan Z. J. Williams Daniel Rueckert E. C. Robinson MedIm ViT 10 2 0 21 Mar 2023
Rejecting Cognitivism: Computational Phenomenology for Deep Learning P. Beckmann G. Köstner Ines Hipólito 27 4 0 16 Feb 2023
Improved Decoding of Attentional Selection in Multi-Talker Environments with Self-Supervised Learned Speech Representation Cong Han Vishal B. Choudhari Yinghao Aaron Li N. Mesgarani 16 3 0 11 Feb 2023
Deep Learning Models to Study Sentence Comprehension in the Human Brain S. Arana Jacques Pesnot Lerousseau P. Hagoort 21 10 0 16 Jan 2023
Handling and extracting key entities from customer conversations using Speech recognition and Named Entity recognition Sharvi Endait Ruturaj Ghatage DD Kadam 10 2 0 28 Nov 2022
Decoding speech perception from non-invasive brain recordings Alexandre Défossez Charlotte Caucheteux Jérémy Rapin Ori Kabeli J. King 32 115 0 25 Aug 2022
Model-based analysis of brain activity reveals the hierarchy of language in 305 subjects Charlotte Caucheteux Alexandre Gramfort J. King 40 32 0 12 Oct 2021
Inductive biases, pretraining and fine-tuning jointly account for brain responses to speech Juliette Millet J. King 45 34 0 25 Feb 2021
Can RNNs learn Recursive Nested Subject-Verb Agreements? Yair Lakretz T. Desbordes J. King Benoît Crabbé Maxime Oquab S. Dehaene 160 19 0 06 Jan 2021