ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2506.17019
18
0

Instituto de Telecomunicações at IWSLT 2025: Aligning Small-Scale Speech and Language Models for Speech-to-Text Learning

20 June 2025
Giuseppe Attanasio
Sonal Sannigrahi
Ben Peters
André F. T. Martins
    AuLLM
ArXiv (abs)PDFHTML
Main:4 Pages
2 Figures
Bibliography:3 Pages
4 Tables
Abstract

This paper presents the IT-IST submission to the IWSLT 2025 Shared Task on Instruction Following Speech Processing. We submit results for the Short Track, i.e., speech recognition, translation, and spoken question answering. Our model is a unified speech-to-text model that integrates a pre-trained continuous speech encoder and text decoder through a first phase of modality alignment and a second phase of instruction fine-tuning. Crucially, we focus on using small-scale language model backbones (< 2B) and restrict to high-quality, CC-BY data along with synthetic data generation to supplement existing resources.

View on arXiv
@article{attanasio2025_2506.17019,
  title={ Instituto de Telecomunicações at IWSLT 2025: Aligning Small-Scale Speech and Language Models for Speech-to-Text Learning },
  author={ Giuseppe Attanasio and Sonal Sannigrahi and Ben Peters and André F. T. Martins },
  journal={arXiv preprint arXiv:2506.17019},
  year={ 2025 }
}
Comments on this paper