v1v2 (latest)

BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation

11 March 2021

Papers citing "BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation"

50 / 106 papers shown

Title
EmoSLLM: Parameter-Efficient Adaptation of LLMs for Speech Emotion Recognition Hugo Thimonier Antony Perzo Renaud Seguier 20 0 0 19 Aug 2025
Localizing Audio-Visual Deepfakes via Hierarchical Boundary Modeling Xuanjun Chen Shih-Peng Cheng Jiawei Du Lin Zhang Xiaoxiao Miao Chung-Che Wang Haibin Wu Hung-yi Lee Jyh-Shing Roger Jang 34 1 0 04 Aug 2025
USAD: Universal Speech and Audio Representation via Distillation Heng-Jui Chang Saurabhchand Bhati James R. Glass Alexander H. Liu 87 0 0 23 Jun 2025
SSLAM: Enhancing Self-Supervised Models with Audio Mixtures for Polyphonic Soundscapes Tony Alex S. Ahmed A. Mustafa Muhammad Awais Philip J. B. Jackson 71 3 0 13 Jun 2025
DeepFake Doctor: Diagnosing and Treating Audio-Video Fake Detection Marcel Klemt Carlotta Segna Anna Rohrbach 108 0 0 06 Jun 2025
Learning More with Less: Self-Supervised Approaches for Low-Resource Speech Emotion Recognition Ziwei Gong Pengyuan Shi Kaan Donbekci Lin Ai Run Chen David Sasu Zehui Wu Julia Hirschberg SSL 92 0 0 01 Jun 2025
JiTTER: Jigsaw Temporal Transformer for Event Reconstruction for Self-Supervised Sound Event Detection Hyeonuk Nam Yong-Hwa Park 115 2 0 28 Feb 2025
MCLRL: A Multi-Domain Contrastive Learning with Reinforcement Learning Framework for Few-Shot Modulation Recognition Dongwei Xu Yutao Zhu Yao Lu Youpeng Feng Yun Lin Qi Xuan 145 3 0 26 Feb 2025
Road Traffic Sign Recognition method using Siamese network Combining Efficient-CNN based Encoder Zhenghao Xi Yuchao Shao Yang Zheng Xiang Liu Yaqi Liu Yitong Cai 262 0 0 24 Feb 2025
Phoneme-Level Contrastive Learning for User-Defined Keyword Spotting with Flexible Enrollment Li Kewei Zhou Hengshun Shen Kai Dai Yusheng Du Jun 135 3 0 31 Dec 2024
T-JEPA: Augmentation-Free Self-Supervised Learning for Tabular Data Hugo Thimonier José Lucas De Melo Costa Fabrice Popineau Arpad Rimmel Bich-Liên Doan 170 5 0 07 Oct 2024
BiSSL: Enhancing the Alignment Between Self-Supervised Pretraining and Downstream Fine-Tuning via Bilevel Optimization Gustav Wagner Zakarias Lars Kai Hansen Zheng-Hua Tan 158 1 0 03 Oct 2024
Synthio: Augmenting Small-Scale Audio Classification Datasets with Synthetic Data Sreyan Ghosh Sonal Kumar Zhifeng Kong Rafael Valle Bryan Catanzaro Dinesh Manocha DiffM 167 3 0 02 Oct 2024
Self-supervised Learning for Acoustic Few-Shot Classification Jingyong Liang Bernd Meyer Isaac Ning Lee Thanh-Toan Do SSL 168 1 0 15 Sep 2024
Domain-Invariant Representation Learning of Bird Sounds Ilyass Moummad Romain Serizel Emmanouil Benetos Nicolas Farrugia SSL 186 4 0 13 Sep 2024
What to align in multimodal contrastive learning? Benoit Dufumier J. Castillo-Navarro D. Tuia Jean-Philippe Thiran 208 10 0 11 Sep 2024
SSDM: Scalable Speech Dysfluency Modeling Jiachen Lian Xuanru Zhou Z. Ezzes Jet M J Vonk Brittany Morin D. Baquirin Zachary Mille M. G. Tempini Gopala Anumanchipalli AuLLM 155 11 0 29 Aug 2024
Efficient Unsupervised Visual Representation Learning with Explicit Cluster Balancing Ioannis Maniadis Metaxas Georgios Tzimiropoulos Ioannis Patras SSL 141 1 0 15 Jul 2024
STONE: Self-supervised Tonality Estimator Yuexuan Kong Vincent Lostanlen Gabriel Meseguer-Brocal Stella Wong Mathieu Lagrange Romain Hennequin 159 6 0 10 Jul 2024
ADAPT: Multimodal Learning for Detecting Physiological Changes under Missing Modalities Julie Mordacq Léo Milecki Maria Vakalopoulou Steve Oudot Vicky Kalogeiton OffRL MedIm 97 5 0 04 Jul 2024
Towards Open Respiratory Acoustic Foundation Models: Pretraining and Benchmarking Yuwei Zhang Tong Xia Jing Han Yu Wu Georgios Rizos Yang Liu Mohammed Mosuily Jagmohan Chauhan Cecilia Mascolo AI4CE 92 18 0 23 Jun 2024
Predicting Heart Activity from Speech using Data-driven and Knowledge-based features Gasser Elbanna Z. Mostaani Mathew Magimai.-Doss SSL 106 4 0 10 Jun 2024
Contrastive Learning from Synthetic Audio Doppelgängers Manuel Cherep Nikhil Singh 163 1 0 09 Jun 2024
UrBAN: Urban Beehive Acoustics and PheNotyping Dataset Mahsa Abdollahi Yi Zhu Heitor R. Guimarães Nico Coallier Ségolène Maucourt Pierre Giovenazzo Tiago H. Falk 77 3 0 05 Jun 2024
Hearing Touch: Audio-Visual Pretraining for Contact-Rich Manipulation Jared Mejia Victoria Dean Tess Hellebrekers Abhinav Gupta 127 13 0 14 May 2024
Exploring Pre-trained General-purpose Audio Representations for Heart Murmur Detection Daisuke Niizumi Daiki Takeuchi Yasunori Ohishi Noboru Harada K. Kashino MedIm 85 3 0 26 Apr 2024
AudioRepInceptionNeXt: A lightweight single-stream architecture for efficient audio recognition Kin Wai Lau Yasar Abbas Ur Rehman L. Po 107 1 0 21 Apr 2024
Learning Tracking Representations from Single Point Annotations Qiangqiang Wu Antoni B. Chan 121 1 0 15 Apr 2024
An Experimental Comparison Of Multi-view Self-supervised Methods For Music Tagging Gabriel Meseguer-Brocal Dorian Desblancs Romain Hennequin SSL 100 8 0 14 Apr 2024
Guided Masked Self-Distillation Modeling for Distributed Multimedia Sensor Event Analysis Masahiro Yasuda Noboru Harada Yasunori Ohishi Shoichiro Saito Akira Nakayama Nobutaka Ono 117 4 0 12 Apr 2024
Masked Modeling Duo: Towards a Universal Audio Pre-training Framework Daisuke Niizumi Daiki Takeuchi Yasunori Ohishi Noboru Harada K. Kashino 127 24 0 09 Apr 2024
uaMix-MAE: Efficient Tuning of Pretrained Audio Transformers with Unsupervised Audio Mixtures Afrina Tabassum Dung N. Tran Trung D. Q. Dang Ismini Lourentzou K. Koishida 98 0 0 14 Mar 2024
FunnyNet-W: Multimodal Learning of Funny Moments in Videos in the Wild Zhi-Song Liu Robin Courant Vicky Kalogeiton 159 9 0 08 Jan 2024
EAT: Self-Supervised Pre-Training with Efficient Audio Transformer Wenxi Chen Yuzhe Liang Ziyang Ma Zhisheng Zheng Xie Chen ViT 151 40 0 07 Jan 2024
Self-Supervised Learning for Anomalous Sound Detection Kevin Wilkinghoff 81 21 0 15 Dec 2023
AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset Zhixi Cai Shreya Ghosh Aman Pankaj Adatia Munawar Hayat Abhinav Dhall Kalin Stefanov 97 58 0 26 Nov 2023
MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation Kelin Yu Yunhai Han Matthew Zhu Vaibhav Saxena Danfei Xu Ye Zhao 128 29 0 25 Oct 2023
SyncFusion: Multimodal Onset-synchronized Video-to-Audio Foley Synthesis Marco Comunità R. F. Gramaccioni Emilian Postolache Emanuele Rodolà Danilo Comminiello Joshua D. Reiss DiffM 83 17 0 23 Oct 2023
Efficient Supervised Training of Audio Transformers for Music Representation Learning Pablo Alonso-Jiménez Xavier Serra Dmitry Bogdanov ViT 88 7 0 28 Sep 2023
Exploring Self-Supervised Contrastive Learning of Spatial Sound Event Representation Xilin Jiang Cong Han Yinghao Aaron Li N. Mesgarani SSL 101 2 0 27 Sep 2023
AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models Yuan Tseng Layne Berry Yi-Ting Chen I-Hsiang Chiu Hsuan-Hao Lin ... Yu Tsao Shinji Watanabe Abdel-rahman Mohamed Chi-Luen Feng Hung-yi Lee VLM SSL 171 17 0 19 Sep 2023
Do learned speech symbols follow Zipf's law? Shinnosuke Takamichi Hiroki Maeda Joonyong Park Daisuke Saito Hiroshi Saruwatari 65 2 0 18 Sep 2023
EnCodecMAE: Leveraging neural codecs for universal audio representation learning L. Pepino Pablo Riera Luciana Ferrer 97 5 0 14 Sep 2023
Optimizing Audio Augmentations for Contrastive Learning of Health-Related Acoustic Signals Louis Blankemeier Sebastien Baur Wei-Hung Weng Jake Garrison Yossi Matias Shruthi Prabhakara Diego Ardila Zaid Nabulsi 81 0 0 11 Sep 2023
UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localization Rui Zhang Hongxia Wang Ming-han Du Hanqing Liu Yangqiaoyu Zhou Q. Zeng 119 37 0 28 Aug 2023
Audio Difference Captioning Utilizing Similarity-Discrepancy Disentanglement Daiki Takeuchi Yasunori Ohishi Daisuke Niizumi Noboru Harada K. Kashino 96 8 0 23 Aug 2023
AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining Haohe Liu Yiitan Yuan Xubo Liu Xinhao Mei Qiuqiang Kong Qiao Tian Yuping Wang Wenwu Wang Yuxuan Wang Mark D. Plumbley DiffM 184 292 0 10 Aug 2023
Speaker Embeddings as Individuality Proxy for Voice Stress Detection Zihan Wu Neil Scheidwasser Karl El Hajal Milos Cernak 89 3 0 09 Jun 2023
Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level Tasks Xian Li Nian Shao Xiaofei Li ViT CLIP 143 36 0 07 Jun 2023
Masked Autoencoders with Multi-Window Local-Global Attention Are Better Audio Learners Sarthak Yadav Sergios Theodoridis Lars Kai Hansen Zheng-Hua Tan 126 10 0 01 Jun 2023