Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generation

19 October 2022

Xu Tan

Papers citing "Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generation"

36 / 36 papers shown

Title
A Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectives Shuyu Li Shulei Ji Zihao W. Wang Songruoyao Wu Jiaxing Yu K. Zhang MGen VGen 63 1 0 01 Apr 2025
$Music102: An $D_{12}$-equivariant transformer for chord progression accompaniment$ Music102: An $D_{12}$ -equivariant transformer for chord progression accompaniment Weiliang Luo 20 0 0 23 Oct 2024
Generating Symbolic Music from Natural Language Prompts using an LLM-Enhanced Dataset Weihan Xu Julian McAuley Taylor Berg-Kirkpatrick Shlomo Dubnov Hao-Wen Dong 28 1 0 02 Oct 2024
Evaluation of pretrained language models on music understanding Yannis Vasilakis Rachel M. Bittner Johan Pauwels 20 1 0 17 Sep 2024
MMT-BERT: Chord-aware Symbolic Music Generation Based on Multitrack Music Transformer and MusicBERT Jinlong Zhu Keigo Sakurai Ren Togo Takahiro Ogawa Miki Haseyama GAN 22 1 0 02 Sep 2024
Six Dragons Fly Again: Reviving 15th-Century Korean Court Music with Transformers and Novel Encoding Donwon Park Mark Gotham Dongmin Kim Hannah Park Se Young Chun Dasaem Jeong 26 1 0 02 Aug 2024
Practical and Reproducible Symbolic Music Generation by Large Language Models with Structural Embeddings Seungyeon Rhyu Kichang Yang Sungjun Cho Jaehyeon Kim Kyogu Lee Moontae Lee 30 0 0 29 Jul 2024
BandControlNet: Parallel Transformers-based Steerable Popular Music Generation with Fine-Grained Spatiotemporal Features Jing Luo Xinyu Yang Dorien Herremans 26 3 0 15 Jul 2024
Music Proofreading with RefinPaint: Where and How to Modify Compositions given Context Pedro Ramoneda Martin Rocamora Taketo Akama 28 0 0 12 Jul 2024
MuseBarControl: Enhancing Fine-Grained Control in Symbolic Music Generation through Pre-Training and Counterfactual Loss Yangyang Shu Haiming Xu Ziqin Zhou Anton van den Hengel Lingqiao Liu 15 3 0 05 Jul 2024
MuDiT & MuSiT: Alignment with Colloquial Expression in Description-to-Song Generation Zihao Wang Haoxuan Liu Jiaxing Yu Tao Zhang Yan Liu K. Zhang 55 1 0 03 Jul 2024
Accompanied Singing Voice Synthesis with Fully Text-controlled Melody Ruiqi Li Zhiqing Hong Yongqi Wang Lichao Zhang Rongjie Huang Siqi Zheng Zhou Zhao 31 6 0 02 Jul 2024
A Survey of Deep Learning Audio Generation Methods Matej Bozic Marko Horvat VLM MedIm 41 0 0 31 May 2024
Motifs, Phrases, and Beyond: The Modelling of Structure in Symbolic Music Generation Keshav Bhandari Simon Colton 30 8 0 12 Mar 2024
Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Survey Dinh-Viet-Toan Le Louis Bigo Mikaela Keller Dorien Herremans MedIm 32 9 0 27 Feb 2024
Equipping Pretrained Unconditional Music Transformers with Instrument and Genre Controls Weihan Xu Julian McAuley Shlomo Dubnov Hao-Wen Dong 15 1 0 21 Nov 2023
Sound of Story: Multi-modal Storytelling with Audio Jaeyeon Bae Seokhoon Jeong Seokun Kang Namgi Han Jae-Yon Lee Hyounghun Kim Taehwan Kim 21 2 0 30 Oct 2023
MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models Dingyao Yu Kaitao Song Peiling Lu Tianyu He Xu Tan Wei Ye Shikun Zhang Jiang Bian LLMAG 13 16 0 18 Oct 2023
MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation Xinda Wu Zhijie Huang Kejun Zhang Jiaxing Yu Xu Tan Tieyao Zhang Zihao W. Wang Lingyun Sun 16 5 0 19 Sep 2023
Sparks of Large Audio Models: A Survey and Outlook S. Latif Moazzam Shoukat Fahad Shamshad Muhammad Usama Yi Ren ... Wenwu Wang Xulong Zhang Roberto Togneri Erik Cambria Björn W. Schuller LM&MA AuLLM 29 36 0 24 Aug 2023
Exploring Sampling Techniques for Generating Melodies with a Transformer Language Model Mathias Rose Bjare Stefan Lattner Gerhard Widmer 8 2 0 18 Aug 2023
IteraTTA: An interface for exploring both text prompts and audio priors in generating music with text-to-audio models Hiromu Yakura Masataka Goto 13 2 0 24 Jul 2023
EmoGen: Eliminating Subjective Bias in Emotional Music Generation C. Kang Peiling Lu Botao Yu Xuejiao Tan Wei Ye Shikun Zhang Jiang Bian MGen 38 6 0 03 Jul 2023
MuseCoco: Generating Symbolic Music from Text Peiling Lu Xin Xu C. Kang Botao Yu Chengyi Xing Xuejiao Tan Jiang Bian 12 39 0 31 May 2023
GETMusic: Generating Any Music Tracks with a Unified Representation and Diffusion Framework Ang Lv Xuejiao Tan Peiling Lu Wei Ye Shikun Zhang Jiang Bian Rui Yan DiffM 17 13 0 18 May 2023
LooPy: A Research-Friendly Mix Framework for Music Information Retrieval on Electronic Dance Music Xinyu Li 6 0 0 01 May 2023
Moûsai: Text-to-Music Generation with Long-Context Latent Diffusion Flavio Schneider Ojasv Kamal Zhijing Jin Bernhard Schölkopf MGen 27 83 0 27 Jan 2023
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation Ningxin Zheng Huiqiang Jiang Quan Zhang Zhenhua Han Yuqing Yang ... Fan Yang Chengruidong Zhang Lili Qiu Mao Yang Lidong Zhou 30 26 0 26 Jan 2023
WuYun: Exploring hierarchical skeleton-guided melody generation using knowledge-enhanced deep learning Kejun Zhang Xinda Wu Tieyao Zhang Zhijie Huang Xu Tan Qihao Liang Songruoyao Wu Lingyun Sun 29 10 0 11 Jan 2023
Language Models are Drummers: Drum Composition with Natural Language Pre-Training Li Zhang Chris Callison-Burch 21 5 0 03 Jan 2023
A Review of Intelligent Music Generation Systems Lei Wang Ziyi Zhao Han Liu Junwei Pang Yi-qiang Qin Qidi Wu MGen 12 31 0 16 Nov 2022
A Survey on Artificial Intelligence for Music Generation: Agents, Domains and Perspectives Carlos Hernandez-Olivan Javier Hernandez-Olivan J. R. Beltrán MGen 27 6 0 25 Oct 2022
Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs Wen-Yi Hsiao Jen-Yu Liu Yin-Cheng Yeh Yi-Hsuan Yang 76 180 0 07 Jan 2021
ERNIE-Doc: A Retrospective Long-Document Modeling Transformer Siyu Ding Junyuan Shang Shuohuan Wang Yu Sun Hao Tian Hua-Hong Wu Haifeng Wang 60 52 0 31 Dec 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 249 2,009 0 28 Jul 2020
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 238 578 0 12 Mar 2020