Multi-granularity time domain single-channel music source separation

Zhiying Liu; Yan Guo; Hui Zhang

doi:10.1117/12.3004581

16 August 2023 Multi-granularity time domain single-channel music source separation

Zhiying Liu, Yan Guo, Hui Zhang

Proceedings Volume 12787, Sixth International Conference on Advanced Electronic Materials, Computers, and Software Engineering (AEMCSE 2023); 127870S (2023) https://doi.org/10.1117/12.3004581
Event: 6th International Conference on Advanced Electronic Materials, Computers and Software Engineering (AEMCSE 2023), 2023, Shenyang, China

Abstract

Music source separation isolates or separates the desired accompaniment or singing voice from the song recording. This study solves this problem in the time domain using only one channel. Music contains rich information over multiple temporal scales, such as rhythm, tonality, melody, harmony, chord, etc. These different temporal scales information should be represented by features in different granularity. Inspired by this underlying nature of music, a multi-granularity solution is adopted. Furthermore, music is usually self-similar and can be treated as a fractal structure, meaning multiscale pattern repetition exists in music. We have captured these patterns in a batch of different granularity features using the multi-granularity solution. A self-attention mechanism is adopted to link these regular, predictable, and repeated features. Finally, we combine the multi-granularity and self-attention and adopt the Sandglasset model, which can utilize the information in different temporal scales and the relationship of the repeated pattern among different temporal scales. Experimental results on public datasets show that the proposed method outperforms existing systems in the single-channel music source separation task.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Zhiying Liu, Yan Guo, and Hui Zhang "Multi-granularity time domain single-channel music source separation", Proc. SPIE 12787, Sixth International Conference on Advanced Electronic Materials, Computers, and Software Engineering (AEMCSE 2023), 127870S (16 August 2023); https://doi.org/10.1117/12.3004581

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available