Music melody generation and LIF supervised training based on spiking neural network

Yang Gao

doi:10.1117/12.2659783

22 November 2022 Music melody generation and LIF supervised training based on spiking neural network

Yang Gao

Proceedings Volume 12475, Second International Conference on Advanced Algorithms and Signal Image Processing (AASIP 2022); 124750R (2022) https://doi.org/10.1117/12.2659783
Event: Second International Conference on Advanced Algorithms and Signal Image Processing (AASIP 2022), 2022, Hulun Buir, China

Abstract

With the help of neuroscience research, the neural network model based on the pulse generation time can be accurately established, which is called Spiking Neural Network (SNN). This new type of neural network uses spike coding, which allows for more information and greater computing power to be obtained by obtaining the precise timing of the spikes. The application of SNN in music melody generation has a good application prospect. In this study, the Cell of Long Short-Term Memory (LSTM) in the generative model was replaced by Leaky Integrate-and-Fire (LIF), and two different variants of LIF were proposed based on Cell. Although the LIF variant achieved better results than the original LIF, it was not better than Cell in comprehensive comparison, and replacing Cell with LIF in the generative model could not improve the quality of the generated melody. The simple strategy used in the experiments to solve the supervised training problem of LIF was the main reason for such results. For SNN to be widely used, it is urgent to solve its supervised training problem.

Citation Download Citation

Yang Gao "Music melody generation and LIF supervised training based on spiking neural network", Proc. SPIE 12475, Second International Conference on Advanced Algorithms and Signal Image Processing (AASIP 2022), 124750R (22 November 2022); https://doi.org/10.1117/12.2659783

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available