Neurorecognition visualization in multitask end-to-end speech

Orken Mamyrbayev; Sergii Pavlov; Akbayan Bekarystankyzy; Dina Oralbekova; Bagashar Zhumazhanov; Larysa Azarova; Dinara Mussayeva; Tetiana Koval; Konrad Gromaszek; Nurdaulet Issimov; Kadrzhan Shiyapov

doi:10.1117/12.3022727

20 December 2023 Neurorecognition visualization in multitask end-to-end speech

Orken Mamyrbayev, Sergii Pavlov, Akbayan Bekarystankyzy, Dina Oralbekova, Bagashar Zhumazhanov, Larysa Azarova, Dinara Mussayeva, Tetiana Koval, Konrad Gromaszek, Nurdaulet Issimov, Kadrzhan Shiyapov

Author Affiliations +

Proceedings Volume 12985, Optical Fibers and Their Applications 2023; 129850G (2023) https://doi.org/10.1117/12.3022727
Event: Optical Fibers and Their Applications 2023, 2023, Lublin, Poland

Abstract

Nowadays, speech-processing technologies with different language systems are successfully used in mobile and stationary devices. Kazakh is considered a low-resource language, which poses various challenges for conventional speech recognition methods. This paper presents a proposed model capable of multitasking and handling concurrent speech recognition, dialect identification, and speaker identification, all in an end-to-end framework. The developed multitask model enables training three different tasks within a single model. A multitask recognition system is created based on the WaveNet-CTC model. Experiments show that for the concrete task end-to-end multitask model has better performance than other models.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Orken Mamyrbayev, Sergii Pavlov, Akbayan Bekarystankyzy, Dina Oralbekova, Bagashar Zhumazhanov, Larysa Azarova, Dinara Mussayeva, Tetiana Koval, Konrad Gromaszek, Nurdaulet Issimov, and Kadrzhan Shiyapov "Neurorecognition visualization in multitask end-to-end speech", Proc. SPIE 12985, Optical Fibers and Their Applications 2023, 129850G (20 December 2023); https://doi.org/10.1117/12.3022727

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available