Cochlea-inspired sound visualization method

Seok-Jin Park; Hee-Beom Lee; Gi-Woo Kim

doi:10.1117/12.2657817

18 April 2023 Cochlea-inspired sound visualization method

Seok-Jin Park, Hee-Beom Lee, Gi-Woo Kim

Proceedings Volume 12485, Nano-, Bio-, Info-Tech Sensors, and Wearable Systems 2023; 1248505 (2023) https://doi.org/10.1117/12.2657817
Event: SPIE Smart Structures + Nondestructive Evaluation, 2023, Long Beach, California, United States

Abstract

This study presents the initial study for a new approach to visualize an acoustic sound aimed at mimicking the traveling wave propagation of the basilar membrane within the human cochlea. Typically, a fast Fourier transform (FFT) is required to extract the frequency information from acoustic sound (i.e., voice) for speech recognition. Although this algorithm ensures real-time frequency extraction due to the inherent fast recursive structure, it is necessary to develop a new frequency selectivity technique for advanced speech recognition. We explore the potential of the cochlea-inspired sound visualization to deliver new frequency selectivity by using an image sensor. The experimental prototyping model is fabricated, and we capture images of frequency dependent wave propagation motion using a camera and reproduce 2D images through motion magnification. This approach offers a promising application for speech recognition systems because no FFT is required to extract the frequency information, although there are outstanding technical problems that need to be further examined.

Conference Presentation

Citation Download Citation

Seok-Jin Park, Hee-Beom Lee, and Gi-Woo Kim "Cochlea-inspired sound visualization method", Proc. SPIE 12485, Nano-, Bio-, Info-Tech Sensors, and Wearable Systems 2023, 1248505 (18 April 2023); https://doi.org/10.1117/12.2657817

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available