Using sound to extract meaning from complex data

Carla Scaletti; Alan B. Craig

doi:10.1117/12.44397

1 June 1991 Using sound to extract meaning from complex data

Carla Scaletti, Alan B. Craig

Proceedings Volume 1459, Extracting Meaning from Complex Data: Processing, Display, Interaction II; (1991) https://doi.org/10.1117/12.44397
Event: Electronic Imaging '91, 1991, San Jose, CA, United States

Abstract

In analyzing abstract data sets, it is useful to represent them in several alternative formats, each format bringing out different aspects of the data. While most work in data mapping has focused on visual representations, it has been found that sonic representations can also be effective aids in interpreting complex data, especially when sonification is used in conjunction with visualization. The authors have developed prototypes for several high-level sonification tools that can be applied to a wide variety of data. While they used programmable multi- processor digital signal processing hardware to develop and experiment with these prototypes, each of these tools could be implemented as special-purpose hardware or software for use by scientists in specific applications. The prototype tools include: Mapper (maps data to various sonic parameters), Comparator (feeds a different mapping into each speaker channel), Sonic Histogram (maps the magnitude of each category onto the amplitude of its associated sound), Shifter (shifts signals into the audible range), Marker (a sonic alarm that marks a specific condition). These tools were tested by using them to generate data-driven sound tracks for video animations generated from the same data. The resulting videos provide an increased data bandwidth and an increased sense of virtual reality to the viewer.

Citation Download Citation

Carla Scaletti and Alan B. Craig "Using sound to extract meaning from complex data", Proc. SPIE 1459, Extracting Meaning from Complex Data: Processing, Display, Interaction II, (1 June 1991); https://doi.org/10.1117/12.44397

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available