Use of sonification in the detection of anomalous events

Mark Ballora; Robert J. Cole; Heidi Kruesi; Herbert Greene; Ganesh Monahan; David L. Hall

doi:10.1117/12.918688

Translator Disclaimer

10 May 2012 Use of sonification in the detection of anomalous events

Mark Ballora, Robert J. Cole, Heidi Kruesi, Herbert Greene, Ganesh Monahan, David L. Hall

Author Affiliations +

Proceedings Volume 8407, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012; 84070S (2012) https://doi.org/10.1117/12.918688
Event: SPIE Defense, Security, and Sensing, 2012, Baltimore, Maryland, United States

Abstract

In this paper, we describe the construction of a soundtrack that fuses stock market data with information taken from tweets. This soundtrack, or auditory display, presents the numerical and text data in such a way that anomalous events may be readily detected, even by untrained listeners. The soundtrack generation is flexible, allowing an individual listener to create a unique audio mix from the available information sources. Properly constructed, the display exploits the auditory system's sensitivities to periodicities, to dynamic changes, and to patterns. This type of display could be valuable in environments that demand high levels of situational awareness based on multiple sources of incoming information.

Citation Download Citation

Mark Ballora, Robert J. Cole, Heidi Kruesi, Herbert Greene, Ganesh Monahan, and David L. Hall "Use of sonification in the detection of anomalous events", Proc. SPIE 8407, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012, 84070S (10 May 2012); https://doi.org/10.1117/12.918688

ACCESS THE FULL ARTICLE