Sound meets image: freedom of expression in texture description

Reinier J. Jansen; René van Egmond; Huib de Ridder

doi:10.1117/12.914698

28 February 2012 Sound meets image: freedom of expression in texture description

Reinier J. Jansen, René van Egmond, Huib de Ridder

Proceedings Volume 8291, Human Vision and Electronic Imaging XVII; 829119 (2012) https://doi.org/10.1117/12.914698
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

The use of sound was explored as means for expressing perceptual attributes of visual textures. Two sets of 17 visual textures were prepared: one set taken from the CUReT database, and one set synthesized to replicate the former set. Participants were instructed to match a sound texture with a visual texture displayed onscreen. A modified version of a Product Sound Sketching Tool was provided, in which an interactive physical interface was coupled to a frequency modulation synthesizer. Rather than selecting from a pre-defined set of sound samples, continuous exploration of the auditory space allowed for an increased freedom of expression. While doing so, participants were asked to describe what auditory and visual qualities they were paying attention to. It was found that participants were able to create sounds that matched visual textures. Based on differences in diversity of descriptions, synthetic textures were found to have less salient perceptual attributes than their original counterparts. Finally, three interesting sound synthesis clusters were found, corresponding with mutually exclusive description vocabularies.

Citation Download Citation

Reinier J. Jansen, René van Egmond, and Huib de Ridder "Sound meets image: freedom of expression in texture description", Proc. SPIE 8291, Human Vision and Electronic Imaging XVII, 829119 (28 February 2012); https://doi.org/10.1117/12.914698

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available