Finding saliency in noisy images

Chelhwon Kim; Peyman Milanfar

doi:10.1117/12.905760

10 February 2012 Finding saliency in noisy images

Chelhwon Kim, Peyman Milanfar

Proceedings Volume 8296, Computational Imaging X; 82960U (2012) https://doi.org/10.1117/12.905760
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

Recently, many computational saliency models have been introduced^{2, 5, 7, 13, 23} to transform a given image into a scalar-valued map that represents visual saliency of the input image. These approaches, however, generally assume the given image is clean. Fortunately, most methods implicitly suppress the noise before calculating the saliency by blurring and downsampling the input image, and therefore tend to be apparently rather insensitive to noise.¹¹ However, a fundamental and explicit treatment of saliency in noisy images is missing from the literature. Indeed, as we will show, the price for this apparent insensitivity to noise is that the overall performance over a large range of noise strengths is diminished. Accordingly, the question is how to compute saliency in a reliable way when a noise-corrupted image is given. To address this problem, we propose a novel and statistically sound method for estimating saliency based on a non-parametric regression framework. The proposed estimate of the saliency at a pixel is a data-dependent weighted average of dissimilarities between a center patch and its surrounding patches. This aggregation of the dissimilarities is simple and more stable despite the presence of noise. For comparison's sake, we apply a state of the art denoising approach before attempting to calculate the saliency map, which obviously produces much more stable results for noisy images. Despite the advantage of preprocessing, we still found that our method consistently outperforms the other state-of-the-art^{2, 13} methods over a large range of noise strengths.

Citation Download Citation

Chelhwon Kim and Peyman Milanfar "Finding saliency in noisy images", Proc. SPIE 8296, Computational Imaging X, 82960U (10 February 2012); https://doi.org/10.1117/12.905760

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available