No-reference visual quality assessment for image inpainting

V. V. Voronin; Vladimir A. Frantc; V. I. Marchuk; A. I. Sherstobitov; K. Egiazarian

doi:10.1117/12.2076507

16 March 2015 No-reference visual quality assessment for image inpainting

V. V. Voronin, Vladimir A. Frantc, V. I. Marchuk, A. I. Sherstobitov, K. Egiazarian

Proceedings Volume 9399, Image Processing: Algorithms and Systems XIII; 93990U (2015) https://doi.org/10.1117/12.2076507
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

Inpainting has received a lot of attention in recent years and quality assessment is an important task to evaluate different image reconstruction approaches. In many cases inpainting methods introduce a blur in sharp transitions in image and image contours in the recovery of large areas with missing pixels and often fail to recover curvy boundary edges. Quantitative metrics of inpainting results currently do not exist and researchers use human comparisons to evaluate their methodologies and techniques. Most objective quality assessment methods rely on a reference image, which is often not available in inpainting applications. Usually researchers use subjective quality assessment by human observers. It is difficult and time consuming procedure. This paper focuses on a machine learning approach for no-reference visual quality assessment for image inpainting based on the human visual property. Our method is based on observation that Local Binary Patterns well describe local structural information of the image. We use a support vector regression learned on assessed by human images to predict perceived quality of inpainted images. We demonstrate how our predicted quality value correlates with qualitative opinion in a human observer study. Results are shown on a human-scored dataset for different inpainting methods.

Citation Download Citation

V. V. Voronin, Vladimir A. Frantc, V. I. Marchuk, A. I. Sherstobitov, and K. Egiazarian "No-reference visual quality assessment for image inpainting", Proc. SPIE 9399, Image Processing: Algorithms and Systems XIII, 93990U (16 March 2015); https://doi.org/10.1117/12.2076507

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available