No-reference image quality assessment based on deep convolutional neural networks

Ravi Ravela; Mukul Shirvaikar; Christos Grecos

doi:10.1117/12.2518438

14 May 2019 No-reference image quality assessment based on deep convolutional neural networks

Ravi Ravela, Mukul Shirvaikar, Christos Grecos

Proceedings Volume 10996, Real-Time Image Processing and Deep Learning 2019; 1099604 (2019) https://doi.org/10.1117/12.2518438
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

A no-reference image quality assessment technique can measure the visual distortion in an image without any reference image data. Image distortions can be caused through the acquisition, compression or transmission of digital images. From the several types of image distortions, JPEG and JPEG2000 compression distortions, addition of white noise, Gaussian blur and fast fading are the most common ones. A typical real-world image may have multiple types of distortion. Our aim is to determine the different types of distortion that are present in an image and find the total distortion levels using a novel architecture using multiple Deep Convolutional Neural Networks (MDNN). The proposed model will classify different types of distortion that are present in an image thereby achieving both these objectives. Initially, local contrast normalization (LCN) is performed on images which are fed into the deep neural network for training. The images are then processed by a convolution-based distortion classifier which estimates the probability of each distortion type. Next, the distortion quality is predicted for each class. These probabilities are fused using the weighted average-pooling algorithm to get a single regressor output. We also experimented on the different parameters of the neural network, including optimizers (Adam, Adadelta, SGD, Rmsprop) and activation functions (RELU, SoftMax, Sigmoid, and Linear). The LIVE II database is used for the training, since it has five of the major distortion types. Cross-dataset validation is done on the CSIQ and TID2008 database. The results were evaluated using different correlation coefficients (SORCC, PLCC) and we achieved a linear correlation with the differential mean opinion scores (DMOS) for each of these coefficients in the tests conducted.

Conference Presentation

Citation Download Citation

Ravi Ravela, Mukul Shirvaikar, and Christos Grecos "No-reference image quality assessment based on deep convolutional neural networks", Proc. SPIE 10996, Real-Time Image Processing and Deep Learning 2019, 1099604 (14 May 2019); https://doi.org/10.1117/12.2518438

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available