Embedded image enhancement for high-throughput cameras

Stan J. C. Geerts; Dion Cornelissen; Peter H. N. de With

doi:10.1117/12.2036966

5 March 2014 Embedded image enhancement for high-throughput cameras

Stan J. C. Geerts, Dion Cornelissen, Peter H. N. de With

Proceedings Volume 9026, Video Surveillance and Transportation Imaging Applications 2014; 90260Z (2014) https://doi.org/10.1117/12.2036966
Event: IS&T/SPIE Electronic Imaging, 2014, San Francisco, California, United States

Abstract

This paper presents image enhancement for a novel Ultra-High-Definition (UHD) video camera offering 4K images and higher. Conventional image enhancement techniques need to be reconsidered for the high-resolution images and the low-light sensitivity of the new sensor. We study two image enhancement functions and evaluate and optimize the algorithms for embedded implementation in programmable logic (FPGA). The enhancement study involves high-quality Auto White Balancing (AWB) and Local Contrast Enhancement (LCE). We have compared multiple algorithms from literature, both with objective and subjective metrics. In order to objectively compare Local Contrast (LC), an existing LC metric is modified for LC measurement in UHD images. For AWB, we have found that color histogram stretching offers a subjective high image quality and it is among the algorithms with the lowest complexity, while giving only a small balancing error. We impose a color-to-color gain constraint, which improves robustness of low-light images. For local contrast enhancement, a combination of contrast preserving gamma and single-scale Retinex is selected. A modified bilateral filter is designed to prevent halo artifacts, while significantly reducing the complexity and simultaneously preserving quality. We show that by cascading contrast preserving gamma and single-scale Retinex, the visibility of details is improved towards the level appropriate for high-quality surveillance applications. The user is offered control over the amount of enhancement. Also, we discuss the mapping of those functions on a heterogeneous platform to come to an effective implementation while preserving quality and robustness.

Citation Download Citation

Stan J. C. Geerts, Dion Cornelissen, and Peter H. N. de With "Embedded image enhancement for high-throughput cameras", Proc. SPIE 9026, Video Surveillance and Transportation Imaging Applications 2014, 90260Z (5 March 2014); https://doi.org/10.1117/12.2036966

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
14 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Image enhancement

Field programmable gate arrays

Image processing

Image quality

RGB color model

Image sensors

Show All Keywords

Keywords/Phrases

Search In:

Publication Years