Photorealistic image synthesis and camera validation from 2D images

Juan Carlos Santos Ferrer; David González Chévere; Vidya Manian

doi:10.1117/12.2050916

5 June 2014 Photorealistic image synthesis and camera validation from 2D images

Juan Carlos Santos Ferrer, David González Chévere, Vidya Manian

Proceedings Volume 9117, Three-Dimensional Imaging, Visualization, and Display 2014; 911712 (2014) https://doi.org/10.1117/12.2050916
Event: SPIE Sensing Technology + Applications, 2014, Baltimore, MD, United States

Abstract

This paper presents a new 3D scene reconstruction technique using the Unity 3D game engine. The method presented here allow us to reconstruct the shape of simple objects and more complex ones from multiple 2D images, including infrared and digital images from indoor scenes and only digital images from outdoor scenes and then add the reconstructed object to the simulated scene created in Unity 3D, these scenes are then validated with real world scenes. The method used different cameras settings and explores different properties in the reconstructions of the scenes including light, color, texture, shapes and different views. To achieve the highest possible resolution, it was necessary the extraction of partial textures from visible surfaces. To recover the 3D shapes and the depth of simple objects that can be represented by the geometric bodies, there geometric characteristics were used. To estimate the depth of more complex objects the triangulation method was used, for this the intrinsic and extrinsic parameters were calculated using geometric camera calibration. To implement the methods mentioned above the Matlab tool was used. The technique presented here also let’s us to simulate small simple videos, by reconstructing a sequence of multiple scenes of the video separated by small margins of time. To measure the quality of the reconstructed images and video scenes the Fast Low Band Model (FLBM) metric from the Video Quality Measurement (VQM) software was used. Low bandwidth perception based features include edges and motion.

Citation Download Citation

Juan Carlos Santos Ferrer, David González Chévere, and Vidya Manian "Photorealistic image synthesis and camera validation from 2D images", Proc. SPIE 9117, Three-Dimensional Imaging, Visualization, and Display 2014, 911712 (5 June 2014); https://doi.org/10.1117/12.2050916

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

3D image reconstruction

Video

3D image processing

Calibration

Digital imaging

Image quality

Show All Keywords

Keywords/Phrases

Search In:

Publication Years