Virtual view image synthesis for eye-contact in TV conversation system

Daisuke Murayama; Keiichi Kimura; Tadaaki Hosaka; Takayuki Hamamoto; Nao Shibuhisa; Seiichi Tanaka; Shunichi Sato; Sakae Saito

doi:10.1117/12.839121

4 February 2010 Virtual view image synthesis for eye-contact in TV conversation system

Daisuke Murayama, Keiichi Kimura, Tadaaki Hosaka, Takayuki Hamamoto, Nao Shibuhisa, Seiichi Tanaka, Shunichi Sato, Sakae Saito

Author Affiliations +

Proceedings Volume 7526, Three-Dimensional Image Processing (3DIP) and Applications; 75260B (2010) https://doi.org/10.1117/12.839121
Event: IS&T/SPIE Electronic Imaging, 2010, San Jose, California, United States

Abstract

Eye-contact plays an important role for human communications in the sense that it can convey unspoken information. However, it is highly difficult to realize eye-contact in teleconferencing systems because of camera configurations. Conventional methods to overcome this difficulty mainly resorted to space-consuming optical devices such as half mirrors. In this paper, we propose an alternative approach to achieve eye-contact by techniques of arbitrary view image synthesis. In our method, multiple images captured by real cameras are converted to the virtual viewpoint (the center of the display) by homography, and evaluation of matching errors among these projected images provides the depth map and the virtual image. Furthermore, we also propose a simpler version of this method by using a single camera to save the computational costs, in which the only one real image is transformed to the virtual viewpoint based on the hypothesis that the subject is located at a predetermined distance. In this simple implementation, eye regions are separately generated by comparison with pre-captured frontal face images. Experimental results of both the methods show that the synthesized virtual images enable the eye-contact favorably.

Citation Download Citation

Daisuke Murayama, Keiichi Kimura, Tadaaki Hosaka, Takayuki Hamamoto, Nao Shibuhisa, Seiichi Tanaka, Shunichi Sato, and Sakae Saito "Virtual view image synthesis for eye-contact in TV conversation system", Proc. SPIE 7526, Three-Dimensional Image Processing (3DIP) and Applications, 75260B (4 February 2010); https://doi.org/10.1117/12.839121

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Imaging systems

Eye

Matrices

Image processing

Calibration

Prototyping

Show All Keywords

Keywords/Phrases

Search In:

Publication Years