Mr. Tatsuro Mori Profile

Tatsuro Mori

at Nagoya Univ

SPIE Involvement:

Author

Publications (2)

This will count as one of your downloads.

You will have access to both the presentation and article (if available).

DOWNLOAD NOW

This content is available for download via your institution's subscription. To access this item, please sign in to your personal account.

Email or Username Forgot your username?

Password Forgot your password?

Show

Keep me signed in

No SPIE account? Create an account

Proceedings Article | 6 March 2014 Paper

Development of free-viewpoint image synthesis system using time varying projection and spacetime stereo

Tatsuro Mori, Keita Takahashi, Toshiaki Fujii

Proceedings Volume 9011, 90111X (2014) https://doi.org/10.1117/12.2038843

KEYWORDS: Cameras, Projection systems, Imaging systems, Video, Digital Light Processing, Image processing, Video acceleration, RGB color model, 3D image reconstruction, Calibration

Read Abstract +

The goal of our research is to develop a real-time free-viewpoint image synthesis system for dynamic scenes using multi-view video cameras. To this end, depth estimation that is efficient and suitable for dynamic scenes is indispensable. A promising solution for this is view-dependent depth estimation where per-pixel depth maps are estimated directly for the target views to synthesize. Such view dependent methods were successfully adopted in previous works, but their depth estimation quality was limited especially for textureless objects, resulting in low quality virtual views. This limitation comes from a fact that their depth estimation depended only on passive approaches such as traditional stereo triangulation. To tackle this problem, we considered to use active methods in addition to the passive stereo triangulation. Inspired by the success of recent commercial depth cameras, we developed a customized active illumination using a DLP projector. The projector casts spacially incoherrent patterns to the scene and makes textureless regions identifiable from the cameras, so that stereo triangulation among the multi-view cameras can be greatly improved. Moreover, making the illuminations time-varying, we can stabilize depth estimation more by using spatiotemporal matching across multi-view cameras based on the concept of spacetime stereo method, and also remove the artificial patterns from the synthesized virtual views by averaging successive time frames. Our system consisting of 16 video cameras synchronized with the DLP projector runs in real-time (about 10 fps) thanks to our sophisticated GPGPU implementation.

Proceedings Article | 12 March 2013 Paper

Adaptive hole filling for 3D warping-based virtual view synthesis

Tatsuro Mori, Mehrdad Panahpour Tehrani, Toshiaki Fujii, Masayuki Tanimoto

Proceedings Volume 8648, 864823 (2013) https://doi.org/10.1117/12.2002830

KEYWORDS: Cameras, Image processing, 3D image processing, 3D vision, Image filtering, Digital filtering, 3D displays, Optical filters, Factor analysis, Image resolution

Read Abstract +

In this paper, we discuss a Free viewpoint synthesis with View + Depth format for Multiview applications such as 3DTV and Free View-point Television(FTV)¹.When generating a virtual image, 3D warping is used with view and depth of a reference camera. This process includes the problem that holes appear in the virtual image. In conventional method, the holes were dealt with collectively by median filter. There are some different reasons why holes appear through this process. So, it is improper that they are not distinguished particularly and treated all at once like conventional method. We analyze the factors, and recognize that two ones exist, boundary between foreground and background, and reduction of resolution. In this paper, we propose a new hole filling method considering these factors. In the first step, we classify nearby pixels into boundary or same object area according to the gradient of depth value. For boundary case, we hold them and refer to other two real cameras. For another case of same object area, we set up sub-pixels between nearby pixels and warp them if the depth is gradually changing or virtual viewpoint of the warped image is closer to the object than the original view position because they probably cause holes from reduction of resolution. We implement these methods in the simulation. As a result, we prevent boundary in the virtual image from being ambiguous, and confirm the availability of proposed method.

My Library

You currently do not have any folders to save your paper to! Create a new folder below.

Folder Name

Folder Description

View contact details

UPDATE YOUR PROFILE

Is this your profile? Update it now.

Sign into your SPIE.org account

Don’t have a profile and want one?

Create an account on SPIE.org

Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks. You are receiving this notice because your organization may not have SPIE eBooks access.*

*Shibboleth/Open Athens users─please sign in to access your institution's subscriptions.

To obtain this item, you may purchase the complete book in print or electronic format on SPIE.org.

ORGANIZATIONAL
Sign in with credentials provided by your organization.

Organizational Username

Organizational Password

Show/Hide Password

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members:

Non-members: ADD TO CART

Keywords/Phrases

Search In:

Publication Years