Real-time 3D face reconstruction based on geometry

Linrui Wang; Wang Xiang; Junfei Dai

doi:10.1117/12.2666805

27 January 2023 Real-time 3D face reconstruction based on geometry

Linrui Wang, Wang Xiang, Junfei Dai

Proceedings Volume 12550, International Conference on Optical and Photonic Engineering (icOPEN 2022); 1255021 (2023) https://doi.org/10.1117/12.2666805
Event: International Conference on Optical and Photonic Engineering (icOPEN 2022), 2022, ONLINE, China

Abstract

We developed a novel method based on geometry to reconstruct a dynamic face solely by using the conventional structured light system, which does not need extra images, hardware components, or objects. In our method, the bridge of the nose is considered the feature region because its shape remains almost constant when a human is moving or making expressions. This three-dimensional (3D) face reconstruction method consists of the following steps: (1) spatially unwrap the phase and obtain the texture image for each frame; (2) locate the nose area for each frame with a feature detection algorithm; (3) determine the fringe order in the first frame with the cues given by traditional methods and acquire the recovered result of the feature region; (4) locate the feature region for each possible fringe order in one frame by finding the pixel nearest to the camera along the depth direction in the nose area; (5) register each 3D shape of the feature region with it in the former frame by the Iterative Closest Point (ICP) algorithm; (6) determine the fringe order by the minimal Hausdorff distance between two registered 3D shapes and then construct the face with the entire absolute phase map. Experimental results indicate that our proposed approach is capable of real-time reconstruction of a dynamic face and only three phase-shifted fringes are required per frame.

Citation Download Citation

Linrui Wang, Wang Xiang, and Junfei Dai "Real-time 3D face reconstruction based on geometry", Proc. SPIE 12550, International Conference on Optical and Photonic Engineering (icOPEN 2022), 1255021 (27 January 2023); https://doi.org/10.1117/12.2666805

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
5 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Nose

Bridges

Cameras

Phase shifts

Imaging systems

Reconstruction algorithms

3D modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years