A model based method for stereo face reconstruction

Hengwei Xu; Zongqing Lu; Qingmin Liao

doi:10.1117/12.2539698

14 August 2019 A model based method for stereo face reconstruction

Hengwei Xu, Zongqing Lu, Qingmin Liao

Proceedings Volume 11179, Eleventh International Conference on Digital Image Processing (ICDIP 2019); 111794H (2019) https://doi.org/10.1117/12.2539698
Event: Eleventh International Conference on Digital Image Processing (ICDIP 2019), 2019, Guangzhou, China

Abstract

Face reconstruction is a long-standing and extremely challenging problem. In order to solve this problem more accurately and efficiently, In this paper, we propose a model based stereo method to reconstruct fine detailed 3D face with the calibrated face stereo images captured by stereo camera. Our model based stereo method can avoid the limited power of expressiveness in model based reconstruction and the mismatch appeared in stereo reconstruction. In the proposed method, the sparse landmarks detected from stereo images are employed to reconstruct coarse shape and posture parameters with 3d morphable model(3DMM). The detailed face will be gotten by per vertex deformation based on coarse shape according to illumination value, gradient and surface smooth terms, and the direction of per vertex deformation follows the direction of the vertex’s normal, for which is the fastest changing direction of local mesh area. The experimental results show that our proposed method achieve high performance compared with the E-eos method.

Citation Download Citation

Hengwei Xu, Zongqing Lu, and Qingmin Liao "A model based method for stereo face reconstruction", Proc. SPIE 11179, Eleventh International Conference on Digital Image Processing (ICDIP 2019), 111794H (14 August 2019); https://doi.org/10.1117/12.2539698

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available