Self-supervised 3D face reconstruction based on multi-view UV fusion

Cheng Zeng; Xiaohan Li; Xiang Zhou

doi:10.1117/12.2601213

30 June 2021 Self-supervised 3D face reconstruction based on multi-view UV fusion

Cheng Zeng, Xiaohan Li, Xiang Zhou

Proceedings Volume 11878, Thirteenth International Conference on Digital Image Processing (ICDIP 2021); 1187819 (2021) https://doi.org/10.1117/12.2601213
Event: Thirteenth International Conference on Digital Image Processing, 2021, Singapore, Singapore

Abstract

Image-based 3D face reconstruction has a huge application in the field of face analysis, such as face recognition, facial animation, and face editing. Recently, the popular methods based on 3dmm suffer from the ill-posed face pose16 and depth ambiguity issue. In order to address the issue, two multi-view geometric constraints are included in the reconstruction process. Note that before using these two constraints, a complete UV texture needs to be generated by texture fusion. Then, we can establish dense correspondences between different views leveraging a novel self-supervised pixel consistency constraint. We also use the facial landmark-based epi-polar constraint to constrain the pose between different views to obtain more accurate results. Extensive experiments demonstrate the superiority of the proposed method over other popular 3dmm methods with single-view input in accuracy and robustness, especially under large poses.

Citation Download Citation

Cheng Zeng, Xiaohan Li, and Xiang Zhou "Self-supervised 3D face reconstruction based on multi-view UV fusion", Proc. SPIE 11878, Thirteenth International Conference on Digital Image Processing (ICDIP 2021), 1187819 (30 June 2021); https://doi.org/10.1117/12.2601213

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available