Translator Disclaimer
17 January 2005 Virtual mirror based on 3D-shape reconstruction and real-time face tracking
Author Affiliations +
Proceedings Volume 5670, Internet Imaging VI; (2005)
Event: Electronic Imaging 2005, 2005, San Jose, California, United States
Human face gives various kinds of information such as feeling, age, physical condition and so on. Therefore it is important to acquire and reconstruct the facial pattern precisely for various kinds of applications. Our goal is to create the electronic cosmetics systems with real-time tracking of 3D facial pattern. A simple 3D virtual mirror interface system is proposed for acquisition and reconstruction of facial pattern, which enables a real time tracking of 3D facial pattern. The movement of lip in the face, which can be estimated based on mean shift and Kalman filter is introduced to recognize the rotation and parallel shift of face. Modified Photometric Stereo Method is also proposed to acquire the 3D shape without the influence of deficiency in shadow area of the object. It is shown that the proposed system is effective to acquire and reconstruct for the real-time tracking of 3D facial pattern image than traditional approaches. We consider that this interface can be applied to the electronic cosmetics systems that can simulate make-up, plastic surgery and color appearance under various illuminations.
© (2005) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Takao Makino, Toshiya Nakaguchi, Norimichi Tsumura, and Yoichi Miyake "Virtual mirror based on 3D-shape reconstruction and real-time face tracking", Proc. SPIE 5670, Internet Imaging VI, (17 January 2005);


Back to Top