Markerless 3D facial motion capture system

Youngkyoo Hwang; Jung-Bae Kim; Xuetao Feng; Won-Chul Bang; Taehyun Rhee; James D.K. Kim; ChangYeong Kim

doi:10.1117/12.907528

8 February 2012 Markerless 3D facial motion capture system

Youngkyoo Hwang, Jung-Bae Kim, Xuetao Feng, Won-Chul Bang, Taehyun Rhee, James D.K. Kim, ChangYeong Kim

Proceedings Volume 8289, The Engineering Reality of Virtual Reality 2012; 828909 (2012) https://doi.org/10.1117/12.907528
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

We propose a novel markerless 3D facial motion capture system using only one common camera. This system is simple and easy to transfer facial expressions of a user's into virtual world. It has robustly tracking facial feature points associated with head movements. In addition, it estimates high accurate 3D points' locations. We designed novel approaches to the followings; Firstly, for precisely 3D head motion tracking, we applied 3D constraints using a 3D face model on conventional 2D feature points tracking approach, called Active Appearance Model (AAM). Secondly, for dealing with various expressions of a user's, we designed 2D face generic models from around 5000 images data and 3D shape data including symmetric and asymmetric facial expressions. Lastly, for accurately facial expression cloning, we invented a manifold space to successfully transfer 2D low dimensional feature points to 3D high dimensional points. The manifold space is defined by eleven facial expression bases.

Citation Download Citation

Youngkyoo Hwang, Jung-Bae Kim, Xuetao Feng, Won-Chul Bang, Taehyun Rhee, James D.K. Kim, and ChangYeong Kim "Markerless 3D facial motion capture system", Proc. SPIE 8289, The Engineering Reality of Virtual Reality 2012, 828909 (8 February 2012); https://doi.org/10.1117/12.907528

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available