Learning head pose-insensitive and discriminative deep features for smile detection

Yanling Gan; Jingying Chen; Luhui Xu

doi:10.1117/1.JEI.27.5.053048

30 October 2018 Learning head pose-insensitive and discriminative deep features for smile detection

Yanling Gan, Jingying Chen, Luhui Xu

Author Affiliations +

Journal of Electronic Imaging, Vol. 27, Issue 5, 053048 (October 2018). https://doi.org/10.1117/1.JEI.27.5.053048

Abstract

Smile detection plays an important role in human emotion analysis and has wide applications. However, there is still a gap between the performance of the current smile detection algorithms and real-world applications, due to variations of head pose and environment noise. We propose a robust framework based on convolutional neural networks (CNNs) for smile detection. To alleviate the influence of head pose variations and improve performance, the proposed framework customizes two-feature learning layers such as (1) smile feature extraction layer is constructed by hidden factor analysis for learning head pose-insensitive smile features; (2) smile feature discrimination layer is constructed by marginal Fisher analysis, and it is used to learn discriminative features for further enhancing the discrimination between smile and nonsmile. The two layers both work as fully connected layers, and they are connected layer by layer to a backbone CNN network. Experiments have been performed on two publicly available datasets, and the results show that the proposed framework delivers promising performance (95.45% on GENKI4K and 93.62% on labeled faces in the wild attribute) and outperforms the state of the art.

Citation Download Citation

Yanling Gan, Jingying Chen, and Luhui Xu "Learning head pose-insensitive and discriminative deep features for smile detection," Journal of Electronic Imaging 27(5), 053048 (30 October 2018). https://doi.org/10.1117/1.JEI.27.5.053048

Received: 17 July 2018; Accepted: 9 October 2018; Published: 30 October 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available