Multiscale feature pyramid perception for micro-expression recognition based on domain adaptation

Zhihao Wang

doi:10.1117/12.3048376

3 October 2024 Multiscale feature pyramid perception for micro-expression recognition based on domain adaptation

Zhihao Wang

Proceedings Volume 13272, Fifth International Conference on Computer Vision and Data Mining (ICCVDM 2024); 132722X (2024) https://doi.org/10.1117/12.3048376
Event: 5th International Conference on Computer Vision and Data Mining (ICCVDM 2024), 2024, Changchun, China

Abstract

Micro-expressions (MEs) are unintentional, brief facial expressions with the potential to reveal hidden or suppressed emotions, significantly contributing to the study of human emotions and psychological states. Despite this, the brief duration and subtlety of MEs make micro-expression recognition (MER) a difficult task. This paper introduces a domain adaptation based multi-scale feature pyramid perception framework for MER, namely domain adaptation multi-scale feature pyramid perception network (DAMFPP-Net), extracting common feature representations between MEs and macroexpressions (MaEs) and transferring them to MER task. Specifically, the network extracts multi-scale features of both MEs and MaEs by multi-scale feature pyramids construction and perception module. Then, domain adaptation is utilized to reduce the differences in feature distributions between the two, thus obtaining a shared emotional representation. Finally, the common features are transferred to MER task to adapt to the unique characteristics of MEs. Our approach demonstrates state-of-the-art performance through extensive experiments on three public micro-expression datasets.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Zhihao Wang "Multiscale feature pyramid perception for micro-expression recognition based on domain adaptation", Proc. SPIE 13272, Fifth International Conference on Computer Vision and Data Mining (ICCVDM 2024), 132722X (3 October 2024); https://doi.org/10.1117/12.3048376

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
5 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Feature extraction

Machine learning

Optical flow

Education and training

Emotion

Performance modeling

Ablation

Show All Keywords

Keywords/Phrases

Search In:

Publication Years