13 January 2021 Facial expression recognition based on facial part attention mechanism
Qiubo Zhong, Baofu Fang, Shenbin Wei, Zaijun Wang, Haoxiang Zhang
Author Affiliations +
Abstract

In the context of facial expression recognition (FER), a lot of methods focus on feature extraction of the whole facial image, but sometimes it is equally important to concentrate on local area features that embody stronger emotions. This paper proposes an FER method based on the facial part attention mechanism (FPA). We adopt the attention mechanism to extract emotional rich local area features, which are complementary to the whole facial features for better FER. First, this paper proposes a cluster-based facial landmarks selection method to select facial landmarks that have commonality and best reflect local area emotions. Then, we design an FPA convolutional neural network, which consists of two parts. The first part is the object network, which is used to extract the whole facial features; the second part is the part attention network, and the attention component is used to extract the local part features. Finally, the two parts are merged to train the final classifier. The method was tested on the Real-World Affective Faces database and the recognition accuracy of 87.26% was obtained, which proved the effectiveness of the method.

© 2021 SPIE and IS&T 1017-9909/2021/$28.00 © 2021 SPIE and IS&T
Qiubo Zhong, Baofu Fang, Shenbin Wei, Zaijun Wang, and Haoxiang Zhang "Facial expression recognition based on facial part attention mechanism," Journal of Electronic Imaging 30(3), 031206 (13 January 2021). https://doi.org/10.1117/1.JEI.30.3.031206
Received: 15 October 2020; Accepted: 3 December 2020; Published: 13 January 2021
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Facial recognition systems

Feature extraction

Network architectures

Convolution

Staring arrays

Convolutional neural networks

Databases

Back to Top