Human emotion detector based on genetic algorithm using lip features

Terrence Brown; Gholamreza Fetanat; Abdollah Homaifar; Brian Tsou; Olga Mendoza-Schrock

doi:10.1117/12.851190

27 April 2010 Human emotion detector based on genetic algorithm using lip features

Terrence Brown, Gholamreza Fetanat, Abdollah Homaifar, Brian Tsou, Olga Mendoza-Schrock

Proceedings Volume 7704, Evolutionary and Bio-Inspired Computation: Theory and Applications IV; 77040I (2010) https://doi.org/10.1117/12.851190
Event: SPIE Defense, Security, and Sensing, 2010, Orlando, Florida, United States

Abstract

We predicted human emotion using a Genetic Algorithm (GA) based lip feature extractor from facial images to classify all seven universal emotions of fear, happiness, dislike, surprise, anger, sadness and neutrality. First, we isolated the mouth from the input images using special methods, such as Region of Interest (ROI) acquisition, grayscaling, histogram equalization, filtering, and edge detection. Next, the GA determined the optimal or near optimal ellipse parameters that circumvent and separate the mouth into upper and lower lips. The two ellipses then went through fitness calculation and were followed by training using a database of Japanese women's faces expressing all seven emotions. Finally, our proposed algorithm was tested using a published database consisting of emotions from several persons. The final results were then presented in confusion matrices. Our results showed an accuracy that varies from 20% to 60% for each of the seven emotions. The errors were mainly due to inaccuracies in the classification, and also due to the different expressions in the given emotion database. Detailed analysis of these errors pointed to the limitation of detecting emotion based on the lip features alone. Similar work [1] has been done in the literature for emotion detection in only one person, we have successfully extended our GA based solution to include several subjects.

Citation Download Citation

Terrence Brown, Gholamreza Fetanat, Abdollah Homaifar, Brian Tsou, and Olga Mendoza-Schrock "Human emotion detector based on genetic algorithm using lip features", Proc. SPIE 7704, Evolutionary and Bio-Inspired Computation: Theory and Applications IV, 77040I (27 April 2010); https://doi.org/10.1117/12.851190

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available