A Hybrid Machine Learning Approach for Sentiment Analysis of Partially Occluded Faces

Document Type

Conference Proceeding

Source of Publication

2021 IEEE International Conference on Artificial Intelligence and Computer Applications, ICAICA 2021

Publication Date

6-28-2021

Abstract

With millions of images and videos uploaded on social media every day, facial sentiment analysis has gained significant attention as means of gaining large scale insights into people's emotions and sentiments. While several models have been proposed for sentiment and emotion analysis of complete, camera-facing pictures, the analysis of images appearing in natural settings and crowded scenes poses more challenges. In such settings, images typically contain a mix of complete and partially occluded faces (i.e. obstructed faces) presented with different angles, resolutions and distances from the camera. In this paper, we propose a hybrid machine learning model combining convolutional neural networks (CNNs) and support vector machines (SVMs) to achieve accurate facial sentiment and emotion analysis of incomplete and partially occluded facial images. The proposed model was successfully tested using 4, 690 images containing 25, 400 faces, collected from a large-scale public event. The model was able to correctly classify the test dataset containing faces with different angles, camera distances, occlusion areas, and image resolutions. The results show a classification accuracy of 89.9% for facial sentiment analysis, and an accuracy of 87.4% when distinguishing between seven emotions in partially occluded faces. This makes our model suitable for real-life practical applications.

ISBN

9781665418676

Publisher

IEEE

First Page

389

Last Page

392

Disciplines

Computer Sciences

Keywords

convolutional neural networks, facial recognition, Sentiment analysis, support vector machines

Scopus ID

85114554678

Indexed in Scopus

yes

Open Access

no

Link to Full Text

Share

COinS