Document Type
Article
Source of Publication
Complex & Intelligent Systems
Publication Date
6-7-2023
Abstract
Driver emotion classification is an important topic that can raise awareness of driving habits because many drivers are overconfident and unaware of their bad driving habits. Drivers will acquire insight into their poor driving behaviors and be better able to avoid future accidents if their behavior is automatically identified. In this paper, we use different models such as convolutional neural networks, recurrent neural networks, and multi-layer perceptron classification models to construct an ensemble convolutional neural network-based enhanced driver facial expression recognition model. First, the faces of the drivers are discovered using the faster region-based convolutional neural network (R-CNN) model, which can recognize faces in real-time and offline video reliably and effectively. The feature-fusing technique is utilized to integrate the features extracted from three CNN models, and the fused features are then used to train the suggested ensemble classification model. To increase the accuracy and efficiency of face detection, a new convolutional neural network block (InceptionV3) replaces the improved Faster R-CNN feature-learning block. To evaluate the proposed face detection and driver facial expression recognition (DFER) datasets, we achieved an accuracy of 98.01%, 99.53%, 99.27%, 96.81%, and 99.90% on the JAFFE, CK+, FER-2013, AffectNet, and custom-developed datasets, respectively. The custom-developed dataset has been recorded as the best among all under the simulation environment.
DOI Link
ISSN
Publisher
Springer Science and Business Media LLC
First Page
1
Last Page
26
Disciplines
Computer Sciences
Keywords
Driver facial expression recognition (DFER), Custom developed datasets (CDD), Computer vision, Attention mechanism and DenseNet, FE
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Recommended Citation
Zaman, Khalid; Zhaoyun, Sun; Shah, Babar; Hussain, Tariq; Shah, Sayyed Mudassar; Ali, Farman; and Khan, Umer Sadiq, "A novel driver emotion recognition system based on deep ensemble classification" (2023). All Works. 5880.
https://zuscholars.zu.ac.ae/works/5880
Indexed in Scopus
no
Open Access
yes
Open Access Type
Gold: This publication is openly available in an open access journal/series