Divya Krishnani
A new context-based feature for classification of emotions in photographs
Krishnani, Divya; Shivakumara, Palaiahnakote; Lu, Tong; Pal, Umapada; Lopresti, Daniel; Hemantha Kumar, Govindaraju
Authors
Dr Shivakumara Palaiahnakote S.Palaiahnakote@salford.ac.uk
Lecturer
Tong Lu
Umapada Pal
Daniel Lopresti
Govindaraju Hemantha Kumar
Abstract
A high volume of images is shared on the public Internet each day. Many of these are photographs of people with facial expressions and actions displaying various emotions. In this work, we examine the problem of classifying broad categories of emotions based on such images, including Bullying, Mildly Aggressive, Very Aggressive, Unhappy, Disdain and Happy. This work proposes the Context-based Features for Classification of Emotions in Photographs (CFCEP). The proposed method first detects faces as a foreground component, and other information (non-face) as background components to extract context features. Next, for each foreground and background component, we explore the Hanman transform to study local variations in the components. The proposed method combines the Hanman transform (H) values of foreground and background components according to their merits, which results in two feature vectors. The two feature vectors are fused by deriving weights to generate one feature vector. Furthermore, the feature vector is fed to a CNN classifier for classification of images of different emotions uploaded on social media and public internet. Experimental results on our dataset of different emotion classes and the benchmark dataset show that the proposed method is effective in terms of average classification rate. It reports 91.7% for our 10-class dataset, 92.3% for 5 classes of standard dataset and 81.4% for FERPlus dataset. In addition, a comparative study with existing methods on the benchmark dataset of 5-classes, standard dataset of facial expression (FERPlus) and another dataset of 10-classes show that the proposed method is best in terms of scalability and robustness.
Citation
Krishnani, D., Shivakumara, P., Lu, T., Pal, U., Lopresti, D., & Hemantha Kumar, G. (2021). A new context-based feature for classification of emotions in photographs. Multimedia Tools and Applications, 80, 15589–15618. https://doi.org/10.1007/s11042-020-10404-8
Journal Article Type | Article |
---|---|
Acceptance Date | Dec 20, 2020 |
Publication Date | Apr 5, 2021 |
Deposit Date | Feb 2, 2024 |
Journal | Multimedia Tools and Applications |
Print ISSN | 1380-7501 |
Publisher | Springer Verlag |
Peer Reviewed | Peer Reviewed |
Volume | 80 |
Pages | 15589–15618 |
DOI | https://doi.org/10.1007/s11042-020-10404-8 |
You might also like
Classification of aesthetic natural scene images using statistical and semantic features
(2023)
Journal Article
An Episodic Learning Network for Text Detection on Human Bodies in Sports Images
(2022)
Journal Article
A Conformable Moments-Based Deep Learning System for Forged Handwriting Detection
(2022)
Journal Article
Downloadable Citations
About USIR
Administrator e-mail: library-research@salford.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search