Kunal Biswas
Classification of aesthetic natural scene images using statistical and semantic features
Biswas, Kunal; Shivakumara, Palaiahnakote; Pal, Umapada; Lu, Tong; Blumenstein, Michael; Lladós, Josep
Authors
Dr Shivakumara Palaiahnakote S.Palaiahnakote@salford.ac.uk
Lecturer
Umapada Pal
Tong Lu
Michael Blumenstein
Josep Lladós
Abstract
Aesthetic image analysis is essential for improving the performance of multimedia image retrieval systems, especially from a repository of social media and multimedia content stored on mobile devices. This paper presents a novel method for classifying aesthetic natural scene images by studying the naturalness of image content using statistical features, and reading text in the images using semantic features. Unlike existing methods that focus only on image quality with human information, the proposed approach focuses on image features as well as text-based semantic features without human intervention to reduce the gap between subjectivity and objectivity in the classification. The aesthetic classes considered in this work are (i) Very Pleasant, (ii) Pleasant, (iii) Normal and (iv) Unpleasant. The naturalness is represented by features of focus, defocus, perceived brightness, perceived contrast, blurriness and noisiness, while semantics are represented by text recognition, description of the images and labels of images, profile pictures, and banner images. Furthermore, a deep learning model is proposed in a novel way to fuse statistical and semantic features for the classification of aesthetic natural scene images. Experiments on our own dataset and the standard datasets demonstrate that the proposed approach achieves 92.74%, 88.67% and 83.22% average classification rates on our own dataset, AVA dataset and CUHKPQ dataset, respectively. Furthermore, a comparative study of the proposed model with the existing methods shows that the proposed method is effective for the classification of aesthetic social media images.
Citation
Biswas, K., Shivakumara, P., Pal, U., Lu, T., Blumenstein, M., & Lladós, J. (2023). Classification of aesthetic natural scene images using statistical and semantic features. Multimedia Tools and Applications, 82, 13507–13532. https://doi.org/10.1007/s11042-022-13924-7
Journal Article Type | Article |
---|---|
Acceptance Date | Sep 12, 2022 |
Publication Date | 2023-04 |
Deposit Date | Feb 2, 2024 |
Journal | Multimedia Tools and Applications |
Print ISSN | 1380-7501 |
Publisher | Springer Verlag |
Peer Reviewed | Peer Reviewed |
Volume | 82 |
Pages | 13507–13532 |
DOI | https://doi.org/10.1007/s11042-022-13924-7 |
You might also like
An Episodic Learning Network for Text Detection on Human Bodies in Sports Images
(2022)
Journal Article
A Conformable Moments-Based Deep Learning System for Forged Handwriting Detection
(2022)
Journal Article
A deep action-oriented video image classification system for text detection and recognition
(2021)
Journal Article
Downloadable Citations
About USIR
Administrator e-mail: library-research@salford.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search