Dr Salem Ameen S.A.Ameen1@salford.ac.uk
Lecturer
Dr Salem Ameen S.A.Ameen1@salford.ac.uk
Lecturer
Prof Sunil Vadera S.Vadera@salford.ac.uk
Professor
Sign language is used by approximately 70 million1 people throughout the world, and an automatic tool for interpreting it could make a major impact on communication between those who use it and those who may not understand it.
However, computer interpretation of sign language is very difficult given the variability in size, shape and position of the fingers or hands in an image.
Hence, this paper explores the applicability of deep learning for interpreting sign language. The paper develops a convolutional neural network aimed at classifying fingerspelling images using both image intensity and depth data.
The developed convolutional network is evaluated by applying it to the problem of finger spelling recognition for American Sign Language. The evaluation shows that the developed convolutional network performs better than previous studies and has precision of 82% and recall of 80%. Analysis of the confusion matrix from the evaluation reveals the underlying difficulties of classifying some particular signs which is discussed in the paper.
Journal Article Type | Article |
---|---|
Acceptance Date | Dec 9, 2016 |
Online Publication Date | Feb 7, 2017 |
Publication Date | Jun 5, 2017 |
Deposit Date | Jan 26, 2017 |
Publicly Available Date | Feb 7, 2018 |
Journal | Expert Systems |
Print ISSN | 0266-4720 |
Electronic ISSN | 1468-0394 |
Publisher | Wiley |
Volume | 34 |
Issue | 3 |
Pages | e12197 |
DOI | https://doi.org/10.1111/exsy.12197 |
Publisher URL | http://dx.doi.org/10.1111/exsy.12197 |
Related Public URLs | http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1468-0394 |
14_07_16_FingerSpellingwithConvNet_ASL.pdf
(917 Kb)
PDF
Optimizing deep learning networks using multi-armed bandits
(-0001)
Thesis
Methods for pruning deep neural networks
(2022)
Journal Article
Pruning neural networks using multi-armed bandits
(2019)
Journal Article
Vision transformers for automated detection of pig interactions in groups
(2025)
Journal Article
About USIR
Administrator e-mail: library-research@salford.ac.uk
This application uses the following open-source libraries:
Apache License Version 2.0 (http://www.apache.org/licenses/)
Apache License Version 2.0 (http://www.apache.org/licenses/)
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2025
Advanced Search