No Detail Found!

Deep learning based south indian sign language recognition by stacked autoencoder model and ensemble classifier on still images and videos

Author(s)
RAMESH MANOHAR BADIGER Computer Science Department, Tontadarya College of Engineering, Gadag 582101, India
DHARMANNA LAMANI Department of ISE, SDMIT, Ujire 574240, India
Abstract
Recently, sign or gesture recognition has been challenged by concerns like high computational cost, occlusion of hands, and inaccurate tracking of hand signs and gestures. The existing models face difficulty in managing longer term sequential data, due to poor information learning and processing. To highlight the aforementioned concerns, a novel deep learning based ensemble model is proposed in this article. Firstly, the sign/gesture images are acquired from American Sign Language (ASL)-Modified National Institute of Standard and Technology (MNIST) and real time South Indian Sign Language (SISL) databases. In addition, K-means clustering with the Gaussian blur method is implemented for precisely segmenting the sign/gesture region. Next, the feature extraction is carried-out using Gray-level Co-occurrence Matrix (GLCM) features and AlexNet, and then the dimensionality of the extracted feature vectors are decreased using a deep learning model: stacked autoencoder. The dimensionally decreased feature vectors are fed to the ensemble classifier (Multi-Support Vector Machine (MSVM) and Naive Bayes) to classify 24 alphabets and 30 SISL classes on the ASL-MNIST and real time SISL databases. The extensive experiments demonstrated that the ensemble based stacked autoencoder model achieved 99.96% and 99.08% of accuracy on the ASL-MNIST and real time SISL databases, which are better related to the traditional machine learning classifiers.
Publication Details
Page(s) 6587-6597
DOI DOI not available
Published Journal: Journal of Theoretical and Applied Information Technology, Volume: 100, Issue: 21, Year: 2022

Request the full text from PASTIC

Keywords
Naïve Bayes, Gesture, Stacked Autoencoder, Sign Language Recognition, K-means Clustering, Multi Support Vector Machine
0

Citations

0

Downloads

51

Views