No Detail Found!

A Comparative Analysis of Long Short-Term Memory Recurrent Neural Network Classifiers for Text Classification

Author(s)
Saeed Ullah Planning and Development Department, Government of KP, Pakistan
Jamal Uddin Qurtuba University of Science & Information Technology, Peshawar, Pakistan
Abstract
The classification of news text is hard due to tremendous variations in interpretations of text and events such as various groups and vast volume of text contents. Text recognition and classification are challenging research areas in artificial intelligence and machine learning. Deep learning is a type of machine learning that is widely used to build the recognition method for human behavior and text classification systems. A popular deep learning technique Recurrent Neural Network is used to identify the points of interest and remove the attributes from the text for the identification and classification of the human language. The Recurrent Neural Network is a form of neural network in which the output from the previous stage is fed to the current phase data. All inputs and outputs are independent of each other in standard neural networks. It is important to determine next term in a sentence in some situations; the prior words are needed to recall the previous words. Hence, Recurrent Neural Network came in with the aid of a hidden layer, which solved this problem. The hidden state is the primary and most significant function of Recurrent Neural Network. The Recurrent Neural Network is based on classifiers that use combination of layers. Long Short-Term Memory, Bi-Directional Long Short-Term Memory, Deeper Long Short-Term Memory and Deep Bi Directional Long Short-Term Memory are all Recurrent Neural Network layered base classifiers. They store the previous data block as well as the new data block and merge it into one row as output. In this research, these classifiers are analyzed for a better, generalize and efficient Long Short-Term Memory Recurrent Neural Network text classification classifier. For this purpose, the BBC news platform is selected for text classification. Experiments are conducted on mentioned classifiers and the simulation was done through MATLAB. The comparative findings are presented in form of tables and are analyzed for exploring a better classifier. It is also observed that different evaluation parameters had an effect on the process of text analysis. Deep Bi Directional Long Short-Term Memory has proven its efficiency and better performance comparatively for text classification on performance evaluation measures like Accuracy (74%), True Positive rate (90%), and False Positive rate (6%), Recall (90%), Precision (75%) and F-measure (74%).
Publication Details
Page(s) 46-73
DOI DOI not available
Published Journal: The Sciencetech, Volume: 2, Issue: 3, Year: 2021

Request the full text from PASTIC

Keywords
deep learning, Machine learning, Recurrent Neural Network, Convolution Neural Network, long short-term memory.
References
Asim M. N.,Wasim M.,Ali M. S.,Rehman A.,INTELLECT A. .2017 .Comparison of feature selection methods in text classification on highly skewed datasets. 1st International Conference on Latest Trends in Electrical Engineering and Computing Technologies, : 1-8.
Buzic D.,Dobsa J. .2018 .Lyrics classification using Naive Bayes. 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics, MIPRO 2018 - Proceedings, : 1011-1015.
Chen C. W.,Tseng S. P.,Kuan T. W.,Wang J. F. .2020 .Outpatient text classification using attention-based bidirectional LSTM for robot-assisted servicing in hospital. Information (Switzerland), 11(2) : .
Chen D.,Liu Z. .2010 .A new text categorization method based on HMM and SVM. ICCET, 7 : 383-386.
Chen Y.,Zhang Z. .2018 .Research on text sentiment analysis. , : .
. .A Comparative Analysis of Long Short-Term Memory Saeed. Jamal Intelligence and Lecture Notes in Bioinformatics), (4) : 8-107.
Prakash A.,Hasan S. A.,Lee K.,Datla V.,Qadir A.,Liu J.,Farri O. .2016 .Neural paraphrase generation with stacked residual LSTM Networks. COLING 2016 - 26th International Conference on Computational Linguistics, Proceedings of COLING 2016: Technical Papers, : 2923-2934.
Rhanoui M.,Mikram M. .2019 .A CNN-BiLSTM Model for Document-Level Sentiment Analysis. , : 832-847.
Silalahi M.,Hardiyati R.,Nadhiroh I. M.,Handayani T.,Amelia M.,Rahmaida R. .2018 .A text classification on the downstreaming potential of biomedicine publications in Indonesia. 2018 International Conference on Information and Communications Technology, ICOIACT, : 515-519.
Silva C.,Ribeiro B. .2006 .Scaling text classification with relevance vector machines. Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, 5 : 4186-4191.
Wang J.-H.,Luo X.,Wang L. .2018 .An LSTM Approach to Short Text Sentiment Classification with Word Embeddings. 2018 Conference on Computational Linguistics and Speech Processing ROCLING, 214 : 223.
Yin W.,Kann K.,Yu M.,Schütze H. .2017 .Comparative Study of CNN and RNN for Natural Language Processing. , : .
Young T.,Hazarika D.,Poria S.,Cambria E.,MCI E. .2018 .Recent trends in deep learning based natural language processing [Review Article]. IEEE Computational Intelligence Magazine, 13(3) : 55-75.
Zhang C.,Biś D.,Liu X.,He Z. .2019 .Biomedical word sense disambiguation with bidirectional long short-term memory and attention-based neural networks. BMC Bioinformatics, 20(Suppl 16) : 1-15.
Zhang S.,Lei M.,Yan Z.,Dai L. .2018 .Deep-FSMN for Large Vocabulary Continuous Speech Recognition. Speech and Signal Processing - Proceedings, 2018-April, : 5869-5873.
Zhelezniakov D.,Zaytsev V.,Radyvonenko O. .2019 .Acceleration of Online Recognition of 2D Sequences Using. , : .
Catala . .A Comparative Analysis of Long Short-Term Memory Saeed, Jamal Deep Bidirectional LSTM and Dynamic Programming. Advances in Computational Intelligence, 11507 : 030.
Zhou J.,Lu Y.,Dai H. N.,Wang H.,Xiao H. .2019 .Sentiment analysis of Chinese microblog based on stacked bidirectional LSTM. IEEE Access, 7 : 38856-38866.
Zhou P.,Qi Z.,Zheng S.,Xu J.,Bao H.,Xu B. .2016 .Text classification improved by integrating bidirectional LSTM with two-dimensional max pooling. COLING 2016 - 26th International Conference on Computational Linguistics, Proceedings of COLING 2016: Technical Papers, 2(1) : 3485-3495.
0

Citations

0

Downloads

8

Views