No Detail Found!

Feature Selection Using a Hybrid Approach: Harmony Search with Recurrent Neural Networks and Filter Methods on the Mimic-Iii Dataset

Author(s)
Preethi K Department of Computer Applications, School of Information Technology, Madurai Kamaraj University,Madurai, Tamilnadu,India
Ramakrishnan M Department of Computer Applications, School of Information Technology, Madurai Kamaraj University,Madurai, Tamilnadu,India
Abstract
Building reliable and effective prediction models requires careful feature selection, especially when working with complicated medical datasets. Applied to the Medical Information Mart for Intensive Care III (MIMIC-III) dataset, this study presents a novel hybrid method for feature selection that incorporates Harmony Search (HS), Recurrent Neural Networks (RNNs), and conventional Filter Methods. A wide range of clinical records, including vital signs, prescriptions, test results, and diagnostic codes, are included in the dataset. With the help of filter techniques, we guide the first feature ranking in our proposed method (HS-RNN-FM), which combines the deep learning characteristics of RNNs with the global optimization capabilities of Harmony Search. According to experimental data, HS-RNN-FM performs better in terms of precision, recall, accuracy, F1 -score, and AUC-ROC than conventional techniques like Genetic Algorithm with Mutual Information (GA-MI) and Particle Swarm Optimization with Chi-Square Test (PSO-Chi2). Due to its exceptional performance, HS-RNN-FM has the potential to improve predictive modeling in healthcare applications by handling huge and complicated datasets in an efficient manner.
Publication Details
Page(s) 290-309
DOI DOI not available
Published Journal: International Journal of Communication Networks and Information Security, Volume: 16, Issue: S1, Year: 2024

Request the full text from PASTIC

Keywords
Genetic Algorithm, Particle Swarm Optimization, Feature selection, Methods, Harmony Search, MIMIC-III Dataset, Medical Data Analysis, Recurrent Neural Networks (Rnns)
References
Chandrashekar G.,Sahin F. .2014 .A survey on feature selection methods. Computers & Electrical Engineering, 40(1) : 16-28.
Harutyunyan H.,Khachatrian H.,Kale D. C.,G. D. C. .2017 .Multitask learning and benchmarking with clinical time series data. Scientific data, 4 : 170075.
Breiman L. .2001 .. Random Forests. Machine Learning, 45(1) : 5-32.
Das S.,Suganthan P. N. .2011 .Differential Evolution: A Survey of the State-ofthe-Art. IEEE Transactions on Evolutionary Computation, 15(1) : 4-31.
Elman J. L. .1990 .. Finding Structure in Time. Cognitive Science, 14(2) : 179-211.
Geem Z. W.,Kim J. H.,Loganathan G. V. .2001 .A New Heuristic Optimization Algorithm: Harmony Search. , 76(2) : 60-68.
Guyon I.,Elisseeff A. .2003 .An Introduction to Variable and Feature Selection. Journal of Machine Learning Research, 3 : 1157-1182.
Guyon I.,Weston J.,Barnhill S.,Vapnik V. .2002 .Gene Selection for Cancer Classification using Support Vector Machines. Machine Learning, 46 : 389-422.
Hall M. A. .1999 .Correlation-based Feature Selection for Machine Learning. PhD thesis, : .
Johnson A. E. W.,Pollard T. J.,Shen L.,Lehman L. W. H.,Feng M.,Ghassemi M.,Mark R. G. .2016 .MIMIC-III, a Freely Accessible Critical Care Database. Scientific Data, 3 : 160035.
Kohavi R.,G. H. R. .1997 .Wrappers for feature subset selection. Artificial Intelligence, 97(1-2) : 273-324.
Lipton Z. C.,Kale D. C.,Elkan C.,Wetzel R. .2016 .Learning to Diagnose with LSTM Recurrent Neural Networks. ArXiv preprint arXiv: 1511, : 03677.
Rojas R.,Pomares H. .2018 .Genetic Algorithms for Feature Selection in Time Series Prediction. Neural Computing and Applications, 30(1) : 1-10.
Saeed M.,Villarroel M.,Reisner A. T.,Clifford G.,Lehman L. W.,Mark R. G. .2011 .Multiparameter Intelligent Monitoring in Intensive Care II (MIMIC-II): A Public-Access Intensive Care Unit Database. Critical Care Medicine, 39(5) : 952-960.
Tibshirani R. .1996 .Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1) : 267-288.
Trivedi H. N.,Mody N. .2017 .A Hybrid Feature Selection Approach Based on ReliefF and Genetic Algorithm. Procedia Computer Science, 122 : 857-865.
Johnson A. E.,Pollard T. J.,Shen L.,Lehman L. W.,Feng M.,Ghassemi M.,Mark R. G. .2016 .MIMIC-III, a freely accessible critical care database. Scientific data, 3 : 160035.
Holland J. H. .1992 .Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. , : .
Goldberg D. E.,J. H. D. E. .1988 .Genetic algorithms and machine learning. Machine learning, 3(2) : 95-99.
Cover T. M.,Thomas J. A. .2006 .Elements of information theory. , : .
Peng H.,Long F.,Ding C. .2005 .Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(8) : 1226-1238.
Eberhart R.,Kennedy J. .1995 .A new optimizer using particle swarm theory. In MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science, : 39-43.
Shi Y.,Eberhart R. C. .1998 .Parameter selection in particle swarm optimization. In International Conference on Evolutionary Programming, : 591-600.
Mahdavi M.,Fesanghary M.,Damangir E. .2007 .An improved harmony search algorithm for solving optimization problems. Applied mathematics and computation, 188(2) : 1567-1579.
Omran M. G.,Mahdavi M.,Ahmadi S. .2009 .Optimizing the harmony search algorithm with differential mutation. Communications in Nonlinear Science and Numerical Simulation, 14(7) : 2881-2889.
Graves A.,Mohamed A. R.,Hinton G. .2013 .Speech recognition with deep recurrent neural networks. In 2013 IEEE international conference on acoustics, speech and signal processing, : 6645-6649.
Mikolov T.,Karafiát M.,Burget L.,Cernocký J.,Khudanpur S. .2010 .Recurrent neural network based language model. In Eleventh annual conference of the international speech communication association., : .
0

Citations

0

Downloads

48

Views