Intelligent Information Retrieval from Unstructured Data using Natural Language Processing

Muhammad Yusuf Khan; Syed Zain Ali; Muhammad Hassan Sohail; Muhammad Wasim; Lubaid Ahmed

Author(s)

Muhammad Yusuf Khan Department of Computer Science, Usman Institute of Technology Karachi Country , Pakistan

Syed Zain Ali Department of Computer Science, Usman Institute of Technology Karachi Country , Pakistan

Muhammad Hassan Sohail Department of Computer Science, Usman Institute of Technology Karachi Country , Pakistan

Muhammad Wasim Department of Computer Science, Usman Institute of Technology Karachi Country , Pakistan

Lubaid Ahmed Department of Computer Science, Usman Institute of Technology Karachi Country , Pakistan

Abstract

Companies and recruitment agencies required to go through tons of Curriculum Vitae every day to find suitable candidates, which is inefficient if done manually by a recruiter. In this paper, an automatic system is proposed for the selection of best candidate. This proposed model can take out all the vital information from the unstructured curricula vitae and transform them into the structured format. It will also allow recruiters to filter and search for only relevant data within the structured curricula vitae. This proposed model uses different techniques of data extraction, natural language processing and named entity recognition for converting unstructured information into the structured information.

Publication Details

Page(s) 51-58

DOI DOI not available

Published Journal: Journal of Information & Communication Technology (JICT), Volume: 17, Issue: 2, Year: 2023

Request the full text from PASTIC

Keywords

natural language processing, Information extraction, Named Entity Recognition, Filtering unstructured Curriculum Vitae

References

Sander P. .2023 .. Machine Learning and Artificial Intelligence in Radiation Oncology, : 137-161.

Manogaran C.,Thota D.,Lopez D.,Applications D. .2022 .IGI global. in Research Anthology on Big Data Analytics, : 1578-1596.

Pouyanfar S. .2018 .Multimedia big data analytics: A survey. ACM computing surveys (CSUR), 51(1) : 1-34.

Ghosh S.,Roy S.K.,Bandyopadhyay S.K. .2012 .A tutorial review on Text Mining Algorithms. International Journal of Advanced Research in Computer and Communication Engineering, 1(4) : 7.

Hirschberg ,C.D. Manning .2015 .Advances in natural language processing. Science, 349(6245) : 261-266.

Collins M.,Singer Y. .1999 .Unsupervised models for named entity classification. in SIGDAT conference on empirical methods in natural language processing and very large corpora, : .

Patil N.,Patil A.,Pawar B. .2020 .Named entity recognition using conditional random fields. Procedia Computer Science, 167 : 1181-1188.

Chiu J.P. .2016 .Named entity recognition with bidirectional LSTM-CNNs. Transactions of the association for computational linguistics. , : 357-370.

Devlin J. .2018 .Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, : .

Siefkes C.,Siniakov P. .2005 .An overview and classification of adaptive approaches to information extraction. Journal on Data Semantics IV, : 172-212.

Huang ,C.-C. .2014 .Cross-lingual information to the rescue in keyword extraction. in Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, : .

Patil N. .2017 .Candidate recruitment system by using keyword based searching. International Research Journal of Engineering and Technology, 4(3) : 24-26.

. .Introducing spacy. 2016 [cited 2024 February, 19 : .

Andor D. .2016 .Globally normalized transition-based neural networks. arXiv preprint arXiv:1603.06042, : .

Li Y. .2017 .Mison: a fast JSON parser for data analytics. Proceedings of the VLDB Endowment, 10(10) : 1118-1129.

Joshi A.K. .1991 .. Natural language processing. Science, 253(5025) : 1242-1249.

Kumar L.,P.K. Bhatia L. .2013 .Text mining: concepts, process and applications. Journal of Global Research in Computer Science, 4(3) : 36-39.

Tan A.-H. . .Text mining: The state of the art and the challenges. 1999. Citeseer. 57, : .

Yuyao G. .2024 .Integrated modeling for retired mechanical product genes in remanufacturing: A knowledge graphbased approach. Advanced Engineering Informatics, 59 : 102254.

Pan Y.a.F. .2024 .JinXia and Zhu, ChunTing and Li, Minda and Wu, HuiQun, Towards an Automatic Transformer to Fhir Structured Radiology Report Via Gpt-4. , : .

Armary P. .2024 .CIAD System for Geographical Entity Detection at TextMine'24. , : .

Saout T.,Lardeux F.,Saubion F. .2024 .An Overview of Data Extraction From Invoices. IEEE Access, 12 : 19872-19886.

Jiang J. .2012 .Information extraction from text. Mining text data, : 11-41.

Sanyal S. .2017 .Resume parser with natural language processing. International Journal of Engineering Science, 4484 : .

Ma L. . .Information extraction from unstructured document. , : .

Francis L.,Flynn M.,Text Mining Handbook Casualty Actuarial Society E Forum M. .2010 .. , : .

MURZABULATOV A. .2015 .The problem of resume overload during talent acquisition. , : .

Gupta G.S.,Lehal G.S. .2009 .A survey of text mining techniques and applications. Journal of emerging technologies in web intelligence, 1(1) : 60-76.

Aggarwal C.C. . .Mining text streams. in Mining text data. 2012, : 297-321.

Gabriel P.,Gluchowski P.,Pastwa A. .2009 .W3l GmbH. , : .

Nigam Jigyasa,S.S. Jigyasa .2015 .Fast and Efective System for Name Entity Recognition on Big Data. International Journal of Computer Sciences and Engineering, 3(2) : 31-35.

Khan I.A. .2015 .Eficient Techniques for Improved Data Classification and POS Tagging by Monitoring Extraction, Pruning and Updating of Unknown Foreign Words. , : .

.2022 .. ChatGPT. November 30, : .

Iftene A.,Balahur-Dobrescu A. .2008 .Named Entity Relation Mining using Wikipedia. in LREC, : .

DELL . .. 2022 [cited 2024 February, 19 : .

. .Apache tika. 2007 [cited 2024 February, 19 : .

.2022 .. Whisper. September 21, : .

Yashodhya V.W. .2024 .A phrase-based questionnaireanswering approach for automatic initial frailty assessment based on clinical notes. Computers in Biology and Medicine, 170 : 108043.

Stadermann J.,Jager D.,Zernik U.,Patents Google .2020 .Hierarchical information extraction using document segmentation and optical character recognition correction. , : .

Zhou G.,Su J. .2002 .Named entity recognition using an HMMbased chunk tagger. in Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, : .

Huang D.,Patents Google .2017 .Means to process hierarchical json data for use in a flat structure data system. , : .

Han J,Pei J.,Kamber M. . .Data mining: concepts and techniques. 2011: Elsevier., : .

Kantardzic M. . .Data mining: concepts, models, methods, and algorithms. , : .