Advancements in Natural Language Processing: Enhancing Machine Understanding of Human Language in Conversational AI Systems | [International Journal of Communication Networks and Information Security • 2024]

Author(s):

1. Kavita D. Hanabaratti: Department of CSE, K.L.S Gogte Institute of Technology, Visvesvaraya Technological University,Belagavi,India

2. Ashwini S Shivannavar: Department of Electronics and Communication, Sri Siddhartha Institute of Technology,SSAHE, Tumakuru,

3. Sujit N. Deshpande: Assistant Professor, Department of Computer Engineering, PES's Modern College of Engineering,Pune,

4. Rajesh V. Argiddi: Department of Computer Science and Engineering, Walchand Institute of Technology,Solapur,

5. RVS Praveen: Digital Engineering and Assurance, LTIMindtree Limited, M/s. Divija Commercial Properties THE SKYVIEW-Building No. 20, Serlingampally Mandal, Hyderabad, Telangana,

6. Suhasini A. Itkar: Department of Computer Engineering, PES's Modern College of Engineering,Pune,

Abstract:

This paper aims to review the recent developments in Natural Language Processing and their implications to the improvement of current comprehension in conversational AI interfaces. The comparison of four leading NLP models, namely BERT, GPT, T5 and XLNet is carried out systematically with respect to the major tasks of conversational interfaces including text generation, sentiment analysis and question answering. Based on the performance predicate that I used, it is clear that BERT has a 91% accuracy level. 5%, GPT 88. 2%, T5 89. 6%, and XLNet 90. 3%. Precision scores were precise to the second decimal place for BERT at 92. of reserves as 1%, while keeping GPT at 87%. 9%, T5 at 88. 5%, while last comes the averagely performing XLNet at 89. 7%. On the aspect of recall rates, BERT had a slightly better performance at 90.8%, GPT at 86. 5%, T5 at 87. ; 87% BERT, 88% RoBERTa, 89% XLNet. 2%. The recognized F1-scores were as well highest in BERT where it obtained 91. 4%, and XLNet at 89%. 5%, T5 at 88. Metcash Group Ltd at 17, Coles Group at 28, Woolworths at 10 Metcash Ltd at 6% and GPT at 87. 7%. This paper shows that BERT surpasses GPT-T5 in terms of accuracy and precision; however, GPT and T5 are better suited for text generation applications. These models contain theoretical and practical value in analyzing their advantages and drawbacks, which makes the base for choosing the suitable tools of NLP for definite uses and developed future conversational AI appliances.

Page(s): 193-204

DOI: DOI not available

Published: Journal: International Journal of Communication Networks and Information Security, Volume: 16, Issue: 4, Year: 2024

Keywords:

natural language processing , BERT , GPT , Conversational AI , Model Evaluation

References:

[1] ALABBAS A.,ALOMAR K. .2024 .Tayseer: A Novel AI-Powered Arabic Chatbot Framework for Technical and Vocational Student Helpdesk Services and Enhancing Student Interactions. Applied Sciences, 14(6) : 2547.

[2] ALAWIDA M.,MEJRI S.,MEHMOOD A.,CHIKHAOUI B.,OLUDARE I.A. .2023 .A Comprehensive Study of ChatGPT: Advancements, Limitations, and Ethical Considerations in Natural Language Processing and Cybersecurity. , 14(8) : 462.

[3] AL-KHALIFA H.,T. H. .2024 .. Natural Language Processing Patents Landscape Analysis. Data, 9(4) : 52.

[4] ALKHOURI K.I. .2024 .The Role of Artificial Intelligence in the Study of the Psychology of Religion. , 15(3) : 290.

[5] ALOWAIS S.A.,ALGHAMDI S.S.,ALQAHTANI N.,ALSHAYA T.,A.I. T.,ALDAIREM S.N.,ALRASHED A.,M. A.,KHALID A.,B.S. A.,AL H.A.,YAMI H.A.,S. H.A.,S.A. H.A.,ALBEKAIRY H.A.,A.M. H.A. .2023 .Revolutionizing healthcare: the role of artificial intelligence in clinical practice. BMC Medical Education, 23 : 1-15.

[6] ANAS A. .2024 .Redefining Healthcare With Artificial Intelligence (AI): The Contributions of ChatGPT, Gemini, and Co-pilot. Cureus, 16(4) : .

[7] BAO Y.,GONG W.,YANG K. .2023 .A Literature Review of Human-AI Synergy in Decision Making: From the Perspective of Affordance Actualization Theory. Systems, 11(9) : 442.

[8] BEKBOLATOVA M.,MAYER M.,J. M.,TOMA W.O.,M. W.O.,Perspectives Public .2024 .Transformative Potential of AI in Healthcare: Definitions, Applications, and Navigating the Ethical Landscape. , 12(2) : 125.

[9] CADEDDU A.,CHESSA A.,DE LEO,FENU LEO,MOTTA G.,OSBORNE E.,RECUPERO F.,D.R. F.,SALATINO F.,A. F.,SECCHI F.,L. F. .2024 .Optimizing Tourism Accommodation Offers by Integrating Language Models and Knowledge Graph Technologies. , 15(7) : 398.

[10] CORDOŞ A.,ŞTEFANIGĂ S.,MUNTEAN C. .2024 .Leveraging ChatGPT for Digital Healthcare Speech Writing. , 46(1) : 1-11.

[11] DONG-HWI K.,WOO-HYEOK SON,SUNG-SHIN K.,TAE-HYEON YUN,JAE-DONG L. .2023 .A Hybrid Deep Learning Emotion Classification System Using Multimodal Data. , 23(23) : 9333.

[12] ETHAPE P.,KANE P.,R. P.,G. P.,CHIMANE S. .2023 .and. International Research Journal of Innovations in Engineering and Technology, 7(11) : 603-610.

[13] FARAZ A.,AHSAN F.,MOUNSEF J.,KARAMITSOS J.,I. J.,KANAVOS J.,A. J. .2024 .Enhancing Child Safety in Online Gaming: The Development and Application of Protectbot, an AI-Powered Chatbot Framework. , 15(4) : 233.

[14] GAO Q. .2024 .Intelligent Recognition of Tool Wear with Artificial Intelligence Agent. , 14(7) : 827.

[15] HAASE J.,W. J.,MENDLING J.,J. J.,ONNASCH J.,L. J.,PLATTFAUT J. .2024 .Interdisciplinary Directions for Researching the Effects of Robotic Process Automation and Large Language Models on Business Processes. Communications of the Association for Information Systems, 54 : 28.

[16] HAi V.P.,MOORE P. .2024 .Applied Hedge Algebra Approach with Multilingual Large Language Models to Extract Hidden Rules in Datasets for Improvement of Generative AI Applications. , 15(7) : 381.

[17] HASSANI H.,SILVA E.S. .2023 .The Role of ChatGPT in Data Science: How AIAssisted Conversational Interfaces Are Revolutionizing the Field. Big Data and Cognitive Computing, 7(2) : 62.

[18] IZADI S.,FOROUZANFAR M. .2024 .Error Correction and Adaptation in Conversational AI: A Review of Techniques and Applications in Chatbots. Ai, 5(2) : 803.

[19] LEMOS M.,CARDOSO M.,P.J.S. M.,J.M.F. RODRIGUES .2024 .Harnessing AI and NLP Tools for Innovating Brand Name Generation and Evaluation: A Comprehensive Review. Multimodal Technologies and Interaction, 8(7) : 56.

[20] LI X.,LI Y. .2024 .. Deep Learning and Natural Language Processing Technology Based Display and Analysis of Modern Artwork. Journal of Electrical Systems, 20(3) : 1636-1646.

[21] MADUSHANKA S.,SAMARASEKARA N.,HERATH T.,SAMARAKOON T.,U. T. .2023 .AI-Based Movie Content Rating and Recommendation System. International Research Journal of Innovations in Engineering and Technology, 7(11) : 120-126.

[22] MANOGNYA L.R.,HARSHA G.N.,PRANAV K.,S. K.,MANOJ K.H.,Detective.AI - A Pdf Referencing Docu .2024 .Chatbot. International Research Journal of Innovations in Engineering and Technology, 8(4) : 318-322.

[23] MIAO J.,SUPPADUNGSUK C.,GARCIA S.,VALENCIA S.,O. S.,QURESHI A.,CHEUNGPASITPORN F. .2024 .Ethical Dilemmas in Using AI for Academic Writing and an Example Framework for Peer Review in Nephrology Academia: A Narrative Review. Clinics and Practice, 14(1) : 89.

[24] MIAO J.,SUPPADUNGSUK C.,S. C.,RADHAKRISHNAN P.,CHEUNGPASITPORN Y. .2024 .Chain of Thought Utilization in Large Language Models and Application in Nephrology. , 60(1) : 148.

[25] NADARZYNSKI T.,KNIGHTS N.,HUSBANDS D.,LLEWELLYN C.A.,BUCHANAN C.D.,T. C.D.,RIDGE C.D.,D. C.D. .2024 .Achieving health equity through conversational AI: A roadmap for design and implementation of inclusive chatbots in healthcare. PLOS Digital Health, 3(5) : .

[26] OLUJIMI P.A.,ADE-IBIJOLA A. .2023 .NLP techniques for automating responses to customer queries: a systematic review. Discover Artificial Intelligence, 3(1) : 20.

[27] Sharma Neha .2023 .Human Resource Management Model with ICT Architecture: Solution of Management & Understanding of Psychology of Human Resources and Corporate Social Responsibility”. 9s(2), 6 : 219-230.

[28] William P.,Shrivastava A.,Chauhan P.S.,Raja M.,Ojha S.B.,Kumar K.,Tripathi N.,Jain C.,Kumar S.,D S. .2023 .Natural Language Processing Implementation for Sentiment Analysis on Tweets. Radio Communications and 5G Networks. Lecture Notes in Networks and Systems, 588 : 26.

[29] Maheswari K.,Ahmad Y. A.,Bani Ahmad .2023 .Enterprise Human Resource Management Model by Artificial Intelligence to Get Befitted in Psychology of Consumers Towards Digital Technology”. 10s(2), 6 : 209-220.

[30] Shrivastava Anurag,Suji S. J.,Prasad S. J.,Mani P. .2023 .: IoT Based RFID Attendance Monitoring System of Students using Arduino ESP8266 & Adafruit.io on Defined Area, Cybernetics. , : .

[31] William P.,Lanke G. R.,Bordoloi D.,Shrivastava A.,Srivastavaa A. P.,Deshmukh S. V. .2023 ."Assessment of Human Activity Recognition based on Impact of Feature Extraction Prediction Accuracy,". 2023 4th International Conference on Intelligent Engineering and Management (ICIEM), 10166247 : 1-6.

[32] William P.,Lanke G. R.,Inukollu V. N. R.,Singh P.,Shrivastava A.,Kumar R. .2023 ."Framework for Design and Implementation of Chat Support System using Natural Language Processing,". 2023 4th International Conference on Intelligent Engineering and Management (ICIEM), 10166939 : 1-7.

[33] ORTIZ-GARCES I.,GOVEA I.,J. I.,ANDRADE I.,VILLEGAS-CH R.O.,W. R.O. .2024 .Optimizing Chatbot Effectiveness through Advanced Syntactic Analysis: A Comprehensive Study in Natural Language Processing. Applied Sciences, 14(5) : 1737.

[34] PANAGOULIAS D.P.,VIRVOU M.,TSIHRINTZIS M.,G.A. M. .2024 .Augmenting Large Language Models with Rules for Enhanced Domain-Specific Interactions: The Case of Medical Diagnosis. , 13(2) : 320.

[35] PDF .2024 .Impact of Contradicting Subtle Emotion Cues on Large Language Models with Various Prompting Techniques. International Journal of Advanced Computer Science and Applications, 15(4) : .

[36] PDF .2024 .Unified Approach for Scalable Task-Oriented Dialogue System. International Journal of Advanced Computer Science and Applications, 15(4) : .

Citations

Downloads

Views