Facial Expression Control System for VLC Media Player

Shaik Munawar; Potte Mounika; Badise Manoj; Mohammad
Sirajuddin

Author(s)

Shaik Munawar CSE, Kakatiya Institute of Technology and Science, Warangal, Telangana, India

Potte Mounika CSE(DS), CMR Technical Campus, Hyderabad, Telangana, India

Badise Manoj CSE, jyothishmathi Institute of Technology and Science, Karimnagar, Telangana, India.

Mohammad Sirajuddin CSE , Vaageswari College of engineering, Karimnagar, Telangana, India

Abstract

Computer vision research increasingly focuses on face detection recognition in the context of sign language interpretation and humancomputer interaction. The present proposed system is an illustration of a vision-based HCI, which facilitates efficient, and natural communication between people and computers through the use of cameras and image processing algorithms. This project presents a novel approach to interface design, leveraging mouth gestures for controlling the VLC Media Player, a widely used multimedia application. Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), two deep learning methods, are used to teach the system to recognize and categorize a variety of predefined mouth motions with accuracy. Through the utilization of computer vision techniques, specifically facial landmark detection and gesture recognition, the system interprets a user's oral movements to execute corresponding commands within the VLC Media Player. It's particularly aimed at assisting individuals who are severely disabled or paralyzed, offering them a new level of independence when interacting with digital media. This proposed system's main objective is to establish a system, which able to recognize facial expressions and for directing the media player. This project advances humancomputer interaction by introducing a novel interface paradigm that utilizes facial gestures' expressive capabilities.

Publication Details

Page(s) 263-270

DOI DOI not available

Published Journal: International Journal of Communication Networks and Information Security, Volume: 16, Issue: 3, Year: 2024

Request the full text from PASTIC

Keywords

Convolutional neural networks, Deep learning, human-computer interaction, Gesture, Hands-free Interface, eol>Webcam, Facial Detection, VLC Media Player, Mouth Gesture Recognition

References

.2009 .Lip movement and gesture recognition for a multimodal human computer interface”. , : .

.2017 .Deep Learning-based Facial Expression Recognition for Monitoring Neurological Disorders”. IEEE International Conference on Bioinformatics and Biomedicine (BIBM), : .

Bilvika K,Tejaswini. K .2021 .Face and Hand Gesture Recognition System for Controlling VLC Media Player. International Journal of Scientific Research in Science and Technology. 119-124, : 10.

Archajo Marcelo,Roseli de Deus Lopes Marcelo,January 2015 . .Human computer interface controlled by lip”. IEEE Journal of Biomedical and Health Informatics, 19 : .

J. -B. Gomez A.,Ceballos F.,Prieto T.,Redarce T. .2009 ."Mouth gesture and voice command based robot command interface,". 2009 IEEE International Conference on Robotics and Automation, 5152858 : 333-338.

Niu ,McCrickard Scott. .2018 .Tongue-able Interfaces: Prototyping and Evaluating Camera Based Tongue Gesture Input System. Smart Health, 03 : .

Algorri M. E.,Escobar A. .2004 ."Facial gesture recognition for interactive applications,". ENC, 1342605 : 188-195.

Tan Gemicioglu,Winters R. Michael,Yu-Te Wang,Thomas M. Gable Ivan J.,Tashev Ivan J.,Sapaico L. R.,Laga H.,Nakajima M.,Shuo Niu,McCrickard D. Scott,Sapaico L. R.,Laga H.,Nakajima M. .2011 .Detection of tongue protrusion gestures from videos. IEICE TRANSACTIONS on Information and Systems, E94-D(8), 5457529 : 1671-1682.