Open Access   Article Go Back

Gift of Voice to Mute: Hand Gestures Converted to Text and Voice

Seher Taneja1 , Mandeep Sukhija2

  1. Dept. of Physics, Springdales School, Dhaula Kuan, New Delhi, India.
  2. Dept. of Physics, Springdales School, Dhaula Kuan, New Delhi, India.

Section:Technical Paper, Product Type: Journal Paper
Volume-8 , Issue-4 , Page no. 64-69, Apr-2020

CrossRef-DOI:   https://doi.org/10.26438/ijcse/v8i4.6469

Online published on Apr 30, 2020

Copyright © Seher Taneja , Mandeep Sukhija . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

View this paper at   Google Scholar | DPI Digital Library

How to Cite this Paper

  • IEEE Citation
  • MLA Citation
  • APA Citation
  • BibTex Citation
  • RIS Citation

IEEE Style Citation: Seher Taneja , Mandeep Sukhija, “Gift of Voice to Mute: Hand Gestures Converted to Text and Voice,” International Journal of Computer Sciences and Engineering, Vol.8, Issue.4, pp.64-69, 2020.

MLA Style Citation: Seher Taneja , Mandeep Sukhija "Gift of Voice to Mute: Hand Gestures Converted to Text and Voice." International Journal of Computer Sciences and Engineering 8.4 (2020): 64-69.

APA Style Citation: Seher Taneja , Mandeep Sukhija, (2020). Gift of Voice to Mute: Hand Gestures Converted to Text and Voice. International Journal of Computer Sciences and Engineering, 8(4), 64-69.

BibTex Style Citation:
@article{Taneja_2020,
author = {Seher Taneja , Mandeep Sukhija},
title = {Gift of Voice to Mute: Hand Gestures Converted to Text and Voice},
journal = {International Journal of Computer Sciences and Engineering},
issue_date = {4 2020},
volume = {8},
Issue = {4},
month = {4},
year = {2020},
issn = {2347-2693},
pages = {64-69},
url = {https://www.ijcseonline.org/full_paper_view.php?paper_id=5076},
doi = {https://doi.org/10.26438/ijcse/v8i4.6469}
publisher = {IJCSE, Indore, INDIA},
}

RIS Style Citation:
TY - JOUR
DO = {https://doi.org/10.26438/ijcse/v8i4.6469}
UR - https://www.ijcseonline.org/full_paper_view.php?paper_id=5076
TI - Gift of Voice to Mute: Hand Gestures Converted to Text and Voice
T2 - International Journal of Computer Sciences and Engineering
AU - Seher Taneja , Mandeep Sukhija
PY - 2020
DA - 2020/04/30
PB - IJCSE, Indore, INDIA
SP - 64-69
IS - 4
VL - 8
SN - 2347-2693
ER -

VIEWS PDF XML
552 603 downloads 206 downloads
  
  
           

Abstract

Though Sign language using gestures and facial expressions helps deaf and dumb people to express their thoughts, normal people do not learn sign language and therefore not able to comprehend it thus causing a barrier between the two and a big cause of frustration. With the objective to lower the barrier in communication by opening up conversations between signers and speakers, we have converted sign language to text and speech using flex sensors, Arduino Uno, HC-05: Bluetooth and a mobile device as the hardware and Arduino IDE and MIT App Inventor as the software. Normal driving gloves have been converted to wireless data smart gloves by fitting them with flex sensors along the length of each finger and the thumb and accelero sensor. The signals are passed on Arduino Uno which converts analog signal from the sensors to digital signals. The signal is then passed on to a Bluetooth device HC-05.Then signal is transmitted to a mobile device on a Bluetooth app. Signal is then converted into a voice message. This low cost solution is affordable, portable and easily customizable with additional Feature for GPS location for safety purposes.

Key-Words / Index Term

Sign language, Flex sensor, Arduino Uno, Gestures, MIT App Inventor

References

[1]. J. Thilagavathy, A.J. Murugan, S. Darwin, “ Embedded Based Hand Talk Assisting System for Deaf and Dumb”, International Journal of Engineering Research & Technology, Vol. 3, Issue.,3, pp. 318-321,2014
[2]. R.R Itkarkar, A.V.Nandi, “Hand gesture to Speech Conversion Using MATLAB”, 4th ICCCNT,Tiruchengode, India,2013
[3]. O.Khandeshe, V.Salvi, V.Gawade, S.Varia, R.Molawade, “A Comparative study On Gesture control voice command Over Android Device”, International Journal of Modern Engineering Research, Vol.9, Issue 1, pp.33-37, 2019
[4]. M.A Ahmed, B.B ZAidan, A.A ZAidan, M.M Salih, M.M.B Lakulu, “A Review on Systems-Based Sensory Gloves for Sign Language Recognition State of the Art between 2007 and 2017, Sensors(Basel), Vol.18, Issue 7,2018
[5]. M.Tawde, H.Singh, S.Shaikh, “Glove for Gesture Recognition using Flex Sensor”, International Journal of Recent Trends in Engineering & Research”, Vol 03, Issue 03, pp. 35-39, 2017
[6]. P.Y.Ingle, R.Kumar, “Let’s Talk model for converting Gesture to voice using hand glove and IOT”, International Journal of Computer Sciences and Engineering, Vol. 7, Issue., 5,pp.806-809,2019
[7]. T. Jaya, Rajendran .V, "Hand-Talk Assistive Technology for the Dumb," International Journal of Scientific Research in Network Security and Communication, Vol.6, Issue.5, pp.27-31, 2018