GURU GOBIND SINGH FOUNDATIONS
GURU GOBIND SING POLYTECHNIC NASHIK- 422009
DEPARTMENT OF ELECTRONIC AND TELE- COMUNICATION ENGINEERING
REPORT ON
Sign Language System for Deaf People Using Arduino
SUBMITTED BY:
Shubham Palve
Rushikesh Pund
Om Kale
Deep Musle
UNDER THE GUIDANCE OF
Prof. Mrs. S.V. KARANDE
COURSE
Diploma in Electronics and Telecommunication Engineering
Submitted from Third Year to MSBTE, Mumbai
2021-2022
Page 1 of 15
ACKNOWLEDGEMENT
The project report is an opportunity to acknowledge our sincere gratitude
towards
all those who helped, guided, and inspired during study.
We would like to thank our guide Respected Prof.Mrs. S.V. Karande for
constantly upgrading us latest news as far as our seminar work is concerned and
being source of enlightenment and thus providing us right approach and
providing all facilities which have been helped this seminar to be a successful.
We are also thankful to Respected HOD Prof.Mrs. S.V. Karande, for helping
us time to time.
Last not but least, we extend our special thanks to our Honorable Principal
Prof. Mr. S.R. Upasani who canalized our effort in right direction and gives us
great pleasure to work for this seminar.
We are also thankful to our sponsor Mr. B.V.Dhundale, who is the director of
CREAATIVE POWERTECH PVT. LTD. NASHIK
We are also thankful to our family members and all friends who directly or
indirectly helped us in completing this seminar.
Above all by grace of God we could achieve it successfully.
Project Guide H.O.D. Principal
Prof.Mrs. S.V. Karande Prof.Mrs. S.V. Karande Prof.Mr. S.R. Upasani
Seal of the
Institute
Page 2 of 15
ABSTRACT
The easiest way for communication in the world is speech. Whereas it becomes
difficult for speech impaired and hearing-impaired people to communicate as
they use sign language for the communication. It becomes difficult for normal
people to understand. Smart Glove for Sign Language Translation is a work that
aims to present an easy way of communication for speech impaired and hearing-
impaired people. This work consists of a glove equipped with sensors which
senses different sign language gesture, these senses data are fed to Arduino and
transfer data to android phone via Bluetooth module, a common android phone
is used in this work for sign to voice translation and voice to sign language
translation. In real life, the sign language users mostly use both hands. Thus,
this is a prototype work presenting an ease in communication for the speech
impaired and hearing-impaired people.
Page 3 of 15
Content Page:
Sr. No. Contents Page No.
1. Chapter-1 Introduction and background of the 5
Industry or User based problem
2. Chapter-2 literature Survey for Problem 6
Identification and Specification
3. Chapter-3 Proposed Detailed Methodology of 7-12
solving the identified problem with action plan
4. Action Plan 13-14
5. References and Bibliography 15
Page 4 of 15
1. INTRODUCTION:
The number of speech impaired and hearing-impaired people are increasing day by day.
About 70 million people in the world are speech impaired and hearing impaired. We often
come across these people communicating with the normal world. These people communicate
with the help of sign language. When a speech impaired person tries to communicate with
normal person and vice-versa, they feel difficult to understand. To bridge the gap between
speech impaired, hearing impaired and normal masses, gesture recognition system is being
used. Gesture recognition is a widely explored field. A lot of work has been done in the past
few years. An electronic device has been used as a language interpreter and provides
convenient way for communication between speech impaired, hearing impaired and normal
people. Gesture for American standard language is shown in figure 1. Gesture recognition is
classified into two main categories i.e., image processing based and sensor based. The main
disadvantage of image processing-based techniques includes complex algorithms for data
processing. Another challenge in image and video processing includes variant lighting
conditions, backgrounds and field of view constraints. The sensor-based technique offers
greater mobility.
Figure 1: American Standard Sign Language
This work uses sensor-based technique instead of image processing-based technique. First of
all, sign language is converted to analog voltage signal using flex sensor and accelerometer.
Using ADC from the microcontroller board analog signal is converted to digital signal. Now,
the microcontroller processes this digital signal, detects respective characters and transmits
through Bluetooth module to Android phone. An application on android is used to display the
characters received from Bluetooth module in the form of text and text is transformed to
voice using Google-text-to-speech. Also, voice is transformed to display text and convert it
into sign language using speech recognizer.
Page 5 of 15
2. LITERAURE SURVEY:
Sign language is the only communication tool used by speech impaired and hearing-impaired
people to communicate to each other. However, normal people do not understand sign
language and this will create a large communication barrier between speech impaired,
hearing impaired and normal people. In addition, the sign language is also not easy to learn
due to its natural differences in sentence structure and grammar. Therefore, there is a need to
develop a system which can help in translating the sign language into voice and voice to sign
language in order to ensure effective and easy communication between different
communities.
Many methods for hand gesture recognition using image processing have been proposed.
“Hand Gesture Recognition System using Image Processing” uses digital image processing
techniques using modified SIFT algorithm. With the help of the algorithm the sign language
is decoded successfully. The advantage using this algorithm is high processing speed which
can produce result in real time. Although the proposed system is fast requiring expensive
materials
also.
“Sign Language Recognition Using Image Processing” uses image processing with the help
of SURF (Speed up Robust Features) algorithm. Video camera is used to record hand
movements, and the input video is partitioned into frames, for each frame, a set of features
are extracted. The system is implemented in TINKERCAD.
“Digital Text and Speech Synthesizer Using Smart Glove for Deaf and Dumb” uses five flex
sensors to detect gesture and accelerometer used for sensing axis x, y and z, find the angle of
the glove tilted with respect to the. The glove is capable of translating their sign language
gestures into speech through android phone. This smart glove focuses the translation of
gestures of words only.
“Smart Glove: Gesture Vocalizer for Deaf and Dumb People” uses glove at the transmitter
side which has to be worn by the user. This glove is mounted with 4 flex sensors each on the
4 fingers of the glove namely thumb, index, middle and ring. This work also focuses the
translation of gestures of words only.
Page 6 of 15
3 PRPOSED METHODOLOGY OF SOLVING IDENTIFIED
PROBLEM:
3.1 Block Diagram of Proposed System
Figure 3.1: Block Diagram
3.2 Working
This glove is total works on the sensors. which are having the 5 sensors on 5 fingers. means
one sensor on one finger respectively. and these sensors are the flex sensor. when we flex
these sensors the value of the reading gets changes. so, we will use this reading in our
application. the flex sensor varies the values from 0 to 1023, so you have to modify your code
according to the sensor value. we put all these sensors over the glove as we bent our finger
the flex sensor also will be bent. so, when we bent our finger, the reading got changed and the
Arduino send the value on the LCD screen. for example, if we bent our first finger then the
sentence on the LCD will be “I need food”. and if I bent my thumb then it will show “I need
water”. same condition for the rest three fingers also.
3.2.1 ARDUINO UNO
The Arduino Uno is an open-source microcontroller board based on
the Microchip ATmega328P microcontroller and developed by Arduino.cc. The board is
equipped with sets of digital and analog input/output (I/O) pins that may be interfaced to
various expansion boards (shields) and other circuits. The board has 14 digital I/O pins (six
capable of PWM output), 6 analog I/O pins, and is programmable with the Arduino
IDE (Integrated Development Environment), via a type B USB cable. It can be powered by
the USB cable or by an external 9-volt battery, though it accepts voltages between 7 and 20
volts. It is similar to the Arduino Nano and Leonardo
Page 7 of 15
3.2.2 Flex Sensors
A flex sensor or bend sensor is a sensor that measures the amount of deflection or bending.
Usually, the sensor is stuck to the surface, and resistance of sensor element is varied by
bending the surface. Since the resistance is directly proportional to the amount of bend it is
used as goniometer, and often called flexible potentiometer.
3.2.3 16×2 LCD
An LCD screen is an electronic display module that uses liquid crystal to produce a visible
image. The 16×2 LCD display is a very basic module commonly used in DIYs and circuits.
The 16×2 translates o a display 16 characters per line in 2 such lines. In this LCD each
character is displayed in a 5×7-pixel matrix.
3.2.4 Potentiometer
A potentiometer is a three-terminal resistor with a sliding or rotating contact that forms an
adjustable voltage divider. If only two terminals are used, one end and the wiper, it acts as
a variable resistor or rheostat.
The measuring instrument called a potentiometer is essentially a voltage divider used for
measuring electric potential (voltage); the component is an implementation of the same
principle, hence its name.
3.2.5 Resistor
A resistor is a passive two-terminal electrical component that implements electrical
resistance as a circuit element. In electronic circuits, resistors are used to reduce current flow,
adjust signal levels, to divide voltages, bias active elements, and terminate transmission lines,
among other uses.
Page 8 of 15
4. CIRCUIT DIGRAM
Figure 4.1: Circuit Diagram
4.1Circuit Diagram Description:
In the circuit there are three major parts, Arduino UNO, Flex sensors and 16×2 LCD display.
Flex sensors have some values, if we flex the sensor value gets changed and we get the signal
to Arduino board.
As per the signal from sensors Arduino board generates output signal for 16×2 LCD display,
and the desired signal or statement gets display on the 16×2 LCD display.
For eg., I need water, I’m hungry, etc.
Page 9 of 15
4.2 Flowchart
Figure 4.2: Flowchart
Page 10 of 15
5. SOFTWARE DETAILS
5.1 TINKERCAD
Tinkercad is a free, easy-to-use web app that equips the next generation of designers and
engineers with the foundational skills for innovation: 3D design, electronics, and coding.
Basically, we use this software for simulation process of the project.
5.2 ARDUINO IDE
The open-source Arduino Software (IDE) makes it easy to write code and upload it to the
board. This software can be used with any Arduino board.
6. RESOSURCES AND CONSUMABLES REQUIRED
Arduino Uno
Flex sensor
16X2 display
10k Potentiometer
10k ohm Resistor
breadboard
wires
glove
PCB
Page 11 of 15
ADVANTAGES:
1. It requires fewer components so its cost is low.
2. Small in size.
3. Light weight.
4. Flexible users.
5. Easy to operate.
DISADVANTAGES:
1. Facial expressions are not considered.
APPLICATIONS:
1. Useful for speech impaired and hearing-impaired people.
2. Communication between normal and abnormal person.
Page 12 of 15
7. ACTION PLAN
Sr. Detail of activity Planned Planned
No. start finished
date date
1. The teachers told us about the final year project and 24th 1st October 2021
we talked about the project as to what our project September
should be like. We discussed in which area the 2021
project should be. Be it in the social, industrial or
defense sectors.
2. We thought for 2 weeks, in which sector the project 1st October 8th October 2021
should be. Be it in the social, industrial or defense 2021
sectors.
3. We decided to do project for deaf people. 8th October 22nd October
2021 2021
4. We have label the project diary. Include the name of 22nd October 29th October
the project you are starting, when it will be started 2021 2021
and the expected completion date.
5. Introduce my project in the project diary. Describe 29th October 5th November
what the project is, why you are completing it and 2021 2021
when you expect to have it completed.
6. We have created a schedule for our project. This is a 5th 12th November
list of goals that we have to complete in a given time November 2021
frame for each during the project. 2021
7. We have record information about how is working on 12th 26th November
the project and what each individual’s duties are November 2021
during the project. This will define their roles and 2021
provide clarity for accountability to everyone
participating in your project diary.
8. Then we surveyed the industrial sector to see if there 26th 3rd December
was any kind of project or anything related to it. We November 2021
went to CREAATIVE POWERTECH PVT. LTD
Page 13 of 15
and asked if there was any modification in our 2021
projects or not. We asked them how would we do
this project whether it is based on a Microcontroller,
Arduino or PLC. “Then he said that there are many
benefits that you can do with Arduino and that the
system can be used easily”.
9. Then we find out what component is needed for this 3rd December 10th December
project and find out if it is available in the market and 2021 2021
if not, what equivalent component can it work like
that. And estimated their worth and it takes about 2
weeks.
10. We went into the project related industry and we 10th 17th December
asked if the industry sponsors us for that project. And December 2021
it takes about 2 weeks. 2021
11. We found CREAATIVE POWERTECH PVT. 17th 17th December
LTD.as an industry that would sponsor us for our December 2021
project. And that, they also will help to made our 2021
project.
12. We have share project diary with our project 17th 31st December
members. That it will help in completing tasks that December 2021
are the same or similar to ours. We have decided to 2021
write the complete sentences instead of just short
notes. Because that we will not be the only reading
the project diary
13. We were deciding to start out final project 31st 31st December
implementation. December 2021
2021
14. We are planning for troubleshoot and final testing of 31st 31st December
our project. December 2021
2021
Page 14 of 15
8. REFERENCES:
[1] http://lemelson.mit.edu/winners/thomas-pryor-and-navid- azodi
[2] https://www.arduino.cc/en/uploads/Main/ArduinoNanoMa nual23.pdf
[3] https://www.sparkfun.com/datasheets/Sensors/Flex/flex22 .pdf
[4] http://www.in.techradar.com/news/wearables/These-gloves-literally-turn-sign-
language-into-speech/articleshow/51810332.cms
[5] http://www.ijste.org/articles/IJSTEV2I9089.pdf
[6] Solanki Krunal M, “Indian Sign Languages using Flex Senser Glove,” International
Journal of Engineering Trends
and Technology (IJETT) - Volume4 Issue6- June 2013 ISSN: 2231
[7]http://www.statesymbolsusa.org/symbol-official-item/maine/state-language-
poetry/american-sign-language
Page 15 of 15
