MIT Solve

Solution Overview

Solution Name

Hand Talk Glove for Dumb and Deaf

One-line solution summary.

Communication strategies may affect one’s ability to engage in interaction and play part in social conflict, but for the deaf and dumb it’s not possible.

What is your solution?

The main aim of this
project is to build bridge between dumb people and normal peoples by building communication
device in the form of gesture glove. This glove helps in interpreting the sign language through
gestures. In daily activities of human life gestures plays important role, during communication
providing easier understanding. Hand gestures are most power full gesture then other gestures
because It helps us to express more in short time[2]. For every hand gesture created, a pattern is
formed through the sensors appreciate the gesture and the microcontroller matches the gesture
which is already stored in memory. The device exclusively interprets alphabets, numbers and
few sentences of language. A training mode is gettable on the device therefore it fits every
person and accuracy is inflated. The gesture glove is a normal, cloth driving glove having flex
sensors for each finger.by bending the sensor the output of the sensor varies. Sensor generates
analog values which will be converted in to digital values and then processed by microcontroller
and then it will be transmitted wirelessly by Bluetooth module to android mobile where the data
will be converted into speech and audio can be heard

What specific problem are you trying to solve?

Natural way of communication is talking. However, in many cases some persons are cannot

communicate in the natural manner e.g. dumb and deaf persons. These differently abled persons
need assistance to do their daily routine job. Today’s technology can be used for their rescue.
Most often differently abled people are not treated as the part of the society. To give them way to
be like a normal person, we have developed a device hand gesture based prototype named
HAND TALK. Communicating between deaf people and persons who do not understand sign
language is very hard without Hand Talk device. Hand talk glove fitted with 5 flex sensors each.

The output data of sensor depends on the degree bend made by the finger. They transform
electrical resistance from bend change of the sensor – the more the bend, the more the resistance
value. The processing of these electrical resistances is in Arduino –Uno Board. Arduino
compares the given signal or input signal with predefined voltage levels stored in controller.
Speaker produces sound according to the stored voltages levels in memory. In that way it is for
deaf and dumb to interface with normal people. Now the future work is to enhance hardware of
this device as well as introduce more languages and signs for different countries. Also trying to
introduce some cultural sings into speech.

Develop small portable device for communication between dumb and normal people

• Introduce more language and more signs
• Moving from Arduino to DS89c420 Microcontroller
• Making it reliable and cheap for users

Who does your solution serve? In what ways will the solution impact their lives?

The gesture gloves should be worn by deaf and dumb people. Five flex sensors are fitted with
glove. Finger position will be changed by bending to show the gesture for different signs. This
change or bending of the fingers changes the resistance of flex sensors according to the bending
of finger. Arduino uno process the data which comes from flex sensor. The flex sensor used is
Arduino UNO compatible and it is connected to Arduino UNO through wires. 5v power supply
needed for arduino to operate. the data which is present in the gloves is wirelessly transmitted by
Bluetooth module. After transmitting data another Bluetooth receives the data using mobile.
This data from flex sensors is processed in Arduino UNO microcontroller. Arduino UNO is
powered with power module which supplies 5V. The android application is design such that
when it receives the processed data by the Bluetooth, it displays it at mobile screen as a text and
simultaneously transforms into speech and audio can be heard.

What steps have you taken to understand the needs of the population you want to serve?

The propose work is helpful for deaf and dumb peoples. After using this device

they can easily communicate with any other normal persons
In future we can control things by gesture control gloves and still controlling
games by gestures are in progress
The cost of this may be reduced upgrading software architectures

Which aspects of the Challenge does your solution most closely address?

Improving learning opportunities and outcomes for learners across their lifetimes, from early childhood on (Learning)

Our solution's stage of development:

Scale: A sustainable enterprise working in several communities or countries that is looking to grow significantly, focusing on increased efficiency

Explain why you selected this stage of development for your solution—in other words, what have you accomplished to date?

Communication is a two-ay interactive process and it plays most important role in our life.
Communication strategies may affect one’s ability to engage in interaction and play part in social
conflict, but for the deaf and dumb it’s not possible. According to NYtimes (The numbers of deafmutes in the world are roughly calculated to be from 700,000 to 900,000, and of these 63 per cent. are
said to be born deaf, the others losing their hearing by different accidents)[1]. The main aim of this
project is to build bridge between dumb people and normal peoples by building communication
device in the form of gesture glove. This glove helps in interpreting the sign language through
gestures.

Where our solution team is headquartered or located:

Hyderabad, Pakistan

Team Lead:

MAZHAR ALI