SMART GLOVES

Abstract

ABSTRACT A considerable number of people in India are deaf and mute, facing significant communication barriers. To address these challenges, a glove-based device that translates American Sign Language (ASL) into spoken words is developed. The system has two primary components (Figure I): recognizing sign language and converting it to text, followed by transforming the text into speech. The sign language glove incorporates flex sensors that detect the extent of linger bending (Figure 2). These sensors vary their resistance according to the degree of bend, and this information is transmitted to an Arduino Nano control unit (Figure 4). where the output signals are converted into text . This text is processed into speech using text-to-speech algorithm. The speech is acquired using a Bluetooth speaker. This smart device is designed to implement few common sample words preferably used by the people of concemed

Specification

FIELD OF THE INVENTION
Several researches are blooming to automate the Sign Language Translation
system. Many individuals presently contribute to promoting communications
5 for the hearing or vocally disabled. Several organizations have come forward to
design systems for connecting the disabled with engineers around the world. It
is found that it is accomplished by integrating some important tools such as the
embedded system, sensors and Web camera-based sign language translation
tools. The proposed system is more related to connecting the disabled and the
10 environment by developing a glove that translates the sign language to speech in
real time which allows users to interact with one another and benefit from
resources.
BACKGROUND OF THE INVENTION
Several researchers described a few methods for converting hand gestures into
15 understandable versions such as Sign Aloud gloves were equipped with sensors
that detected hand movements. The glove translated American Sign Language
(ASL) into text or spoken words. The system used machine learning to
recognize specific gestures and transmit them via Bluetooth to a computer,
where the translation would occur. While innovative, the gloves had limitations,
20 such as the inability to translate facial expressions and body language, which
are key components of sign language.
The smart gloves can be used for the purpose of Finger movement capturing.
Every object becomes accessible and actionable with the help of a
microcontroller. The embedded technology in microcontrollers allows them to
25 exchange information with sensors (Input Device) or with the speaker (Output
Device). These gadgets can improve disabled's lives, create more engaged
communities and eliminate the communication barrier . The Microcontroller is
3
i. ..
:.
-Q)
C)
Ill
D..
Q)
-1- N
E....
0
-LL. M
0
0
-::1'
CIO
0 .....
--:I'
-::1'
N
0
~ en
M
1.1')
N
.M... .
programmed with an identification programme developed in the Embedded C
language to carry out this operation. The suggested module's major goal is to
30 create an effective communication between disabled and other individuals in the
environment.
One compact electronics unit will be used in the process, which will include a
Micro Controller, Flex sensors, Speaker, Raspberry pi 5, Arduino Nano, and
ZIGBEE.
35 Using Flex sensors, this system continuously captures the finger movement.
40
The microcontroller analyses all the sensor data and sends it to the Raspberry
Pi. The Flex sensor is used to capture the finger movement. Zigbee is used to
transmit/receive data between Arduino Nano and Raspberry Pi.
The Raspberry Pi is the master in this project. It oversees the information
transfer chain from the flex sensors to the speaker. Arduino Nano converts the·
analog signal to a pulsating digital signal. This digital signal is transmitted to
the Raspberry Pi using ZIGBEE. Later this signal is compared with the
existing signal ~atabase to produce an accurate output in the form of
text;which is converted into speech using text-to-speech algorithm and the
45 output speech is obtained in the speaker .
SUMMARY OF THE INVENTION
A Smart Glove for disabled is developed to break their communication
barrier. A gloves supported by Arduino nano, Raspberry Pi, Flex sensor is used
to implement a real-time sign language translating device which acts as a standso
alone device without the use of any other devices such as smartphones,
laptops,ets,. As a result, a sensor-based sign language translating system can
efficiently translate the hand signs in real-time ensuring a better communicative
~ and supportive environment.
N
0
~
>
~~~~~T-~~N-T-~!-F-F-l~~ ~ C. M-f-N-N-Pr:1-2/~-5 / i-=.t-,·--1-r:!-?:-4-t-4~~
I
-::1'
0
-Q)
C)
Ill
D..
Q)
--- ---
55 BRIEF DESCRIPTION OF THE DRAWING:
FIGURE I Illustrates the Functional Diagram of proposed system
In this design, the inputs are obtained from the Flex sensors. The hand signs are
transmitted to the Arduino Nano and further to Raspberry Pi via ZIGBEE; the
Arduino nano acts as A-to-D converter,and it simplifies the input signal.The
60 Raspberry Pi acts as a master and the output is simplified to speech after the
signal is compared with the input signal with text as output and is converted to
speech by Text-To-Speech. The speech is produced by the speaker.
FIGURE 2 illustrates the setup of the project
The initial prototype system is composed of the hardware kit with flex sensor,
65 Raspberry PI, Arduino Nano,ZIGBEE RX, ZIGBEE TX. The other components
are the power supply unit along with a Bluetooth speaker. From the
measurement of flex sensors, values are compared with normal reference values
to control the parameters by interfacing with Raspberry PI to pass the
information to the speaker.
70 FIGURE 3 shows Flex Sensors which measure the angle of inclination or
bending of the fingers.
FIGURE 4 shows the Arduino Nano microcontroller which accepts input
from the flex sensors and processes the inputs into Text.
Steps involved in the proposed system:
75 The following steps are involved in the proposed system as shown below:
Step 1: Start
Step2: Obtain signals from Flex Sensors
Step 3: Convert the input signal from analog to digital signal in Arduino
Nano
80 Step 4: Digital signal is transmitted to Raspberry Pi via ZIGBEE
-v-
~\ .
ll'
11•
~:; '.
·~ .
Step 5: The input signal is compared with the existing data base and the .;
output is obtained in the form of speech from speaker
Step 6: Stop


We Claim for,
1. A smart device used to translate the hand gestures into a speech is
comprised of:
Flex sensors for detecting the inclination of fingers:
Arduino nano microcontroller for processing the inputs of flex
10 sensors into text;
Zigbee TX transmitter and Zigbee RX receiver acts as pathway
between two arduino nano microcontrollers;
·. · Raspberry Pi 4 microcontroller for processing the text into speech;
A Bluetooth speaker for capturing the audio transmission;
15 2. The flex sensor as claimed in claim! ,which is capacitve sensor
produces analog output signal.
20
3. Raspberry Pi 4 microcontroller claimed in claim 1, integrates all
the functionalites thereby acts as stand alone device.
4.. Zigbee TX transmitter and Zigbee RX receiver claimed in claim 1
• !
• ,faciltates wireless communication between two microcontrollers
which eliminates electrical interference between the controllers.
s. The hand gestures like "Hello" "Hi" "Need Help" and similar
gestures can be pre programmed and detected

Documents