REAL-TIME SPEECH-TO-TEXT HOLOGRAPHIC COMMUNICATION

Abstract

An innovative real-time speech-to-text conversion system using holographic display technology to aid communication for the deaf and hard-of-hearing (DHH). The system incorporates two complementary speech recognition approaches namely, Speech Recognition Library Approach (SRLA) and W2V2A approach (WVAA) for capturing audio input and converting spoken words into text. The integration of these two recognition methods enhances the system's accuracy and reliability in processing real-time speech. The system is hosted on a Raspberry Pi and interfaced with USB microphone, for capturing spoken language effectively. Upon recognition, the text is instantly displayed on a holographic screen made up of LED matrices and set against an acrylic glass surface, creating a visually engaging representation of floating text. The application of holographic technology in this context is pioneering, which underscores the potential of advanced display and speech processing technologies to transform interactions for individuals with

Specification

Description:FIELD OF THE INVENTION:
The present invention relates to a real-time speech-to-text conversion system using holographic display technology to aid communication for the deaf and hard-of-hearing (DHH). More particularly, the present invention discloses a real-time speech-to-text conversion system which integrates advanced speech recognition technologies with innovative holographic displays which not only aids individuals with hearing impairments but also ensures inclusivity and improves engagement across diverse scenarios.

BACKGROUND OF THE INVENTION:
In the realm of technological advancements, the quest to bridge communication gaps for individuals with disabilities has led to the creation of innovative and inclusive solutions. One such disability is related to hearing in which an individual may be deaf or hard of hearing (DHH). According to the World Health Organization (WHO), a person who is not able to hear as well as someone with normal hearing (hearing thresholds of 20 dB) or better in both ears, is said , Claims:1. A System (S) for real-time speech-to-text conversion with holographic text display, the System (S) comprising:
- USB microphone for capturing audio signals,
- Raspberry Pi 5 as the core computational unit,
- Speech Recognition Module (SRM) for converting spoken words into text,
- Main Application Loop (MAL) for orchestrating flow of activities in the System (S),
- LED Matrix Control Module (LMCM) for controlling the LED Matrix,
- Holographic Projection Module (HPM) for projecting the textual data as a floating text,
characterized in that, the holographic projection technology, using LED arrays and projectors, transforms speech into holographically projected visual text in real-time, creating the illusion of floating text.

2. The System (S) as claimed in claim 1, wherein the said Speech Recognition Module (SRM) comprises two speech recognition approaches namely Speech Recognition Library Approach (SRLA) and W2V2A approach (WVAA) for capturing audio input and converting spoken words into text.

3. The Syst

Documents