NOTETAKING DEVICE FOR VISUALLY IMPAIRED

Abstract

A notetaking device for visually impaired, comprising a pair of hinged rectangular plates 101 and a strap 102 for secure hand attachment, plates 101 incorporates rectangular flaps 202 with pivot joints 203 for turning and pneumatic pins 204 arranged in a grid to form Braille characters, an AI-based imaging unit 103 and LIDAR sensor for obstacle detection, triggering audio alerts through a connected speaker 104, a laser projection unit 105 to inform others of the user's presence, each pneumatic pins 204 includes touch sensors for user input, the imaging unit 103 also detect item prices and scan QR codes for payment, supported by a fingerprint sensor 107 for authorized access, a locking mechanism 108 secures the plates 101 when not in use, a temperature sensor regulates comfort via a Peltier unit 109, and a microphone allows users to input commands for navigation, temperature control or audio data recording.

Specification

Description:FIELD OF THE INVENTION

[0001] The present invention relates to a notetaking device for visually impaired in view of enabling visually impaired users to effortlessly capture, manage, and retrieve notes and information that aids to enhance independence and productivity across various settings that facilitate effective interaction with their environment.

BACKGROUND OF THE INVENTION

[0002] Effective note-taking for visually impaired individuals involves adaptive strategies and tools to enhance accessibility and understanding. One approach is using audio recording devices or apps that allow users to capture lectures or discussions, enabling them to revisit information as needed. Additionally, utilizing Braille note takers provide a tactile way to record and review notes. For those comfortable with technology, text-to-speech and screen readers convert written material into spoken words, making easier to process information. Organizing notes in a structured manner is crucial by using headings, bullet points, and color coding when possible, help create a clear hierarchy of information.

[0003] Collaborating with instructors to obtain accessible materials, such as digital formats that are compatible with assistive technologies, is also beneficial. Furthermore, engaging in active listening and summarizing key points during lectures reinforce understanding. Creating a personal shorthand of symbols streamline the note-taking process, allowing for quicker writing and easier revision. Peer support groups offer valuable insights and techniques for effective note-taking. Regular practice and adaptation of these strategies empower visually impaired individuals to develop their own effective note-taking methods, fostering independence and confidence in their learning experiences. By combining these tools and techniques, visually impaired students enhance their academic success and fully engage with their educational environments.

[0004] Traditional methods of note-taking for visually impaired users include braille writing, audio recordings, and tactile diagrams. Braille writing, though effective requires proficiency in braille, which not all visually impaired individuals possess. Available braille materials are bulky and less accessible for those who rely on electronic devices. Audio recordings provide a hands-free way to capture notes but is challenging when searching for specific information or reviewing material quickly, as they lack the ability to highlight or annotate key points. Tactile diagrams enhance understanding of visual concepts, yet they often require specialized training to interpret effectively, and creating them is labor-intensive. Furthermore, traditional note-taking methods do not integrate well with modern digital tools, limiting the ability to share and collaborate easily. Many visually impaired users also face barriers in environments where assistive technology is not available or when the necessary resources, such as braille paper or audio devices, are lacking. This lead to feelings of isolation and hindered academic or professional performance. While traditional note-taking methods provide valuable support for visually impaired individuals, their limitations in accessibility, efficiency, and adaptability highlight the need for more inclusive, technology-driven solutions that enhance learning and communication for users with diverse needs.

[0005] US7407335B2 discloses about an invention that has a Braille display for use by blind and low vision users. The Braille display can be detachably mounted on a notetaker which includes either a Braille keyboard or a conventional QWERTY keyboard and a memory for storing in digital form information which is entered through the keyboard. Preferably, the Braille display includes a conventional port for connecting through a cable to a personal computer or other computer operated device for displaying information.

[0006] US9524655B1 discloses about an invention that has an interactive Braille display apparatus which includes a frame; 3-sided rotating members installed within the frame such that only one side of the 3-sided rotating members is displayed at a time. Each 3-sided rotating member includes a flat side; a first raised portion side having a first raised portion; a second raised portion side having a second raised portion connected to an input device to receive an input from a user, the second raised portion having a height greater than the height of the first raised portion. The apparatus further includes a microprocessor electrically connected to each clickable switch of each second raised portion, the microprocessor detecting when the clickable switch of at least one second raised portion has been depressed by the user and outputting that the clickable switch of the at least one second raised portion has been depressed.

[0007] Conventionally, many methods are available for preparing the notes for visually impaired users. However, the cited invention primarily focuses on static input and output, lacking integration of navigational features such as obstacle detection and real-time feedback, which are essential for ensuring user safety and mobility in various environments. Both designs rely heavily on external connections for data input, limiting portability and user independence. Also, neither of the invention provides personalized comfort adjustments or voice command functionalities, which are critical for creating an intuitive and user-friendly experience.

[0008] In order to overcome the aforementioned drawbacks, there exists a need in the art to develop a device that requires to seamlessly combine tactile interaction with dynamic navigational support in view of enabling users to safely navigate their surroundings while also providing an intuitive means of recording and accessing information. The developed device also needs to emphasize portability and independence for eliminating the reliance on external devices for functionality that empower visually impaired individuals, providing them with a versatile and adaptive tool which significantly improves their daily activities and overall quality of life.

OBJECTS OF THE INVENTION

[0009] The principal object of the present invention is to overcome the disadvantages of the prior art.

[0010] An object of the present invention is to develop a device that is specifically developed for visually impaired users, allowing them to easily capture, manage, and retrieve notes and information, thereby enhancing their independence and productivity in various settings.

[0011] Another object of the present invention is to develop a device that is capable of improving the safety of visually impaired users by detecting obstacle at an appropriate time and generates real-time audio alerts, helping users navigate their surroundings more effectively and avoiding potential collisions.

[0012] Another object of the present invention is to develop a device that is capable of facilitating interaction with the environment by projecting visual cues that inform people nearby about the user's presence and movements, thereby fostering a safer environment in public spaces and reducing the risk of accidents.

[0013] Another object of the present invention is to develop a device that is capable of supporting users in their journey by providing accurate location tracking and auditory navigation instructions in view of enabling users to confidently find their way to selected destinations while minimizing reliance on external assistance.

[0014] Another object of the present invention is to develop a device that is capable of streamlining shopping experiences for visually impaired users by enabling secure and convenient payment methods, including visual recognition of price tags and PIN entry, ensuring accessibility and efficiency during transactions.

[0015] Yet another object of the present invention is to develop a device that is capable of enhancing the user experience by regulating the temperature based on ambient conditions, thus ensuring that the device remains comfortable to hold and use regardless of the environment.

[0016] The foregoing and other objects, features, and advantages of the present invention will become readily apparent upon further review of the following detailed description of the preferred embodiment as illustrated in the accompanying drawings.

SUMMARY OF THE INVENTION

[0017] The present invention relates to a notetaking device for visually impaired users to improve the safety and navigation capabilities of visually impaired users and generates real-time audio alerts, thus helping users navigate their surroundings more effectively, reducing the risk of potential collisions alongside projecting visual cues to inform those nearby about the user's presence and movements, fostering a safer environment in public spaces.

[0018] According to an embodiment of the present invention, a notetaking device for visually impaired users, comprising a pair of hinged rectangular plates secured to the user's hand by a strap. Between these plates are flexible flaps equipped with pneumatic pins arranged in a grid, enabling the formation of braille characters for easy note-taking. An artificial intelligence-based imaging unit works in conjunction with a LIDAR sensor to detect obstacles in the user's path, triggering audio alerts via an integrated speaker to ensure safety during navigation. A laser projection unit installed on the plates informs nearby individuals of the user's presence, further preventing accidents. The device is equipped with a GPS module for real-time location tracking and navigational assistance, providing auditory directions to the user. For shopping, the imaging unit recognize price tags and scan QR codes, facilitating secure payment processes through a microcontroller that activates the braille grid for PIN input. A fingerprint sensor provided on the plate ensures that only authorized users access payment features. A temperature sensor and a Peltier unit to regulate the plates' temperature for user comfort. A microphone allows for voice commands, enabling users to control various functions, including navigation and note-taking. All these components are powered by an integrated battery, ensuring the device operates efficiently and reliably for users.

[0019] While the invention has been described and shown with particular reference to the preferred embodiment, it will be apparent that variations might be possible that would fall within the scope of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

[0020] These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying drawings where:
Figure 1 illustrates an isometric view of a notetaking device for visually impaired in a closed state; and
Figure 2 illustrates another isometric of the proposed invention in an open state.

DETAILED DESCRIPTION OF THE INVENTION

[0021] The following description includes the preferred best mode of one embodiment of the present invention. It will be clear from this description of the invention that the invention is not limited to these illustrated embodiments but that the invention also includes a variety of modifications and embodiments thereto. Therefore, the present description should be seen as illustrative and not limiting. While the invention is susceptible to various modifications and alternative constructions, it should be understood, that there is no intention to limit the invention to the specific form disclosed, but, on the contrary, the invention is to cover all modifications, alternative constructions, and equivalents falling within the spirit and scope of the invention as defined in the claims.

[0022] In any embodiment described herein, the open-ended terms "comprising," "comprises," and the like (which are synonymous with "including," "having" and "characterized by") may be replaced by the respective partially closed phrases "consisting essentially of," consists essentially of," and the like or the respective closed phrases "consisting of," "consists of, the like.

[0023] As used herein, the singular forms "a," "an," and "the" designate both the singular and the plural, unless expressly stated to designate the singular only.

[0024] The present invention relates to a notetaking device for visually impaired that aims to streamline user experience by providing precise location tracking and auditory navigation instructions to empower users to confidently reach their desired destinations with minimal reliance on external assistance, while also facilitating shopping by enabling secure payment methods through visual recognition of price tags and PIN entry, thus making visually impaired users independent.

[0025] Referring to Figure 1 and 2, an isometric view of a notetaking device for visually impaired in a closed and open state is illustrated, respectively, comprising a pair of rectangular plates 101 attached with one another by means of hinges 201, a strap 102 with ends attached with the plates 101, a plurality of rectangular flaps 202 provided between the plates 101, the flap 202 is configured with a plurality of pivot joints 203, a plurality of pneumatic pins 204 arranged on each of the flaps 202, an artificial intelligence-based imaging unit 103 installed on the plate 101, a speaker 104 attached on the plate, a laser projection unit 105 disposed on the plate 101 by means of a ball and socket joint 106, a fingerprint sensor 107 is provided on the plate 101, a locking mechanism 108 is integrated with the plates 101 and a Peltier unit 109 installed in the plates 101.

[0026] The device disclosed herein includes a pair of rectangular plates 101 that are ingeniously connected by hinges 201, allowing for a versatile and ergonomic design. These plates 101 are constructed from a lightweight yet durable material such as high-grade plastic or aluminium, which provides both strength and portability. The choice of material is crucial as this ensures that the device is strong enough to withstand everyday use while remaining easy for the user to handle. The plates 101 are developed with smooth, rounded edges to enhance comfort, preventing any sharp corners from causing discomfort during prolonged use.

[0027] The hinges 201 connecting the plates 101 are developed for flexibility and reliability, allowing the user to open and close the device smoothly. This is essential as the hinges 201 enables the device to fold compactly when not in use, making the device easy to carry. The hinges 201 are reinforced to ensure longevity, maintaining functionality over time despite repeated movements. The surface of the plates 101 is treated with a tactile finish, allowing visually impaired users to easily differentiate between the device's functions by touch.

[0028] The rectangular shape of the plates 101 provides ample space for the integration of various electronic components while still being manageable for the user to hold securely. The device is equipped with strap that ensures in securing the device easily and effectively during various tasks. The straps are made from material that include but not limited to high-quality, durable materials such as adjustable nylon or breathable fabric, the strap is developed to withstand regular wear while providing flexibility and comfort. The ends of the strap are firmly attached to the rectangular plates 101, typically using reinforced stitching or secure fastening mechanism to ensure stability and reliability during use. This construction prevents any accidental detachment, allowing users to focus on their tasks without concern for the device's integrity.

[0029] The strap 102 is adjustable in length, accommodating different hand sizes and preferences, ensuring that users achieve a snug fit that enhances their control over the device. This adjustability is particularly important for visually impaired users, as this allows them to customize the device to their specific needs, promoting ease of use and reducing any potential strain on their hands or wrists. The straps also include ergonomic features, such as padding in order to enhance comfort, especially during extended periods of use. This is vital in minimizing fatigue, allowing users to engage with the device for longer without discomfort.

[0030] A locking mechanism 108 is integrated with the plates 101 for ensuring that the device remains securely closed when not in use. This mechanism 108 is particularly important for visually impaired users, as this prevents accidental opening of the plates 101, which lead to damage to the internal components or loss of essential features housed within the plates 101. The locking mechanism 108 is carefully considered to provide ease of use while maintaining robustness and reliability.

[0031] The locking mechanism 108 typically consists of a combination of mechanical components, such as a latch or a clasp, that engage when the plates 101 are closed. This latch is developed to operate with a simple push or slide motion, allowing users to engage or disengage the lock with minimal effort. The mechanism 108 is often positioned in a way that is intuitive for users, ensuring that they easily locate and operate without needing to rely on visual feedback.

[0032] In its engaged state, the locking mechanism 108 securely holds the plates 101 together, preventing them from inadvertently opening during transport or storage. This is particularly beneficial in situations where the user is moving around or carrying the device in a bag, as this reduces the risk of the internal components becoming dislodged or damaged. The device's design also ensures that the locking mechanism 108 does not interfere with the functionality of other components in view of allowing the user to retain full access to these features when the device is unlocked.

[0033] A series of rectangular flaps 202 are positioned in between the two plates 101 that are develop to enhance functionality and user interaction. Each flap 202 is crafted from a lightweight yet sturdy material, such as high-density polyethylene or a similar composite, ensuring durability while remaining easy to manipulate. The rectangular shape of these flaps 202 maximizes surface area, providing ample space. The flaps 202 are configured with a plurality of pivot joints 203 so that the flaps 202 curve and bend smoothly along designated lines, enabling users to turn the flaps 202 with ease. This is crucial for several reasons as this allows the user to access different sections of the device without needing to lift or remove entirely. For example, when the user wants to switch between different note-taking sections or functions, user simply pivot the relevant flap 202, making the interaction seamless and intuitive. The pivot joints 203 themselves are engineered for smooth operation, ensuring that the flaps 202 are manipulated without excessive force, which is particularly important for users who have varying degrees of dexterity.

[0034] As each flap 202 is turned, this offers a unique texture and orientation, allowing users to distinguish between different sections or functions. This tactile differentiation is essential for visually impaired users, as this enables them to navigate the device confidently and efficiently. Furthermore, the flaps 202 are developed to lock into specific positions once adjusted, ensuring that the user maintain their chosen configuration without fear of accidental movement. In terms of maintenance and longevity, the pivot joints 203 are developed to withstand repeated use, featuring materials that resist wear and tear over time. This durability is crucial in maintaining the reliability of the device, as users depend on the flaps 202 to function correctly throughout the lifespan of the product.

[0035] The flaps 202 are embedded with array of pneumatic pins 204 that are arranged in a grid formation across each of the rectangular flaps 202. This facilitates the creation of braille characters, providing visually impaired users with an effective means of reading and writing. Each pneumatic pins 204 is constructed to be individually actuated, allowing for precise control over the formation of braille letters and symbols. The pins 204 are constructed from lightweight yet robust materials, these pins 204 are not only durable but also responsive, ensuring that users easily feel the raised braille characters as user interact with the device. The grid arrangement optimizes the spatial organization of the pins 204, enabling users to quickly locate and distinguish between different characters, enhancing their efficiency in note-taking in an appropriate manner.

[0036] The pneumatic pins 204 get actuated based on controlled air pressure which raises and lowers each pins 204 as needed. When the user requires a specific braille character, the microcontroller processes the input and activates the corresponding pins 204, causing them to extend outward to form the desired character. At the core of the pneumatic unit is a pneumatic actuator, which consists of a cylinder, a piston, and an air supply. When compressed air is introduced into the cylinder through an inlet valve, it creates pressure that pushes the piston, causing it to move within the cylinder. This motion extends the connected pneumatic pins 204, which protrude from the surface of the flaps 202 to form tactile Braille characters. This dynamic capability allows for the on-demand creation of braille text, adapting to the user's immediate needs whether user is composing notes, transcribing spoken words, or responding to prompts from the device. This precision ensures that the pins 204 rise and fall accurately, providing a tactile experience that closely mimics traditional braille writing, thus maintaining the integrity and familiarity of the braille system.

[0037] Synchronously, to retract the pins 204, the pneumatic unit employs a controlled release of air pressure that allows air to escape from the cylinder, which causes the piston to move back to its original position due to the force of a spring or the weight of the pins 204 themselves. This retraction process ensures that the pins 204 smoothly return to their resting state, thereby resetting the grid for the formation of new Braille characters. Each pneumatic pins 204 is also equipped with touch sensors, adding another layer of interactivity to the device. These sensors enable the user to not only read the braille characters but also provide input by touching specific pins 204. For example, when the user touches the pins 204 that represents a particular character, the device recognizes this input and respond accordingly, whether by recording the character, executing a command, or navigating through options.

[0038] The touch sensors with the pneumatic pins 204 facilitates a two-way communication process. Users are able to actively engage with the content they are creating or navigating, enhancing their sense of agency and control over the notetaking experience. This is particularly empowering for visually impaired users, as this allows them to interact with the device in a way that aligns with their skills and needs, fostering independence in information management.

[0039] The plate 101 is configured with an artificial intelligence-based imaging unit 103 that aids in enhancing the safety and awareness of their surroundings. The imaging unit 103 is equipped with a high-resolution camera to capture and analyze real-time images of the environment surrounding the user. Once the images are captured, they are transmitted to an integrated processor within the device, which serves as the central hub for analysis and decision-making. The processor employs various protocols to analyze the incoming images. Utilizing machine learning techniques, the imaging unit 103 is trained to recognize and classify different objects, such as furniture, walls, pedestrians, and even smaller obstacles like curbs or steps. This training involves feeding the device with vast datasets containing labeled images that help the AI learn to identify these elements accurately. The AI continuously evaluates the images in real time, employing techniques such as edge detection, pattern recognition, and object segmentation to discern the characteristics of objects in the environment. This allows it to distinguish between obstacles that require attention and benign elements that do not pose a threat.

[0040] In conjunction with this imaging unit 103, a LIDAR (Light Detection and Ranging) sensor embedded on the plate 101 provides precise distance measurements by emitting laser pulses and measuring the time taken for the light to bounce back after hitting the object. This allows the device to create a three-dimensional map of the user's immediate environment, detecting obstacles at various distances. The imaging unit 103 with the LIDAR sensor allows for a comprehensive understanding of the surroundings while the camera captures detailed visual information, the LIDAR sensor quantifies the spatial relationships between the user and nearby objects. This dual-sensor approach enhances the ability to operate effectively in various lighting conditions and environments, making the device highly adaptable.

[0041] As the user walks, the synchronized data from both the imaging unit 103 and the LIDAR sensor is continuously processed by an inbuilt microcontroller. This microcontroller serves as the central processing unit of the device, analyzing the incoming data to detect obstacles in real time. When the device identifies a potential collision hazard such as a person walking closely in front of the user or a wall approaching within a certain distance, the device triggers the audio alert. A speaker 104 attached to the plate 101 generates clear and concise audio warnings, informing the user about the nature and location of the obstacle. This immediate feedback is crucial for the user's navigation, enabling them to take appropriate actions to avoid collisions.

[0042] The audio alerts vary in type, such as beeps, verbal warnings, or specific sound cues, developed to quickly convey the urgency of the situation. For example, a continuous tone indicate that the user has to stop and assess their surroundings, while a series of quick beeps signal that they are approaching a narrow passage or potential hazard. The choice of audio output is crucial for effective communication with the user. The speaker 104 is developed to produce clear, loud sounds that cut through background noise, ensuring that the user is made aware of their surroundings, even in busy or noisy environments. The volume of the audio alerts is adjustable, allowing users to customize the alert sounds based on their preferences or specific environments. For example, in quieter settings, a softer sound suffices, while in louder areas, a more robust audio signal is necessary for effective communication.

[0043] A laser projection unit 105 is installed on the plate 101 in order to enhance the safety and awareness of visually impaired users in their environment. The projection unit 105 is mounted via a ball and socket joint 106, which provides flexibility and allows for a wide range of motion. This enables the user to adjust the projection angle according to their surroundings and preferences, ensuring that the projected images are visible to individuals nearby, regardless of the user's orientation or movement. The laser projection unit 105 project clear, visible images or signals in the vicinity of the user, effectively communicating their presence to others. For example, the projection unit 105 display symbols or graphics that indicate the user is navigating through a public space. These projections include but not limited to a simple "Caution" sign or more personalized symbols indicating the user's direction or intent, such as arrows indicating the path users are taking. This is particularly valuable in crowded areas, where awareness of one's surroundings significantly reduce the risk of accidents or collisions with pedestrians or obstacles.

[0044] The laser projection not only makes the user more visible but also engages the attention of those around them in a way that is both intuitive and immediate. The bright, clear projections stand out against various backgrounds, ensuring that bystanders, cyclists, or drivers notice the user's presence. This approach towards safety fosters a more inclusive environment, where individuals are less likely to unintentionally obstruct or collide with the visually impaired user.

[0045] For example, the imaging unit 103 analyze the environment in real-time and adjust the projection content based on the level of activity around the user. If the device detects a busy intersection, the projection unit 105 project more prominent warnings or directional indicators. This capability transforms the device into a dynamic tool for navigation and safety, actively responding to changing conditions in the user's environment.

[0046] A GPS (Global Positioning System) module embodied with the plate 101 that significantly enhances the navigational capabilities for visually impaired users. The GPS module continuously determines the user's current location by receiving signals from satellites orbiting the Earth. The information gathered includes the user's latitude, longitude, and altitude, enabling the device to accurately pinpoint their position in real-time. The precise geolocation data is fundamental for providing effective navigation assistance, ensuring that users confidently traverse various environments, whether urban or rural.

[0047] Once the GPS device establishes the user's current location, the GPS interact with an integrated navigation method, which is preloaded with maps and points of interest. Users select their desired destination through voice commands or tactile inputs on the device. After the destination is set, the navigation system processes the information to devise the most efficient route based on the user's current location. This route account for various factors, such as walking paths, public transportation options, and accessibility considerations, optimizing the user's travel experience.

[0048] Upon determining the route, the GPS module re-activates the speaker 104 to provide auditory directions to the user. These directions are delivered in a clear, concise manner, guiding the user through the various stages of their journey. For example, the speaker 104 issue prompts like "Turn left in 50 meter" or "Continue straight for two blocks," allowing the user to navigate without the need to look at a screen or rely on visual cues. The use of auditory instructions is particularly beneficial for visually impaired individuals, as this keeps their focus on their surroundings while providing essential navigational support.

[0049] The audio guidance is enhanced with additional contextual information. For example, the device provides alerts when the user is approaching a known landmark or point of interest, such as a park, store, or bus stop. This information not only helps users stay oriented but also enriches their overall travel experience by providing landmarks as reference points. Furthermore, the GPS dynamically update the directions based on real-time changes in the user's environment, such as road closures, construction zones, or changes in pedestrian pathways. If the user deviates from the planned route, the device promptly recalibrates and offer an alternative path, ensuring continuous support throughout the journey. The accuracy and reliability of the GPS module are crucial for the device to function effectively.

[0050] Herein, in case the user wants to do shopping, the imaging unit 103 equipped with image recognition capabilities that allow to identify and interpret various visual elements in the user's environment, particularly price tags and QR codes. When the user approaches an item for purchase, the imaging unit 103 activates to capture an image of the item, specifically focusing on the price tag. Using machine learning protocols, the imaging unit 103 analyzes the captured image to extract the numerical value printed on the price tag, translating this information into an accessible format for the user.

[0051] Once the price is detected, the device relays this information to the microcontroller, which serves as the device's central processing unit. The microcontroller processes the data and re-activate the speaker 104 to audibly announce the price to the user, thereby ensuring that they are informed of the cost before proceeding with the transaction. This auditory feedback is essential for maintaining user autonomy, as this allows individuals to make informed purchasing decisions without needing to rely on assistance from others.

[0052] In addition to recognizing the price, the imaging unit 103 is also capable of scanning QR codes, which become increasingly popular in retail settings for facilitating payments. When the user approaches the payment terminal or a product with a QR code, the imaging unit 103 captures the code and processes it to access the relevant payment information. This enables users to engage in cashless transactions, further enhancing their independence in shopping environments. After successfully scanning the QR code, the microcontroller initiates the payment process. To ensure the security of transactions, particularly in the context of online payments or those requiring a personal identification number (PIN), the device activates a grid of pneumatic pins 204 located on the flaps 202 of the device. These pneumatic pins 204 are developed to pop up in a tactile arrangement, presenting a physical grid of numbers that the user feel. This tactile interface allows visually impaired users to input their PIN securely and independently, as they physically identify each number without the need for visual confirmation. For example, if the user inputs an incorrect PIN, the device provides auditory feedback through the speaker 104, prompting the user to try again or offering a reminder of the correct format. This immediate feedback is crucial for fostering confidence, as this reduces anxiety surrounding financial transactions.

[0053] A fingerprint sensor 107 is installed on the plate 101 for ensuring security and user authorization for payment transactions, particularly for visually impaired users. The fingerprint sensor 107 authenticates the identity of the user before granting access to sensitive payment functionalities, thereby safeguarding against unauthorized transactions and enhancing the overall security of financial interactions. When the user intends to make a purchase or access payment-related features, user first place their finger on the fingerprint sensor 107. The fingerprint sensor 107 operates using biometric technology, which captures the unique patterns of ridges and valleys on the user's fingertip. The captured fingerprint is then converted into a digital template through image processing protocols. This template is compared against the database of stored fingerprints specifically, the fingerprints that are previously registered and authorized for use with the device. This comparison is performed by the microcontroller that process the data in real-time to ensure quick and efficient authentication.

[0054] For security purposes, the fingerprint data is typically stored in an encrypted format within the device, ensuring that sensitive information is protected from potential breaches. Only those fingerprints that are pre-registered by the user are granted access, which means that the device effectively distinguish between authorized users and potential impostors. This layer of biometric security is particularly beneficial for visually impaired individuals, as this provides a reliable and straightforward method of authentication that does not require visual confirmation, which is challenging for them.

[0055] Once the fingerprint sensor 107 verifies that the user is authorized, the microcontroller activates the payment functions, allowing the user to proceed with transactions. This process includes accessing previously entered payment methods, authorizing purchases via QR code scanning, or utilizing the tactile grid for PIN entry. The seamless transition from fingerprint verification to payment processing enhances the user experience by reducing the time and effort required to authenticate payments. Furthermore, if the fingerprint does not match any registered template, the device provides immediate feedback through the speaker 104, notifying the user that authentication has failed. This feedback is crucial, as this allows users to reattempt authentication or seek assistance without delay.

[0056] A temperature sensor is embedded in the plate 101 for enhancing user comfort by actively monitoring ambient temperature conditions. The sensor continuously measures the surrounding temperature and relays this information to the microcontroller, which processes the data to determine whether the user requires heating or cooling. When the ambient temperature deviates from the comfortable range, the microcontroller activates a Peltier unit 109 integrated into the device. The Peltier unit 109 functions as a thermoelectric cooler or heater, effectively adjusting the temperature of the plates 101 to create a more comfortable experience for the user. This is particularly beneficial for individuals who are sensitive to temperature fluctuations, allowing them to maintain a stable and pleasant environment regardless of external conditions. By ensuring that the plates 101 remain at a comfortable temperature, the device enhances user focus and engagement during note-taking or other activities.

[0057] A microphone installed on the plate 101 connected to the microcontroller, significantly enriches the interaction between the user and the device. The microphone allows users to input voice commands, facilitating hands-free operation. Users navigate to specific destinations by simply speaking their requests, which the device interprets and processes accordingly. The microphone is employed to control the Peltier unit 109, enabling users to adjust the temperature settings through vocal instructions, further simplifying the user experience. Furthermore, the microphone allows for the recording of audio data that is converted into Braille characters on the flaps 202, making this easier for users to capture important information in real-time without needing to rely solely on tactile input. This not only enhances accessibility but also promotes a more intuitive and efficient way to interact with the device, empowering visually impaired users to engage more fully with their environment and the information user need to manage their daily activities.

[0058] The microphone also enables navigation assistance simply by user's voice to input their desired destination, and the microcontroller processes this input to access the integrated GPS module. The GPS, in turn, provides auditory directions, guiding the user step-by-step to their chosen location. This hands-free interaction is crucial for maintaining independence, as this allows users to focus on their surroundings without the need to manually operate the device.

[0059] Users also dictate information that the device convert into Braille characters on the flaps 202. This transforms spoken words into tactile feedback, allowing visually impaired users to document information appropriately. The microcontroller processes the audio input, converting this into text and subsequently activating the pneumatic pins 204 to form the corresponding Braille characters. This not only streamlines the note-taking process but also empowers users to capture thoughts and ideas quickly and efficiently.

[0060] Lastly, a battery (not shown in figure) is associated with the system to supply power to electrically powered components which are employed herein. The battery is comprised of a pair of electrodes named as a cathode and an anode. The battery uses a chemical reaction of oxidation/reduction to do work on charge and produce a voltage between their anode and cathode and thus produces electrical energy that is used to do work in the device.

[0061] The present invention works best in the following manner, where the pair of rectangular plates 101 as disclosed in the invention is developed to be attached with one another by means of hinges 201 is secured by the user onto their hand using the attached strap, ensuring the device is comfortably positioned for operation. The user interacts with the device through the braille characters formed by the pneumatic pins 204, which are arranged in grid for easy reference on each of the flaps 202. As the user navigates their environment, the integrated AI-based imaging unit 103 and LIDAR sensor continuously scan for obstacles, providing real-time feedback. When the obstacle is detected, the microcontroller activates the audio alert through the speaker 104, notifying the user to take necessary precautions. Simultaneously, the GPS module tracks the user's location, offering navigational guidance through auditory prompts. For shopping, the imaging unit 103 is able to recognize price tags and QR codes, facilitating secure payment processes where the user input their PIN using the tactile braille grid. The temperature sensor that adjusts the heating or cooling of the plates 101 for user comfort, while voice commands allow for hands-free operation of various functions, including navigation and note recording.

[0062] Although the field of the invention has been described herein with limited reference to specific embodiments, this description is not meant to be construed in a limiting sense. Various modifications of the disclosed embodiments, as well as alternate embodiments of the invention, will become apparent to persons skilled in the art upon reference to the description of the invention. , Claims:1) A notetaking device for visually impaired, comprising:
i) a pair of rectangular plates 101 attached with one another by means of hinges 201;
ii) a strap 102 with ends attached with said plates 101 to enable a securing said plats onto hand of a user;
iii) a plurality of rectangular flaps 202 provided between said plates 101, wherein said flap 202 is configured with a plurality of pivot joints 203 to enable curving of said flaps 202 for turning;
iv) a plurality of pneumatic pins 204 arranged on each of said flaps 202 in a grid arrangement to enable formation of braille characters for reference of said visually impaired user;
v) an artificial intelligence-based imaging unit 103, installed on said plate 101 and integrated with a processor for recording and processing images in a vicinity of said plate 101, in synchronisation with a LIDAR (light detection and ranging) sensor to determine obstacle in front of said user and close proximity of said user during walking to trigger a microcontroller to actuate a speaker 104 attached on said plate 101 to generate an audio alert regarding avoiding said obstacle to prevent a collision;
vi) a laser projection unit 105 disposed on said plate 101 by means of a ball and socket joint 106, to project an image in vicinity of said user to inform people around user regarding presence and movement of said user to prevent an accident; and
vii) a GPS (global positioning device) installed on said plate 101 detects present location of said user to activate said speaker 104 to provide directions to said user regarding navigating to a destination selected by said user.

2) The device as claimed in claim 1, wherein each of said pneumatic pins 204 are provided with touch sensors to enable said user to touch said braille characters to provide input.

3) The device as claimed in claim 1, wherein said imaging unit 103 detects a price of an item during a purchase by determining a price tag of said item, and scan QR code for payment, to trigger said microcontroller to actuate said pneumatic pins 204 to present a grid of numbers to enable said user to input PIN to authenticate said payment.

4) The device as claimed in claim 1, wherein a fingerprint sensor 107 is provided on said plate 101, connected with said microcontroller to enable access to payment only to authorised users.

5) The device as claimed in claim 1, wherein a locking mechanism 108 is integrated with said plates 101 to lock said plates 101 from opening.

6) The device as claimed in claim 1, wherein a temperature sensor embedded in said plate 101 to detect an ambient temperature and trigger a microcontroller to actuate a Peltier unit 109 installed in said plates 101 to heat or cool said plates 101 as per ambient temperature for comfort of said user.

7) The device as claimed in claim 1, wherein a microphone mounted on said plate 101, connected with said microcontroller to enable said user to input commands regarding navigation to a destination, actuating said Peltier unit 109, opening said plates 101, or recording audio data as braille characters on said flaps 202.

8) The device as claimed in claim 1, wherein a battery is associated with said device for powering up electrical and electronically operated components associated with said device.

Documents