A SMART EYEWEAR DEVICE FOR PRIVACY

Abstract

Abstract: Title: A SMART EYEWEAR DEVICE FOR PRIVACY The eyewear device(A) of present invention provides a visual and audio privacy through an integrated processing (018), sensing(016), audio(017) and display(017) circuitries aided with algorithm in the microcontroller (021). The display circuitry ( 019) aids in dynamic tinting, diopter and display; while the audio circuitry (017) adjust the volume levels of the audio output based on the ambient noise levels of the user with a minimal leakage and hence maintaining the privacy such that people around the users do not hear and at the same time making sure that user can get uninterrupted listening experience. Figure 1A

Specification

Description:TECHNICAL FIELD
The present invention relates to a device (A) for aiding privacy relating to visual, and audio aspects of a user. The invention provides an eyewear device (A) to aid in visual and audio privacy of a user and also diopter adjustment. More specifically the invention relates to a smart eyewear device (A) with dynamic tint and adaptive sound system for privacy.
BACKGROUND AND PRIOR ART
Traditional eyewear lacks dynamic tinting capabilities which renders it to be uncomfortable for a user in varying light conditions. The solutions to said problem include manually adjustable tinted lenses or separate sunglasses for different light conditions. Generally the see-through near eye displays have some light leakage in the opposite direction of the user making it socially unacceptable and may impair privacy.
Parallelly conventional smart eyewear or open ear speaker systems for wearable devices will not provide adequate privacy in public environments and adjusting volume levels manually on them can be a distracting experience. There are attempts to solve this problem through Acoustic reverse noise cancelling technology or customizable audio settings but this has not been user friendly.
Patent no US9,028,062 describes about a "Electronic eyeglass frame", the disclosure informs about electronically induced method for changing the tint of the glass, however multiple levels of changing the tint is not available and the device is restricted to visual aspects and does not aid in providing privacy relating to sound. Another Patent document US 10,261,542 discloses about an eyewear with augmented reality, said device is enabled by a neckband with necessary accessories for power and computation. The device is cumbersome to wear and adopt by a user. The US Patent document US10725556 informs about an eyewear with communication circuit to provide notification and information in the vicinity of the user; similarly another document US 10,777,048 informs about a device for usage by elderly persons, the enables a user to access a live operator by tapping a button at the eyewear . The live operator can connect the user to a person, can detect falls or provide assistance via the digital assistant.
However, the prior arts do not provide a solution to enable privacy relating to audio and visual aspects to an user. The present invention aims to overcome the problems relating to visual and audio privacy through an eyewear that can be operated in a facile manner.
SUMMARY OF DISCLOSURE
Accordingly the present invention provides a device (A) for aiding privacy relating to visual, audio aspects and diopter adjustment of a user. More specifically the invention provides-
A smart eyewear device(A) for visual, audio privacy, display and diopter adjustment; comprising lens frame (001) coupled to temples (002); wherein the lens frame(001) and temples (002) encases lens(003), processing circuitry(018), sensing circuitry(016), and audio circuitry(017), Display circuitry(019), wireless Transceivers(015) and Battery(009); wherein
- the processing circuitry (018) is integrated to sensing circuitry(016) and audio circuitry(017) and display circuitry (019)to process captured data, filter and transmit with the aid of microcontrollers(021) with necessary algorithms;
Wherein
-the processing circuitry(0119) comprises microcontroller for storing the algorithm and threshold parameters, flash memory(022), ML core(023) and rectifier circuit (024);
-the sensing circuitry(016) comprises sensors- proximity sensor( 010), IMU(020), ambient light sensor(011), camera sensor (004), encoder (005) and touch sensor(012);
-the audio circuitry(017) comprises comprises Digital signal processor (027), Speakers(006), bone conduction speaker (007), Amplifiers(028), Microphones(014), codec (029), CRC unit(029), and equalizer circuit (072);
-the display circuitry comprises lens tint control system(025), diopter control system (026) and display system(041); and
the transceivers (015) connects the device (A) to an external device(030).
A method for visual privacy through smart eyewear device(A), said method comprising-
a) monitoring the ambient illuminance of light through ambient light sensors (011) in manual mode, or dynamic mode,
b) regulating tint of the electrochromic or liquid crystal lens (003) for controlling opacity or transmittance of light for the visual privacy.


A method for diopter adjustment with smart eyewear device (A), said method comprising providing voltage to different zones of the lens (003) to match focal length with the user's focal length for adjustment of diopter.

A method for audio privacy with smart eyewear device(A), said method comprising step of-

filtering audio data through processing circuit (018) and converting microphone Pulse Density Modulation signals to Pulse Code Modulation signals and processing it to the speakers(006) and bone conduction speaker (007) coupled through amplifiers(028) of device (A) in manual mode, auto privacy mode and forced privacy mode.


BRIEF DESCRIPTION OF FIGURES
The features of the present invention can be understood in detail with the aid of appended figures. It is to be noted however, that the appended figures illustrate only typical embodiments of this invention and are therefore not to be considered limiting the scope for the invention.
Figure 1: illustrates the device(A) as a block diagram and its connectivity to a connected device.
Figure 1A: illustrates the schematic of eyewear device (A).
Figures 2 and 2A: illustrates the hinge mechanism in temples (002) for swapping the frame (001).
Figure 3: illustrates the lens (003) of the eyewear device(A).
Figure 4: illustrates the change in tint of the eyewear device(A).
Figure 4A: illustrates the temple (002) with encoder (005) for adjustment of tint manually with the aid of encoder (005)
Figure 4B: provides a flowchart on the adjustment of tint in the eyewear device(A) by manual or dynamic mode.
Figures 5 and 5A: illustrates display technology for optical display purpose (041) to render device (A) as a AR/MR/VR or spatial computing device.
Figures 6, 6A and 6B: illustrates about auto diopter adjustment for the lens(003).
Figure 7: illustrates the touch pads (055) encased in the dielectric enclosure of temples (002).
Figures 7A, 7B and 7C: illustrates controllable functions like selecting the application, swiping through the menu, scrolling through the list through the device (A).
Figures 8(a) and 8(b) :illustrates the speaker (006) arrangement in the temples (002).
Figures 9(a) and 9(b): the audio output dynamically adjusts based on the user's head orientation(046 and 048).
Figure 10: illustrates haptic feedback for alerting the user about notifications from the connected device (030) and providing intuitive feel to the user.
Figure 11: illustrates the multiple modes -manual privacy mode, auto privacy mode or forced privacy modes that can be adopted by a user for audio privacy.
Figure 12: illustrates the different environments of auto privacy mode like Privacy environment(033), Meeting environment(034), Traffic environment(035).
DETAILED DESCRIPTION OF INVENTION
The present invention provides a smart eyewear device (A) to provide privacy to a user on visual and audio aspects. The foregoing description of the embodiments of the invention on device (A) has been presented for the purpose of illustration. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, as many alternative variations and sequences are possible in light of this disclosure for a person skilled in the art in view of the figures and description. Additional features and advantages of the disclosure will be described hereinafter, which form the focus of the description of the disclosure. It may further be noted that as used herein, the singular "a" "an" and "the" include plural reference unless the context clearly dictates otherwise. Unless defined otherwise, all technical and scientific terms used herein have the same meanings as commonly understood by a person skilled in the art.
Abbreviations:
AR - Augmented Reality
MR - Mixed Reality
VR - Virtual Reality
PDM - Pulse Density Modulation
PCM - Pulse Code Modulation
RMS - Root Mean Square
I2S - Inter Integrated Circuit Sound
SPI - Serial Peripheral Interface
SAI - Serial Audio Interface
ALS - Ambient Light Sensor
IMU - Inertial Measurement Unit
EC - Electrochromic Lens
LC - Liquid Crystal lens
MCU - Microcontroller Unit
MPU - Microprocessor Unit
SoC - System on Chip
SoM - System on Module
Wi-Fi - Wireless Fidelity
Li-Fi - Light Fidelity
BLE - Bluetooth Low Energy
UWB - Ultra Wide Band
ML - Machine Learning
AI - Artificial Intelligence
CRC - Cyclic Redundancy Check
RC - Rectifier Circuit
DSP - Digital Signal Processor
UI - User Interface
MEMS - Micro Electro Mechanical Systems
ED woofers - ElectroDynamic Speakers
The eyewear device (A) of the present invention provides dynamic tinting and diopter regulation for vision and adoptive sound mechanism with audio modulation, speaker sound system with filtered algorithms, sensing, audio and processing circuitry, thus enabling comfort to users in any ambient light and noise conditions.
The eyewear device (A) comprises lens frame (001) coupled with two temples(002); wherein the lens frame(001) and the temples (002) encases lens(003), processing circuitry(018), sensing circuitry(016), audio circuitry(017), display circuitry(019), wireless transceivers for communication transfer (015) and Battery(009), as illustrated in figure 1 and 1A schematically.
In an embodiment of invention the device (A) may be linked to an externally connected device (030) through communication wireless transceiver(015) to facilitate wireless communication between the device (A) and any connected external device(030). The wireless connectivity is enabled through transceivers like BLE, Bluetooth, WIFI, Li Fi integrated into the device (A). Users can pair the device (A) with compatible external devices, allowing for the transfer of data and control without the need for physical connections.
In an embodiment of the invention, the device (A) provides a provision for swapping lens frame(001) to allow users to have different aesthetic elements through different lens frames (001). The processing circuitry(018), sensing circuitry(016), and audio circuitry(017) are enclosed in the temples (002). Swappable frame(001) renders the device more user friendly by providing an option to swap frames as per their fashionable needs in daily wear.
In an embodiment of present invention as illustrated in figure 2 and 2A, swappable frame(001) uses a flexure hinge (054) designed to integrate with the temples(002). The integration is done through a screw based fixing mechanism on the one end (052) which is connected to the frames(001) while the other end is having a snap fit of mechanism which allows it to fit and lock with the aperture space (050) provided on the temples(002) for the snap fit (053) to be inserted thus allowing a swappable option along with swift and strong locking. The flexure hinge (054) also has an option which allows it to bend to suit different head sizes instead of having different frames. The flexure bend is possible through the grove design(051) used in the hinge to give flexibility for the material to bend in order to accommodate varying head sizes. A flexure hinge(054) made of metal or spring metal or plastic depending on the material properties that permits angular pivoting of temples accommodating various head sizes, including small, medium, and large, and is made of a body member of a solid material which is normally having the properties of flexibility or expandability. This will help solve the problems generally faced by eyewear users like face fitting issues with restricted frames lengths; this allows the hinge to bend in order to accommodate the users head size, and customization option to switch frames which can be achieved by the snap-fit mechanism of the hinge to switch the frames easily accommodating the desired frame with similar snap fit mechanism.
In an embodiment of invention, the device (A) focus on minimizing power consumption to extend usage. By the selection of energy-efficient battery (009) and the optimized circuit design, the device (A) provides sustained usage. The device (A) maximizes battery efficiency by operating with low-power modes for sensors such as IMUs, touch sensors which have different power-saving modes such as standby, low-power or sleep modes. These modes reduce sensor activity when not in use, conserving battery power. User can also turn off the auto privacy mode either from the connected device or from the device itself to extend the battery life. The wear detection feature on the designed system can help to save the battery resources by turning off the temples when not worn by the user and to only turn on the device (A) when worn by the user. The battery system, located within the temples (002), also offers a swappable option to a new or recharged battery module, enabling longer usage. Users can seamlessly swap batteries to maintain continuous operation, ensuring convenience and flexibility in usage. This design enhances the overall user experience by providing extended usage time without compromising on functionality or comfort. The swappable battery option may be selected from a mechanism comprising magnetic, snap-fits, mechanical locks or digital lock systems like electro mechanical systems to ensure a safer swappable system.
In an embodiment of invention, the processing circuitry(018) is integrated to both sensing circuitry(016) and audio circuitry(017) to process captured data, filter and transmit with the aid of microcontroller unit (021) with necessary algorithms. The processed data is transmitted to the speakers(006, 007) coupled through amplifiers and codecs perform control functions based on inputs from the sensors or any externally connected device (030).
In an embodiment the processing circuitry(018) comprises a processor selected from a group comprising MCU, MPU, SoC, SoM(021) a Memory unit comprising Flash memory(022) for storing the algorithm/software data and threshold parameters for the device (A) to operate; and to store the data captured from the cameras(004), ML core(023) and rectifier circuit (024) for filtering the sensor signals.
In an embodiment the audio circuitry (017) comprises of speakers(006) and bone conduction speaker (007), amplifiers(028), microphones(014), CRC unit(029) along with the DSP (027), Equaliser circuit(072), codec(078) to filter the noise captured from the microphones(014) and to process the audio signals received from the connected device (030) through equaliser circuit. The equaliser circuit (072) aids in tuning the audio frequency parameters to provide effective and clear audio output. The settings can also be tuned as per the user requirements from the connected device through an equaliser application. The equaliser function is performed through algorithm/software running on the processing circuit(018) of device (A) by controlling the frequency component of the audio signals.
In an embodiment of invention, the sensing circuitry(016) comprises sensing components like sensors which include and but not limited to proximity sensor (010), IMU'S (020), Touch sensor( 012), hall-effect sensor(077), ALS sensors(011), image sensors/camera (004) and encoder (005).
In an embodiment of invention, the display circuitry(019) comprises dynamic lens tint control system(025) comprising EC /LC tint lenses along with a voltage drive circuitry for controlling the tint, diopter control system(026) comprising of Liquid crystal diopter lenses along with the drive circuit and display system(041) comprising Near eye displays which are transparent along with display related circuitry.
The lens (003) of the tint control system comprises liquid crystal lens (075), electrochromic lens(076) and near eye display lens(041) stacked over one another as illustrated in figure 3 and is of thickness ranging from about 3mm.
In an embodiment of invention the figure 4, 4A and 4B illustrate the dynamic tint control system(025). The Ambient Light Sensor (011) in the sensing circuitry (016) of device (A) aids in the dynamic tint function to enhance user comfort in varying light conditions. The Ambient Light Sensors (011) continuously monitor ambient illuminance and compare to predefined thresholds to automatically adjust the tint of the lens (003) to suit the sunlight for transmittance or opacity. The lens (003) of the device (A) changes the tint in response to an applied electric field which is based on the ambient light or illuminance data obtained from the ALS in auto mode. Depending on the direction of the electric field the lens change from transparent to tinted or vice versa, for example in the case of transition from clear(039) to tinted eyewear(040), the lens may transit from clear to dark with the application of electric field voltage, when the electric field is removed or reversed, the electrochromic lens(003) returns to its original state restoring to its initial transparency.

In an embodiment of invention as illustrated in figure 4A and 4B, the tint of the eyewear device(A) can be adjusted manually by the user with the encoder(005) to give the required voltage or current for change of tint of the lens. When encoder(005) is rotated in clockwise direction, incremental supply of voltage or current is applied to lens which increases the tint of the lens(040) and when it is rotated in counterclockwise direction, decremental supply of voltage or current is applied for lens which decreases the tint of the lens (039); providing users with customizable control over their visual experience.

In an embodiment of the invention as illustrated in figure 5 and 5A, the device (A) imbibes optical and optoelectronic display technology for optical display purpose (041) to render it as a AR/MR/VR or spatial computing device. This enhances the visual experience for users, when used along with the dynamic tint mechanism present on the device, offering dynamic adjustments in real-time to optimize display performance by improving the brightness and contrast of the displays through control of the light reaching the users by tinting based on ambient lighting conditions and user preferences. Integrating dynamic tint control will allow the device (A) to minimize power consumption of the display technology by keeping its brightness minimal and increasing the lens tint to make the virtual display more visible by reducing the light reaching the user's eyes. Generally using optical displays like the see-through near eye displays have some light leakage in the opposite direction of the wearer making it socially unacceptable, whereas adding the EC or LC based tint also improves the privacy of the user in this aspect as the lens tints the glasses and reduces the light leakage from waveguide display eyebox region on to the opposite side of the users eyes .
In an embodiment of invention as illustrated in figure 6 the device (A) provides auto diopter adjustment for the lens(003). Users can input their preferred focal power settings from the externally connected device wirelessly(030) or through the onboard algorithm and virtual user interface of the device (045); which controls the voltage applied to different zones of the Liquid crystal based lens (LC) wherein the said each zone(074) will comprise of positive and negative electrodes to precisely control the liquid crystals present in the zone to control the alignment and orientation of the liquid crystals sandwiched between the two polarised transparent glasses and thus control the polarisation of the lenses which in turn changes the refractive index of the lens system as a whole such that it allows the focal power to match the focus of the eyes of the user through diopter control system present in the display circuitry (019) ( Figure 6A); which changes the refractive index of the lens system as a whole such that it allows the focal power to match the focus of the eyes of the user illustrated as- without diopter vision (042) and with diopter vision (043) in figure 6B, ensuring optimal visibility and comfort. Said feature enhances user experience by providing personalized vision correction to individual preferences and requirements.


In an embodiment the device (A) is operated with touch sensors (012) along with electrodes also known as touch pads(055) in the dielectric enclosure (070) of the temple (002) to give users the manual adjustment of certain control functions of the externally connected device(030) or device (A) itself; as illustrated in figure 7. The finger or hand inputs like forward swipes(056, 057), pause(058), other functions like next action, previous action and voice assistant function (059, 062, 063) and backward swipes(060, 061), hold (064, 065), volume increase (067) and volume decrease (066) to perform controllable functions along with functions like controlling or to navigate the UI elements or virtual objects for example selecting the application, swiping through the menu , scrolling through the list and the like as illustrated in figures 7A, 7B and 7C.

In an embodiment of invention the audio processing circuit (017) filters the audio data and processes it to the speakers-open ear speaker (006) selected from a group comprising tweeters, woofers and bone conduction speaker (007) coupled through amplifiers(028) or other necessary audio filtration components. The audio circuitry(017) consists of multiple microphones(014), Amplifiers(028), codecs(078) and CRC unit (029) along with equalizer circuit (072).
In an embodiment of invention, the speakers(006) comprises of tweeters and woofers positioned to direct audio output towards the user's ears through a cavity present on the temples(002). Tweeters handle the reproduction of high-frequency sounds such as vocals and treble, while woofers are dedicated to produce low-frequency sounds such as bass and percussion. The speakers(006) are split evenly, preferably two or oddly on the left and the right temple(002). Speaker system is coupled through the amplifiers ,codecs and other audio related circuitry in the device (A), which is an open ear speaker system where there will be audio leak into the surrounding environment making privacy of the users a concerning issue in many situations.

In an embodiment of invention the microphones(014) capture the voice or noise levels around the user and the ambient environment to determine the decibel level or amplitude of the captured audio signal for performing dynamic adjustment of audio on speakers(006 and 007) automatically coupled through amplifiers (028) and codecs(078) to get the good quality of audio output from the speakers. Said speakers( 006) and Bone conduction speakers (007) are present in front of the ears or at the back of ear. The configuration of speaker arrangement can be vice versa as in figure 8(a) and 8(b) i.e., the bone conduction speaker while coupled with other speakers like Open ear speaker systems- containing ED woofers(013) or Mems tweeters (032) can either be in the front of speakers that is before the ear curve or after the ear curve i.e. behind the ears. Users can seamlessly switch between the speakers (006) and bone conduction speakers(007). The configuration switching adds the benefit of better audio quality along with privacy and ambient awareness. The switching of speakers mode can also be done automatically i.e., when depending on the environment noise levels or the application the user is using on the device (A) can decide when the switching of speaker output to be considered. The bone conduction speakers(007) provide additional privacy of the calls by controlling the audio output decibel level that can be increased or decreased by using amplifiers or other audio circuitry related components when operated along with the smart privacy algorithm.
In an embodiment of invention, the device (A) consist of piezo drivers, electromagnetic or electro-static actuators (009) to give haptic feedback as illustrated in figure 1A when there is any notification or increase or decrease in audio volume or auto diopter adjustment.
In an embodiment of invention, the integration of IMU sensors into the sensing circuitry (016) facilitates real-time tracking of the user's head movements, providing precise data on rotation along multiple axes. The coupling of said sensor data with spatial audio processing, the audio output dynamically adjusts based on the user's head orientation(046 and 048) as illustrated in figures 9(a) and 9(b). For instance, when the user rotates their head to the right the processing circuit detects the rotation based on the data from Gyroscope in IMU and consequently making the audio sources on the right side (046) become louder(047), and to the left side ( 048) the audio becomes higher from left (049). Said synchronized audio feedback enhances the immersive experience of virtual or augmented environments and realism for the user. Also when the device is used as AR/VR/MR presence of IMU can help in interacting with the virtual world objects when the virtual objects are overlaid on to the physical environment and display adjustment based on the orientation of the user's head.
A haptic feedback as illustrated in figure 10 is adopted for alerting the user about notifications from the connected device (030) and providing intuitive feel to the user. The device (A) with piezo drivers or electrostatic or electromagnetic actuators provides haptic feedback that feels more realistic for the users for the functionalities like volume increase or decrease, power on, power off, taking pictures , next/previous songs when listening to music and when connected to other devices and also gives notification alerts from the connected device.

In an embodiment of invention, the device (A) is integrated with filtering algorithm used for conversion of received pdm, I2S or other such microphone (014) signals to PCM signals or other required output formats, which are then processed by processing circuit (018) to give the audio output to the open ear(006) or bone conduction speaker(007) based on the operating mode, with modulated audio levels as per the ambient sound levels sensing. The algorithm captures and transfer signals using the I2S, PDM or other such communication protocols which can stream the continuous signals from the microphones(014) to the processing circuitry(018). The algorithm may be incorporated in any head mounted device configurations like Audio, AR/VR/MR and spatial computing devices to connect to other devices for data exchange and control using transceivers(015) which gives personalized and immersive audiovisual experience; since the open ear sound systems causes audio leak into surrounding environment making privacy of the users a concerning issue.

In an embodiment of invention, the microcontroller unit (021) enabled with algorithms adjust the volume levels of the audio output based on the ambient noise levels of the user environment without any manual intervention which aids users to enjoy any audio in privacy where surrounding people can't hear the audio output from the speakers since this mode minimizes the audio leakage at necessary environments to enhance the privacy level for the user.
In an embodiment of invention the device (A) comprises camera sensor (004) in the lens frame(001) by which user can take pictures and store in it, scan the text to translate into required language and to recognise the hand gestures for performing control function on the connected host device like controlling audio, call control functions and other camera visual applications like SLAM tracking and content creation.
In another embodiment of invention, the device (A) with the aid of algorithm/software optimize noise cancellation in real-time ensuring clear audio communication in noisy environments and the features such as voice recognition and gesture control enhances user interaction and control, making the device more intuitive and user-friendly.
In an embodiment of the invention, the device (A) incorporated with Multiple microphones(014) to enhance the functionality like calls and noise cancellation during calls, voice assistance but more particularly in the privacy environment(033) setting of the device(A) in auto privacy mode. These microphones(014) particularly in the auto privacy mode capture the decibels levels or amplitude of ambient noise levels around the user and process it to the audio circuitry(017) like codecs or processing circuitry(018) through audio transfer communication protocol like I2S, PDM, SPI but not limited to these interfaces, and then processing circuitry(018) filters the data using the components like DSP(027) unit and filters or sometimes even using equalizers present in the circuitry and also through the algorithms; and then process it to the speakers(006) and bone conduction speaker (007) through amplifier or codecs using the same above mentioned communication protocols. The processing circuitry(018) along with sensing circuitry(016) and audio circuitry(017) will help to adjust the volume levels of the audio output based on the ambient noise levels or decibels levels or amplitude level of the user without any manual intervention. With multiple microphones(014) the device (A) can effectively cancel out background noise during calls providing clearer audio for the recipient of the call from the users of this device. Each microphone(014) captures ambient sound levels from different directions and distances, then the captured audio signals from the microphones are processed by the processing circuitry(018) and the integrated algorithms to analyze the signals i.e., amplitude -which translates mostly sometimes as a decibel levels too; to distinguish between desired audio such as the user's voice and unwanted background noise by using the segregation of the frequencies of the captured audio signals.
The algorithm integrated in device (A) takes the noise or voice data from the PDM and from any other type of microphones(0908) and processes it to the processing circuitry(018) which converts that data to PCM. Also the device (A) can include analogue microphones since it doesn't change the configuration or desired function form the system, which gives analog audio output and this will be converted into digital PCM signals by using inbuilt ADC in the processing circuitry(018), after the conversion into PCM samples, integrated algorithm will calculate the amplitude of the PCM samples using RMS(root mean square) over a particular time period and compares with the predefined threshold levels defined in the system algorithm based on different environments selected to adjust the volume of the audio coming out from the speakers(014) coupled through the amplifiers(028) and other audio related circuitry. The algorithms also segregate frequencies of noise from actual voice signals of the user. By comparing the frequency profiles of the captured audio with predefined frequency or amplitude of the audio signals, the algorithm will effectively distinguish between background noise and the user's voice. Once the noise frequencies are identified then the algorithm separates them from the user's voice frequencies. This segregation allows the device (A) to isolate the user's voice from the surrounding noise ensuring that volume adjustments are not made unnecessarily during user speech.

The algorithms integrated in the device (A) can be integrated in any head mounted devices like AR/VR/MR and spatial computing devices. The volume of the audio can also be controlled as per the user input or preference using the gestures recognised from the touch sensor(012), and also for algorithm related to audio privacy to operate effectively, it is not necessary for all components and configurations to be the same in the Smart Eyewear apparatus system all the time Certain components can be omitted or operated together based on the specificity of the application. Only the essential components like microphones(0908) , processing circuitry and speakers(1100) are needed to be present to ensure the auto privacy mode functions perform as determined. This algorithm can be run in parallel along with an algorithm to recognise the gestures from the multiple sensors used on the Smart Eyewear apparatus system device like Touch sensor(0907), ALS sensor(0902), Proximity sensor(0903) and also from the Encoder(0901). When a particular gesture is recognised by the algorithm, it performs a specific control function assigned to that particular gesture.

In an embodiment of invention, the algorithm after determining the sound levels of the environment can determine when the user will need privacy and it provides an automatic option to switch between using open ear speaker systems(006) or bone conduction systems(007) and also can be switched by user defined input, when the ambient noise levels are low as like in the places of libraries, office spaces; the algorithm will switch to forced privacy mode where it will turn on the bone conduction based speaker(007) in order to maintain the privacy levels of the user by turning off the open-ear speaker(006). Another example includes, when the user is receiving a call then the users will be provided an option on the connected device or through the display present on the smart eyewear to choose the required privacy level to maintain the privacy by choosing to switch to the forced privacy mode based on bone conduction speaker(007) or to remain on using the open-ear speaker system(006). The provision of options may include high privacy , low privacy etc., but not just limited to particular options. Also the applications on the connected device or that may be present on the device(A) can switch between open ear speaker systems(006) and bone conduction speaker systems(007) based on the privacy level of the content.

In an embodiment of invention as illustrated in figure 11, the device (A) is adopted in multiple modes -manual mode, auto privacy mode and forced privacy modes which can be activated based on the user inputs, automated inputs like sound levels or even applications on the externally connected devices (030). The forced privacy mode specific to audio privacy works by switching to bone conduction speaker output.

In an embodiment of invention as depicted in figure 12, the auto privacy mode will have multiple environments like Privacy environment(033), Meeting environment(034), Traffic environment(035) and the like. The modes and environments is selected from user input through the connected device(030) or through the device (A) with the aid of display(041) in order to maintain user's privacy based on environment decibel levels (036, 037,038).

In an embodiment of invention, the Manual mode in the device(A) is used for manual adjustment of volume by the user with the aid of microphones(014). In multiple microphone configuration, the primary microphones focus on the user voice and the secondary microphones are oriented in the opposite direction to pick up environmental/background noise. The algorithm differentiate users voice from background and suppress the environmental noise. The integrated microphones capture ambient noise, allowing algorithms to differentiate between voice signals and background noise. By processing the data, the device (A) can suppress noise while enhancing the clarity of voice signals transmitted during calls, akin to AI noise cancellation technology. The noise suppression capability in the device ensures seamless communication even in noisy environments, providing users with an enhanced audio experience and improved call quality. In Traffic environment(035), it uses its multi-microphone configuration to effectively suppress surrounding noise while transmitting clear voice signals during calls.

In an embodiment of invention, in the manual mode the data is captured through the microphones( 014) and stored in the receive buffer. When the receive buffer is full, the data in the buffer is converted from PDM to PCM and stored in the transfer buffer. The buffers facilitate the accumulation of audio samples and enable amplitude modification based on touch-based gestures given by the user from integrated touch sensors(012) on the device (A). The gestures trigger adjustments in the amplitude of the audio data before transmission to the amplifiers or audio circuitry which in turn are connected to speakers(006 and 007). All the modes in the device operates with any configuration of microphones and can work with any mode of communication interfaces like I2S , SAI, PDM and SPI.

In an embodiment, in auto privacy mode, the algorithm engages auto audio adjustment functionality. Similar to manual mode, the audio data is captured and stored in the receive buffer. In said mode, the algorithm calculates the Root Mean Square (RMS) amplitude of the buffered data over a defined time period. This calculated RMS value is then utilized to set the amplitude of the audio data to a particular level before transmission to the amplifiers or audio circuitry connected to speakers(006 and 007)). The communication protocol for transmitting the adjusted audio data to the speakers(006 and 007) is optimized for real-time data transfer, ensuring minimal latency and optimal audio playback. The Auto privacy mode offers users a hands-free experience, where the device automatically adjusts audio levels based on ambient noise conditions, enhancing user comfort and audio audibility. Parallelly, the Auto Privacy Mode ensures utmost confidentiality by allowing only the user to hear audio output from the open-ear speaker system, effectively minimizing audio leakage level with respect to the type of environment the user is present. All the environments in the algorithm which includes and not just limited to Privacy environment(033), Meeting environment(034) and Traffic environment(035) operate on the principle of dynamic volume adjustment, the predefined thresholds are distinct to suit their respective environments where the Traffic environment(035) will be having higher thresholds to match the high noise levels of the environment. In Privacy environment(033), thresholds prioritize maximum confidentiality at generalised user scenarios and in Traffic environment (035), thresholds are calibrated to maintain clarity even at such elevated background noise levels. Whereas in Meeting environment(035) thresholds are kept at minimal level to minimise the privacy concerns especially when the user is present in low noise environments. Example case of operating said modes include when the user is present in the office environment where the noise levels are generally at low level so the algorithm in the device (A) is tuned to suit this environment and when operating the device (A) in the office environment, it will be having low threshold levels to identify noise and also sets the threshold output volume at minimal level to reduce audio leakage. By capturing the ambient noise level in the environment and converting them to root mean square (RMS) amplitude value and comparing this obtained value with the threshold value, the algorithm automatically set the output value of the audio decibel level based on the amplitude value of the noise level obtained. The same mode when operated in traffic conditions will have less audio output in comparison to the ambient noise, so users can't hear the audio clearly and hence the user can choose an option to switch from the connected device or the on the software of device (A) itself to a traffic environment which has higher thresholds and hence user can clearly hear the audio output from the device alienating the fear of privacy concern of higher audio output amplitude due to the high ambient noise levels.

In another embodiment the forced auto privacy is achieved by using the two bone conduction speakers(007) in parallel with the open-ear speakers (006) ( figure 7A). The device (A) can automatically switch to forced privacy mode through a bone conduction speaker(007) based on the context of calling or any input from the application on the connected device(030), or automatic activation input from privacy mode. The auto audio volume adjustment is implemented along with the bone conduction, wherein the audio output from the bone conduction speakers is controlled based on ambient noise around the user, ensuring optimal performance in various environments. This enhances user privacy and audio audibility, offering flexibility and seamless transitions between modes to meet user needs.

In another embodiment, the algorithm integrated into the device(A) employs the I2S (Inter-IC Sound) communication protocol to capture and transfer signals. Said protocol enables the streaming of continuous signals from the microphones(014) connected to the data line. The device (A) efficiently communicates audio data, facilitating seamless processing and transmission of signals for various functionalities such as noise suppression, voice recognition, auto-privacy modes, auto audio volume mode and audio playback by using I2S. Communication protocol may also be PDM, SPI, SAI or other audio based communication protocol based on the requirements of the hardware in the device (A).
The illustrated device(A) thus aids in visual and audio privacy in auto mode or manual mode in a facile manner. The dynamic tinting ability of the device (A) through its lens automatically adjust to varying light conditions giving user enhanced visibility and comfort without the need for manual adjustment or separate sunglasses. The algorithm in the device perform on any platform and can be integrated into any wearable device like AR/VR/MR or spatial computing systems. With the wireless connectivity technology, device (A) can seamlessly concur with other devices.




















, Claims:WE CLAIM:

1. A smart eyewear device(A) for visual, audio privacy, display and diopter adjustment; comprising lens frame (001) coupled to temples (002); wherein the lens frame(001) and temples (002) encases lens(003), processing circuitry(018), sensing circuitry(016), and audio circuitry(017), Display circuitry(019), wireless Transceivers(015) and Battery(009); wherein
- the processing circuitry (018) is integrated to sensing circuitry(016) and audio circuitry(017) and display circuitry (019)to process captured data, filter and transmit with the aid of microcontrollers(021) with necessary algorithms;
Wherein
-the processing circuitry(0119) comprises microcontroller for storing the algorithm and threshold parameters, flash memory(022), ML core(023) and rectifier circuit (024);
-the sensing circuitry(016) comprises sensors- proximity sensor( 010), IMU(020), ambient light sensor(011), camera sensor (004), encoder (005) and touch sensor(012);
-the audio circuitry(017) comprises Digital signal processor (027), Speakers(006), bone conduction speaker (007), Amplifiers(028), Microphones(014), codec (029), CRC unit(029), and equalizer circuit (072);
-the display circuitry comprises lens tint control system(025), diopter control system (026) and display system(041); and
the transceivers (015) connects the device (A) to an external device(030).
2. The smart eyewear device (A) as claimed in claim 1, wherein the lens frame(001) and temples(002) are swappable through flexure hinge (054) integrated with screw (052) to the frame(001) and snap fit (053) to the temples (002).
3. The smart eyewear device (A) as claimed in claim 1, wherein the visual privacy is selected by dynamic or manual tint control of lens(003).
4. The smart eyewear device (A) as claimed in claim 3, wherein the dynamic tint control for visual privacy is by monitoring illuminance by ambient light sensor (011) and regulation of tint of lens (003) through processing circuitry(018) .
5. The smart eyewear device (A) as claimed in claim 3, wherein the manual tint control for visual privacy is through encoder (005) on temple (002).
6. The smart eyewear device (A) as claimed in claim 1, wherein the audio privacy is aided by microphones (014), amplifiers (0111), open ear speaker (006) and bone conduction speaker(007) through the processing circuitry (018).
7. The smart eyewear device (A) as claimed in claim 6, wherein the speaker (006) is selected from tweeters, woofers, or combination thereof.
8. The smart eyewear device (A) as claimed in claim 1, wherein the visual privacy is through modes selected from manual mode, or dynamic mode; and audio privacy is through modes selected from manual privacy mode, auto privacy mode, and forced privacy modes; and the modes are activated based on user inputs and/or automated inputs.
9. The smart eyewear device(A) as claimed in claim 1, wherein the wireless Transceivers (015) is selected from a group comprising BLE, Bluetooth, WIFI, and Li Fi.
10. The smart eyewear device(A) as claimed in claim 1, wherein the lens (003) comprises liquid crystal lens(075), electrochromic lens(076), near eye display lens(041) or its combination.
11. A method for visual privacy through smart eyewear device(A) of claim 1, said method comprising-
a) monitoring the ambient illuminance of light through ambient light sensors (011) in manual mode, or dynamic mode, and
b) regulating tint of the electrochromic or liquid crystal lens (003) for controlling opacity or transmittance of light for the visual privacy.

12. The method as claimed in claim 10, wherein the manual mode the tint of the eyewear device(A) is adjusted manually with encoder(005) of sensing circuitry(016) by providing voltage through rotation in clockwise or anticlockwise direction.

13. The method as claimed in claim 10, wherein the dynamic mode the tint of the eyewear device(A) is by an applied electric field controlled through processing circuitry based on the ambient light conditions obtained through the ALS sensor to the liquid crystal lens (075) or electrochromic lens (076) of lens (003).

14. A method for diopter adjustment with smart eyewear device (A) of claim 1, said method comprising providing voltage to different zones of the lens (003) to match focal length with the user's focal length for adjustment of diopter.

15. A method for audio privacy with smart eyewear device(A) of claim 1, said method comprising step of-
filtering audio data through processing circuit (018) and converting microphone Pulse Density Modulation signals to Pulse Code Modulation signals and processing it to the speakers(006) and bone conduction speaker (007) coupled through amplifiers(028) of device (A) in manual mode, auto privacy mode and forced privacy mode.

16. The method as claimed in claim 15, wherein the manual mode the touch-based gestures by a user from touch sensors(012) trigger adjustments in the amplitude of the audio for transmission to the amplifiers which are connected to speakers(006) and bone conduction speaker (007).
17. The method as claimed in claim 15, wherein the auto privacy mode is activated based on the user inputs selected from sound levels, applications on the external connected devices (030) and through the device (A) with the aid of display(041).
18. The method as claimed in claim 15, wherein the auto privacy mode is selected for environments like Privacy environment(033), Meeting environment(034), and Traffic environment(035) based on user inputs on sound levels, applications on the external connected device (030) and through the device (A) with the aid of display(041).
19. The method as claimed in claim 15, wherein the forced privacy mode is activated based on context or input from the connected device(030) by switching from open ear speaker(006) to bone conduction speaker(007).

Documents