# US 12,216,339 B2 · Eyewear systems, apparatus, and methods for providing assistance to a user > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,216,339 B2 - Document ID: US12216339B2 - Status: Granted - Kind: B2 - Application number: 18/517,910 - Filed: 2023-11-22 - Published: 2024-03-21 - Granted: 2025-02-04 - Earliest claimed: 2018-12-12 - Applicants: Solos Technology Limited - Inventors: Ernesto Carlos Martinez Villalpando; Chiu Ming So; Kwok Wah Law; Wai Kuen Cheung - Web page: https://patentgrep.com/patent/US12216339B2 ## CPC - G02C 5/001: {specially adapted for particular purposes, not otherwise provided for or not fully classifiable according to technical characteristics, e.g. therapeutic glasses} - G02C 3/006: {Arrangements for fitting and securing to the head or neck not in the position of use} - G02C 5/126: {exchangeable or otherwise fitted to the shape of the nose} - G02C 5/14: Side-members - G02C 11/06: Hearing aids (construction of electric hearing aids H04R25/00) - G02C 11/10: {Electronic devices other than hearing aids} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - H04W 4/026: {using orientation information, e.g. compass} - H04W 4/38: for collecting sensor information - G02C 2200/02: Magnetic means - G02C 2200/08: Modular frames, easily exchangeable frame parts and lenses - G02C 2200/16: Frame or frame portions made from rubber - G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract Systems, apparatuses, and methods are taught that provide assistance to a user through an eyewear device. Data is received from a first sensor. The first sensor is incorporated into an eyewear device. The first sensor measures a parameter related to the user. A state of the user is analyzed using the data. Assistance is provided to the user. The assistance is in a form of feedback, and the feedback is related to the state of the user. The assistance can also be related to a context of the user and a state of the user. The context of the user is determined from the data. ## Claims ### Claim 1 A method to provide assistance to a user through an eyewear device, comprising; receiving first data from a first sensor, the first sensor is incorporated into the eyewear device, the first sensor measures a parameter related to the user; receiving second data from a second sensor, wherein the second sensor is an external sensor; analyzing a state of the user, wherein the analyzing uses the first data and the second data; determining a context of the user, wherein determining uses the first data and the second data; and providing assistance to the user, wherein the assistance is in a form of feedback, and wherein the feedback is related to the state and the context. ### Claim 2 (depends on 1) The method of claim 1, wherein a first element of the context is a physical orientation of the user. ### Claim 3 (depends on 2) The method of claim 2, wherein a second element of the context is an activity that the user is doing. ### Claim 4 (depends on 2) The method of claim 2, wherein a third element of the context is the user's environment. ### Claim 5 (depends on 1) The method of claim 1, wherein the assistance is in a form of audio communication for the user. ### Claim 6 A computer readable storage medium storing program code for causing a data processing system to perform steps comprising: receiving first data from a first sensor, the first sensor is incorporated into an eyewear device, the first sensor measures a parameter related to a user; receiving second data from a second sensor, wherein the second sensor is an external sensor; determining a context of the user, wherein the determining uses the first data and the second data; and providing assistance to the user, wherein the assistance is related to the context, and wherein the assistance is in a form of audio communication to the user. ### Claim 7 (depends on 6) The computer readable storage medium of claim 6, wherein a first element of the context is a physical orientation of the user. ### Claim 8 (depends on 6) The computer readable storage medium of claim 6, wherein a second element of the context is an activity that the user is doing. ### Claim 9 (depends on 6) The computer readable storage medium of claim 6, wherein a third element of the context is the user's environment. ### Claim 10 (depends on 6) The computer readable storage medium of claim 6, further comprising: analyzing a state of the user, wherein the analyzing uses the first data and the assistance is related to both the state and the context. ### Claim 11 A system for execution by a data processing system to provide assistance to a user through an eyewear device, comprising: a voice interface, the voice interface has a microphone and a speaker, the voice interface to receive user commands and to provide assistance to the user; a sensor data input, the sensor data input to receive sensor data; a processor, the processor is in electrical communication with the voice interface and the sensor data; and a computer program for processing the sensor data, the computer program and the processor to cause the data processing system to perform steps comprising: receiving first data from a first sensor, the first sensor is incorporated into the eyewear device, the first sensor measures a parameter related to the user; receiving second data from a second sensor, wherein the second sensor is an external sensor; determining a context for the user, wherein the determining uses the first data and the second data; analyzing a state of the user, wherein the analyzing uses the first data and the second data; and providing assistance to the user, the assistance is related to the context and the state. ### Claim 12 (depends on 11) The system of claim 11, wherein the analyzing considers a category selected from the group consisting of health, wellbeing, safety, cognitive, physical, and emotional. ### Claim 13 (depends on 11) The system of claim 11, wherein the assistance is designed to help the user correct a negative condition. ### Claim 14 (depends on 11) The system of claim 11, wherein the assistance is designed to help the user by encouraging a positive condition. ### Claim 15 (depends on 13) The system of claim 13, the system further comprising: a device, the device is external to the eyewear device, the device is in electrical communication with the eyewear device and the device is used to provide the assistance to the user. ### Claim 16 (depends on 11) The system of claim 11, the steps further comprising: receiving third data from a plurality of embedded sensors, the determining uses both the first data and the third data and the analyzing uses both the first data and the third data.