# US 10,311,746 B2 · Wearable apparatus and method for monitoring posture > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,746 B2 - Document ID: US10311746B2 - Status: Granted - Kind: B2 - Application number: 15/622,542 - Filed: 2017-06-14 - Published: 2017-12-14 - Granted: 2019-06-04 - Earliest claimed: 2016-06-14 - Assignees: OrCam Technologies Ltd. - Applicants: OrCam Technologies Ltd. - Inventors: Yonatan Wexler; Amnon Shashua - Web page: https://patentgrep.com/patent/US10311746B2 ## CPC - G09B 19/00: Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26) - G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting - G06F 18/24: Classification techniques - G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands - G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition} - G06V 40/11: {Hand-related biometrics; Hand pose recognition} - G08B 21/0446: {worn on the body to detect changes of posture, e.g. a fall, inclination, acceleration, gait} - G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip - G09B 5/04: with audible presentation of the material to be studied (sound recording or reproducing G11B) - G06V 20/20: in augmented reality scenes - G08B 7/06: using electric transmission {, e.g. involving audible and visible signalling through the use of sound and light sources} - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS ## Abstract The present disclosure relates to systems and methods for monitoring posture of a user of a wearable apparatus. In one implementation, the system may include an image sensor configured to capture one or more images from an environment of the user of the wearable apparatus and at least one processing device. The at least one processing device may be configured to analyze the one or more images to determine at least one indicator of the posture of the user, determine feedback for the user based on the at least one indicator of the posture of the user, and cause the feedback to be output to the user. ## Claims ### Claim 1 A wearable apparatus for monitoring a posture of a user of the wearable apparatus, the wearable apparatus comprising: an image sensor configured to capture images from an environment of the user of the wearable apparatus; and at least one processor configured to: analyze one or more images of the captured images that include a representation of at least a portion of the user to determine at least one indicator of the posture of the user; analyze the one or more images to obtain motion information associated with the user; determine, based on the motion information, whether to generate feedback for the user; classify the at least one indicator of the posture of the user using a classification rule; when the at least one indicator is classified into at least one first category: generate a visual depiction of the posture of the user; generate the feedback based on the at least one indicator of the posture of the user and apply the feedback to generate a visual depiction of a recommended posture; overlay the visual depiction of the posture and the visual depiction of the recommended posture; and cause the overlaid visual depictions to be output to the user; and when the at least one indicator is classified into at least one second category: refrain from generating the feedback. ### Claim 2 (depends on 1) The wearable apparatus of claim 1, wherein the at least one indicator of the posture of the user includes an indicator of a posture of at least one hand of the user. ### Claim 3 (depends on 2) The wearable apparatus of claim 2, wherein the feedback includes a recommended adjustment to a position of the at least one hand of the user. ### Claim 4 (depends on 1) The wearable apparatus of claim 1, wherein the at least one indicator of the posture of the user includes an indicator of a posture of a neck of the user. ### Claim 5 (depends on 4) The wearable apparatus of claim 4, wherein the feedback includes a recommended adjustment to a position of the neck of the user. ### Claim 6 (depends on 1) The wearable apparatus of claim 1, wherein the feedback to the user includes audible feedback or visual feedback. ### Claim 7 (depends on 1) The wearable apparatus of claim 1, further comprising a vibrating component, and wherein the causing the feedback to be output to the user includes causing the vibrating component to generate a vibration. ### Claim 8 (depends on 1) The wearable apparatus of claim 1, wherein causing the feedback to be output to the user includes transmitting the feedback to a device paired with the wearable apparatus. ### Claim 9 (depends on 8) The wearable apparatus of claim 8, wherein the paired device includes one of a smartphone, a tablet, or a smartwatch. ### Claim 10 (depends on 1) The wearable apparatus of claim 1, wherein the at least one processor is further configured to: receive a plurality of posture-related records; and compare the posture-related information to the plurality of posture-related records, and wherein the feedback for the user is determined based on the comparison. ### Claim 11 (depends on 1) The wearable apparatus of claim 1, wherein the at least one first category includes a plurality of categories, and the feedback for the user is determined based on the classification of the at least one indicator of the posture of the user. ### Claim 12 (depends on 11) The wearable apparatus of claim 11, wherein the classification rule is based on one or more machine learning algorithms trained on one or more training examples. ### Claim 13 (depends on 11) The wearable apparatus of claim 11, wherein the classification rule is based on one or more outputs of at least one neural network. ### Claim 14 (depends on 1) The wearable apparatus of claim 1, wherein the at least one processor is further configured to calculate a score associated with the posture of the user based on the at least one indicator of the posture of the user, and the feedback for the user is determined based on the score. ### Claim 15 (depends on 1) The wearable apparatus of claim 1, wherein the at least one processor is further configured to: analyze the one or more images to identify a plurality of body parts; and classify at least one of the body parts as being associated with the user, and wherein analyzing the one or more images to determine the at least one indicator of the posture of the user includes analyzing at least one image of the body part associated with the user. ### Claim 16 A method for monitoring a posture of a user of a wearable apparatus, the method comprising: capturing, via an image sensor included in the wearable apparatus, one or more images that include a representation of at least a portion of the user from an environment of the user of the wearable apparatus; analyzing, via at least one processor included the wearable apparatus, the one or more images to determine at least one indicator of the posture of the user; analyzing the one or more images to obtain motion information associated with the user; determining, based on the motion information, whether to generate feedback for the user; classifying the at least one indicator of the posture of the user using a classification rule; when the at least one indicator is classified into at least one first category: generate a visual depiction of the posture of the user; generate the feedback based on the at least one indicator of the posture of the user and apply the feedback to generate a visual depiction of a recommended posture; overlay the visual depiction of the posture and the visual depiction of the recommended posture; and cause the overlaid visual depictions to be output to the user; and when the at least one indicator is classified into at least one second category: refrain from generating the feedback. ### Claim 17 (depends on 16) The method of claim 16, wherein the at least one indicator of the posture of the user includes an indicator of a posture of at least one hand of the user. ### Claim 18 (depends on 17) The method of claim 17, wherein the feedback includes a recommended adjustment to a position of the at least one hand of the user. ### Claim 19 (depends on 18) The method of claim 18, wherein the at least one indicator of the posture of the user includes an indicator of a posture of a neck of the user. ### Claim 20 (depends on 19) The method of claim 19, wherein the feedback includes a recommended adjustment to a position of the neck of the user. ### Claim 21 (depends on 16) The method of claim 16, wherein the wearable apparatus includes a vibrating component, and causing the feedback to be output to the user includes causing the vibrating component to generate a vibration. ### Claim 22 (depends on 16) The method of claim 16, wherein causing the feedback to be output to the user includes transmitting the feedback to a device paired with the wearable apparatus. ### Claim 23 (depends on 16) The method of claim 16, further comprising: receiving, via the at least one processor, a plurality of posture-related records; and comparing, via the at least one processor, the posture-related information to the plurality of posture-related records, and wherein the feedback for the user is determined based on the comparison. ### Claim 24 (depends on 16) The method of claim 16, wherein the at least one first category includes a plurality of categories, and the feedback for the user is determined based on the classification of the at least one indicator of the posture of the user. ### Claim 25 (depends on 16) The method of claim 16, further comprising calculating, via the at least one processor, a score associated with the posture of the user based on the at least one indicator of the posture of the user, and the feedback for the user is determined based on the score. ### Claim 26 (depends on 16) The method of claim 16, further comprising: analyzing, via the at least one processor, the one or more images to identify a plurality of body parts; and classifying, via the at least one processor, at least one of the body parts as being associated with the user, and wherein analyzing the one or more images to determine the at least one indicator of the posture of the user includes analyzing at least one image of the body part associated with the user. ### Claim 27 (depends on 16) A non-transitory computer readable medium storing instructions for carrying out the method of claim 16.