# US 10,121,258 B2 · Posture system for mobile devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,121,258 B2 - Document ID: US10121258B2 - Status: Granted - Kind: B2 - Application number: 15/201,184 - Filed: 2016-07-01 - Published: 2018-01-04 - Granted: 2018-11-06 - Earliest claimed: 2016-07-01 - Assignees: Intel IP Corporation - Applicants: Intel IP Corporation - Inventors: Wilfrid D'Angelo; Jonathan De Cesco; Jean-pierre Giacalone; David Bercovitz; Carole Malbrancq - Web page: https://patentgrep.com/patent/US10121258B2 ## CPC - G06T 7/337: {involving reference images or patches} - A61B 5/11: Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb {(A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721)} - A61B 5/1114: {Tracking parts of the body} - A61B 5/1116: {Determining posture transitions} - A61B 5/1128: {using image analysis (A61B5/1127 takes precedence)} - A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06T 1/0007: {Image acquisition} - G06T 7/75: {involving models} - G08B 21/0461: {integrated or attached to an item closely associated with the person but not worn by the person, e.g. chair, walking stick, bed sensor} - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2207/30201: Face - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS ## Abstract A system and related methods for determining an actual head angle of a mobile device user from an actual orientation of the mobile device and a relative orientation of the user's head to the mobile device. The actual orientation of the mobile device may be used as a landmark such that the relative orientation of the user's head to the mobile device may be used to approximate the actual head angle of the mobile device user. The determined actual head angle may be compared to a predetermined head angle corresponding to correct posture. If the actual head angle deviates from the predetermined head angle, a stimulus may be provided from the mobile device to encourage the user to rotate their head and/or reposition the mobile device such that their actual head angle aligns with the predetermined head angle. ## Claims ### Claim 1 A system for stimulating a mobile device user to correct improper posture, comprising: a mobile device, comprising: an orientation element configured to determine an actual orientation of the mobile device, and a camera for capturing a plurality of 2D images of the mobile device user's face to determine a relative orientation of the mobile device user's head to the mobile device, wherein an actual head angle is calculated from the actual orientation of the mobile device and the relative orientation of the mobile device user's head to the mobile device; wherein a stimulus is provided to the mobile device user if the actual head angle deviates from a predetermined head angle based on the relative orientation of the mobile device user's head to the mobile device. ### Claim 2 (depends on 1) The system of claim 1, wherein the orientation element comprises at least one of an accelerometer, gyroscope, altimeter, magnetic sensor, differential capacitor or combinations thereof. ### Claim 3 (depends on 1) The system of claim 1, wherein the system: identifies at least two landmarks on each of the plurality of 2D images of the mobile user device's face; and determines the spacing between the at least two landmarks, wherein the spacing corresponds to the actual head angle of the mobile device user's head. ### Claim 4 (depends on 3) The system of claim 3, wherein the at least two landmarks each comprise at least one of eye, nose, ears, mouth, other facial structure, and combinations thereof. ### Claim 5 (depends on 3) The system of claim 3, wherein the plurality of 2D images include at least a first 2D image including a first spacing between the at least two landmarks and a second 2D image including a second spacing between the at least two landmarks; wherein the difference between the first spacing and the second spacing corresponds to rotation of the mobile device user's head to a different actual head angle. ### Claim 6 (depends on 5) The system of claim 5, wherein the first 2D image is a reference image captured when the mobile device user's head is positioned in a known relative orientation to the mobile device. ### Claim 7 (depends on 1) The system of claim 1, wherein the mobile device further comprises: a display for displaying a display image; and a speaker for emitting sound. ### Claim 8 (depends on 7) The system of claim 7, wherein the stimulus comprises at least one of a notification displayed on the display, altering the display image displayed on the display, an audio alert emitted from the speaker, and combinations thereof. ### Claim 9 (depends on 8) The system of claim 8, wherein the stimulus is varied according to the deviation of the actual head angle from the predetermined head angle. ### Claim 10 (depends on 7) The system of claim 7, wherein the display image is shifted vertically on the display such that at least a portion of the display image is obscured if the actual head angle from the predetermined head angle. ### Claim 11 (depends on 10) The system of claim 10, wherein the vertical shift is varied according to the deviation of the actual head angle from the predetermined head angle. ### Claim 12 (depends on 10) The system of claim 10, wherein the vertical shift is varied as mobile device user repositions their head or the mobile device to align the actual head angle with the predetermined head angle to guide the mobile device user in aligning the actual head angle with the predetermined head angle. ### Claim 13 A method for stimulating a mobile device user to correct improper posture, comprising: determining an actual orientation of a mobile device; capturing a plurality of 2D images of the mobile device user's face to determine a relative orientation of the mobile device user's head to the mobile device; calculating an actual head angle from the actual orientation of the mobile device and the relative orientation of the mobile device user's head to the mobile device; providing a stimulus to the mobile device user if the actual head angle deviates from a predetermined head angle; and stopping presentation of the stimulus when the actual head angle aligns with the pre-determined head angle. ### Claim 14 (depends on 13) The method of claim 13, wherein the actual orientation of the mobile device is determined with an orientation element comprising at least one of an accelerometer, gyroscope, altimeter, magnetic sensor, differential capacitor or combinations thereof. ### Claim 15 (depends on 13) The method of claim 13, further comprising: identifying at least two landmarks on each of the plurality of 2D images of the mobile user device's face; and determining spacing between the at least two landmarks, wherein the spacing corresponding to the actual head angle of the mobile device user's head. ### Claim 16 (depends on 15) The method of claim 15, wherein the at least two landmarks comprises at least two of eye, nose, ears, mouth, or other facial structure. ### Claim 17 (depends on 15) The method of claim 15, wherein the plurality of 2D images include at least a first 2D image including a first spacing between the at least two landmarks and a second 2D image including a second spacing between the at least two landmarks; wherein the difference between the first spacing and the second spacing corresponds to rotation of the mobile device user's head to a different actual head angle. ### Claim 18 (depends on 13) The method of claim 13, wherein the mobile device further comprises: a display for displaying a display image; and a speaker for emitting sound. ### Claim 19 (depends on 18) The method of claim 18, wherein the stimulus comprises at least one of a notification displayed on the display, altering the display image displayed on the display, an audio alert emitted from the speaker, and combinations thereof. ### Claim 20 (depends on 19) The method of claim 19, further comprising: varying the stimulus according to the deviation of the actual head angle from the predetermined head angle. ### Claim 21 (depends on 18) The method of claim 18, further comprising: shifting the display image vertically on the display if the actual head angle from the predetermined head angle. ### Claim 22 (depends on 21) The method of claim 21, further comprising: varying the vertical shift according to the deviation of the actual head angle from the predetermined head angle. ### Claim 23 (depends on 21) The method of claim 21, varying the vertical shift as mobile device user repositions their head or the mobile device to align the actual head angle with the predetermined head angle to guide the mobile device user in aligning the actual head angle with the predetermined head angle. ### Claim 24 A mobile device for stimulating a mobile device user to correct improper posture, comprising: at least one orientation element, a camera, and a controller configured to read computer readable instructions and configured to control operation of the mobile device, wherein the instructions for controlling operation of the sensor system comprises instructions for: determining an actual orientation of the mobile device with the at least one orientation element; capturing a plurality of 2D images of the mobile device user's face with the camera to determine a relative orientation of the mobile device user's head to the mobile device; calculating an actual head angle from the actual orientation of the mobile device and the relative orientation of the mobile device user's head to the mobile device; and providing a stimulus to the mobile device user if the actual head angle relative to the mobile device deviates from a predetermined head angle. ### Claim 25 (depends on 24) The mobile device of claim 24, wherein the instructions for controlling the mobile device comprises instructions for: identifying at least two landmarks on each of the plurality of 2D images of the mobile user device's face; and determining spacing between the at least two landmarks, wherein the spacing corresponding to the actual head angle of the mobile device user's head; wherein the plurality of 2D images include at least a first 2D image including a first spacing between the at least two landmarks and a second 2D image including a second spacing between the at least two landmarks; wherein the difference between the first spacing and the second spacing corresponds to rotation of the mobile device user's head to a different actual head angle.