# US 9,727,211 B2 · Systems and methods for unlocking a wearable device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,727,211 B2 - Document ID: US9727211B2 - Status: Granted - Kind: B2 - Application number: 14/966,066 - Filed: 2015-12-11 - Published: 2016-04-07 - Granted: 2017-08-08 - Earliest claimed: 2013-12-01 - Assignees: Upskill, Inc. - Applicants: UPSKILL, Inc. - Inventors: Brian Adams Ballard; Wonjae Kim; Jeffrey Edward Jenkins; Todd Richard Reily - Web page: https://patentgrep.com/patent/US9727211B2 ## CPC - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - A45C 11/00: Receptacles for purposes not provided for in groups A45C1/00-A45C9/00 (specially adapted for toiletry or cosmetic equipment A45D29/20, A45D44/18; travelling sewing kits A45F3/48) - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/017: {Head mounted} - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 3/012: {Head tracking input arrangements} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/0485: Scrolling or panning - G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 21/71: to assure secure computing or processing of information - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission} - H04L 67/52: specially adapted for the location of the user terminal - H04M 1/72454: according to context-related or environment-related conditions - H04N 23/51: Housings - H04N 23/61: based on recognised objects - H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters} - H04N 23/635: {Region indicators; Field of view indicators} - H04W 4/08: User group management - H04W 12/084: using delegated authorisation, e.g. open authorisation [OAuth] protocol - H04W 76/10: Connection setup - A45C 11/002: {for storing portable handheld communication devices, e.g. pagers or smart phones} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0141: {characterised by the informative content of the display} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/0486: Drag-and-drop - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A45C: PURSES; LUGGAGE; HAND CARRIED BAGS - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract Systems and methods allow a user to interact with an augmented reality device. In one implementation, a lockable, wearable device is provided. The wearable device comprises a display; at least one sensor configured to provide an output indicative of a viewing direction of a user; and at least one processing device. The at least one processing device is configured to track a pattern of the viewing direction of the user; and unlock the lockable, wearable device to provide the user with access to information on the display of the device when the tracked pattern of movement matches a predetermined pattern of movement. ## Claims ### Claim 1 A wearable device, comprising: a display; at least one sensor configured to provide an output indicative of a viewing direction of a user; and at least one processing device configured to: cause a plurality of graphical objects to be displayed on the display; track a pattern of movement of a plurality of viewing directions as the user views the graphical objects; determine an input value based on a time duration during which a viewing direction is maintained toward a graphical object; and unlock the wearable device to display additional information to the user when the pattern of movement of the viewing directions matches a predetermined pattern associated with the graphical objects, and when input values associated with the viewing directions match predetermined values associated with the graphical objects. ### Claim 2 (depends on 1) The wearable device of claim 1, wherein the processing device is further configured to determine the viewing direction of the user based on at least one of an orientation of a head of the user or a gaze direction of an eye of the user. ### Claim 3 (depends on 1) The wearable device of claim 1, wherein each of the plurality of graphical objects is associated with a time duration. ### Claim 4 (depends on 3) The wearable device of claim 3, wherein the processing device is further configured to select a graphical object when a viewing direction has been maintained toward the graphical object for a time period that is greater than or equal to the time duration associated with the graphical object. ### Claim 5 (depends on 1) The wearable device of claim 1, wherein the processing device is further configured to: cause a cursor to be displayed on the display; and move the cursor on the display over a graphical object based on an orientation of a head of the user or a gaze direction of an eye of the user. ### Claim 6 (depends on 5) The wearable device of claim 5, wherein the input value comprises a dwell time, and wherein the processing device is further configured to determine the dwell time associated with each viewing direction during which the cursor stays overlapping the graphical object on the display. ### Claim 7 (depends on 5) The wearable device of claim 5, wherein the processing device is further configured to determine the input value associated with the viewing direction based on accuracy of an alignment of the cursor over the graphical object. ### Claim 8 (depends on 5) The wearable device of claim 5, wherein the processing device is further configured to determine the input value based on a speed at which the cursor is moved to the graphical object. ### Claim 9 (depends on 1) The wearable device of claim 1, wherein the processing device is further configured to cause a graphical representation of the input value to be displayed on the display. ### Claim 10 (depends on 9) The wearable device of claim 9, wherein the processing device is further configured to change the graphical representation of the input value as the input value changes. ### Claim 11 (depends on 10) The wearable device of claim 10, wherein the processing device is further configured to change the graphical representation of the input value as a time duration increases during which the viewing direction is maintained toward the graphical object. ### Claim 12 (depends on 9) The wearable device of claim 9, wherein the graphical representation is one of a number, a color, or a letter of an alphabet. ### Claim 13 (depends on 8) The wearable device of claim 8, wherein the processing device is further configured to determine the input value associated with the viewing direction based on a time duration during which the viewing direction is maintained toward the graphical object. ### Claim 14 (depends on 11) The wearable device of claim 11, wherein the plurality of graphical objects are assigned with a plurality of predetermined values, and wherein the processing device is further configured to determine whether a sequence of input values matches a predetermined sequence of the predetermined values assigned to the plurality of graphical objects. ### Claim 15 (depends on 1) The wearable device of claim 1, wherein the processing device is further configured to increase the input value by a predetermined value when a predetermined time duration associated with the graphical object has passed while the viewing direction is maintained toward the graphical object. ### Claim 16 A method of unlocking a wearable device, comprising: displaying a plurality of graphical objects on a display; receiving an output from a sensor indicative of a viewing direction of a user of the wearable device; tracking a pattern of movement of a plurality of viewing directions as the user views the graphical objects; determining an input value based on a time duration during which a viewing direction is maintained toward a graphical object; and unlocking the wearable device to display additional information to the user when the pattern of movement of the viewing directions matches a predetermined pattern associated with the graphical objects, and when input values associated with the viewing directions match predetermined values associated with the graphical objects. ### Claim 17 (depends on 16) The method of claim 16, further comprising: displaying a graphical representation of the input value on the display. ### Claim 18 (depends on 17) The method of claim 17, further comprising: changing the graphical representation of the input value as the input value changes.