# US 2024/0203067 A1 · Wearable device, method, and non-transitory computer readable storage medium providing graphic region

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203067 A1
- Document ID: US20240203067A1
- Status: Published application
- Kind: A1
- Application number: 18/486,729
- Filed: 2023-10-13
- Published: 2024-06-20
- Earliest claimed: 2022-12-15
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Eunkyung LEE
- Web page: https://patentgrep.com/patent/US20240203067A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G01C 21/206: {specially adapted for indoor navigation}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/017: {Head mounted}
- G06F 1/16: Constructional details or arrangements
- G06F 3/00: Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06V 40/18: Eye characteristics, e.g. of the iris
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A wearable device is provided. The wearable device includes a display arranged with respect to eyes of a user wearing the wearable device. The wearable device includes a camera including at least one lens that faces a direction corresponding to a direction in which the eyes faces. The wearable device includes a processor. The processor is configured to identify, in response to a schedule, a place labeled with respect to the schedule. The processor is configured to identify, based at least in part on the identification, whether the camera of the wearable device positioned in the place faces a region in the place to which a graphic region for the schedule is set. The processor is configured to display, via the display, at least portion of the graphic region on at least portion of the region, based on identifying that a direction of the camera corresponds to a first direction in which the camera faces the region. The processor is configured to identify, via the display, information for informing the first direction, based on identifying that the direction corresponds to a second direction different from the first direction.

## Claims

### Claim 1

A wearable device comprising:
a display arranged with respect to eyes of a user wearing the wearable device;
a camera comprising at least one lens that faces a direction corresponding to a direction in which the eyes faces;
a processor; and
memory storing instructions that, when executed by the processor, cause the wearable device to:
identify, based on a schedule, a place associated with the schedule,
based on the wearable device being positioned in the place associated with the schedule, identify a direction of the camera of the wearable device with respect to a region in the place to which a graphic region for the schedule is set,
based on identifying that the direction of the camera corresponds to a first direction in which the camera faces the region, display, via the display, at least portion of the graphic region on at least portion of the region, and
based on identifying that the direction corresponds to a second direction different from the first direction, display, via the display, information for informing to change a direction of the camera.

### Claim 2 (depends on 1)

The wearable device of claim 1, wherein the instructions further cause, when executed by the processor, the wearable device to:
display, via the display, information for informing a movement to the place, based on the wearable device being positioned outside of the place associated with the schedule.

### Claim 3 (depends on 1)

The wearable device of claim 1, wherein the instructions cause, when executed by the processor, the wearable device to display, based on the direction corresponding to the first direction, the at least portion of the graphic region by expanding the at least portion of the graphic region from a portion of the region spaced apart from the wearable device to another portion of the region adjacent to the wearable device.

### Claim 4 (depends on 1)

The wearable device of claim 1, wherein the instructions further cause, when executed by the processor, the wearable device to display, via the display, an execution screen of each of one or more software applications set for the schedule, with the at least portion of the graphic region, based on the direction corresponding to the first direction.

### Claim 5 (depends on 4)

The wearable device of claim 4, wherein the instructions further cause, when executed by the processor, the wearable device to cease displaying one or more execution screens of one or more other software applications, distinct from the one or more software applications, based on the direction corresponding to the first direction.

### Claim 6 (depends on 5)

The wearable device of claim 5, further comprising:
another camera facing the eyes,
wherein the instructions further cause, when executed by the processor, the wearable device to:
identify a gaze of the user through images obtained by using the other camera, and
cease displaying a first execution screen positioned outside of the gaze from among the one or more execution screens, based on the direction corresponding to the first direction, and
wherein a second execution screen in which the gaze is positioned from among the one or more execution screens is maintained via the display, independently from the direction corresponding to the first direction.

### Claim 7 (depends on 6)

The wearable device of claim 6, wherein the instructions further cause, when executed by the processor, the wearable device to cease representing content provided through the second execution screen maintained via the display.

### Claim 8 (depends on 1)

The wearable device of claim 1, wherein the instructions further cause, when executed by the processor, the wearable device to:
display, via the display, a message comprising an executable object for stopping to display the graphic region, while at least portion of the graphic region appears, and
display, via the display, a portion of the region and a portion of the graphic region by stopping to display the graphic region, in response to a user input on the executable object.

### Claim 9 (depends on 1)

The wearable device of claim 1, wherein the instructions further cause, when executed by the processor, the wearable device to:
display, via the display, a message comprising an executable object for ceasing to display the graphic region on the region, while at least portion of the graphic region appears, and
maintain to provide the region, by ceasing to display a portion of the graphic region displayed based on the direction corresponding to the first direction, in response to a user input on the executable object.

### Claim 10 (depends on 1)

The wearable device of claim 1, wherein the instructions further cause, when executed by the processor, the wearable device to:
obtain biometric data of the user,
display, in a virtual reality environment, the at least portion of the graphic region, based on the direction corresponding to the first direction and the biometric data within reference range, and
display, in a mixed reality environment, the at least portion of the graphic region, based on the direction corresponding to the first direction and the biometric data outside of the reference range.

### Claim 11 (depends on 1)

The wearable device of claim 1, wherein the instructions cause, when executed by the processor, the wearable device to:
identify a level of the schedule,
display, in a virtual reality environment, the at least portion of the graphic region, based on the direction corresponding to the first direction and the level higher than a reference label, and
display, in a mixed reality environment, the at least portion of the graphic region, based on the direction corresponding to the first direction and the level lower than or equal to the reference label.

### Claim 12 (depends on 1)

The wearable device of claim 1, wherein the instructions cause, when executed by the processor, the wearable device to:
obtain data indicating illuminance around the wearable device, and
display the at least portion of the graphic region in a brightness identified based on the illuminance in response to the direction corresponding to the first direction.

### Claim 13 (depends on 1)

The wearable device of claim 1, wherein the instructions cause, when executed by the processor, the wearable device to:
identify, while the at least portion of the graphic region is displayed via the display, a progress status of the schedule, based on biometric data of the user, and
based on the progress status, maintain to display the at least portion of the graphic region or change the at least portion of the graphic region to at least portion of another graphic region set with respect to the region for the schedule.

### Claim 14 (depends on 1)

The wearable device of claim 1, wherein the instructions cause, when executed by the processor, the wearable device to:
identify another schedule, distinct from the schedule, registered with respect to the region through an account of the user, while the at least portion of the graphic region is displayed via the display, and
display, via the display, at least portion of another graphic region for the other schedule, on at least portion of the region, in response to the other schedule being identified.

### Claim 15 (depends on 1)

The wearable device of claim 1, further comprising:
a communication circuit,
wherein the instructions further cause, when executed by the processor, the wearable device to:
identify an electronic device being positioned in the region, via the camera or the communication circuit, and
transmit, to the electronic device via the communication circuit, a signal for changing settings of the electronic device to settings for the schedule, based on the direction corresponding to the first direction.

### Claim 16 (depends on 1)

The wearable device of claim 1, further comprising:
a communication circuit,
wherein the instructions further cause, when executed by the processor, the wearable device to:
identify an electronic device, comprising a display, positioned in the region, via the camera or the communication circuit, and
based on the direction corresponding to the first direction:
display, via the display, an execution screen of a first software application set for the schedule, with the at least portion of the graphic region, and
transmit, to the electronic device via the communication circuit, a signal for displaying an execution screen of a second software application set for the schedule via the display of the electronic device.

### Claim 17 (depends on 1)

The wearable device of claim 1, further comprising:
a communication circuit,
wherein the instructions further cause, when executed by the processor, the wearable device to:
register, through a software application, the schedule associated with the place including the region to which the graphic region is set,
based on the registration, transmit, via the communication circuit to a server, information on the schedule,
while the software application is in an inactive state, receive, via the communication circuit, a signal transmitted from the server in response to identifying the schedule based on the information,
change, in response to the signal, a state of the software application from the inactive state to an active state, and
execute operations for displaying via the display the at least portion of the graphic region, by using the software application changed to the active state.

### Claim 18 (depends on 1)

The wearable device of claim 1, further comprising:
a communication circuit,
wherein the instructions further cause, when executed by the processor, the wearable device to:
register, through a software application, the schedule associated with the place including the region to which the graphic region is set,
based on the registration, transmit, via the communication circuit to a server, information on the schedule,
receive, via the communication circuit, a signal transmitted from the server in response to identifying the schedule based on the information,
change, in response to the signal, states of one or more other software applications indicated by the signal to active states, and
execute operations for displaying via the display the at least portion of the graphic region, based at least in part on the one or more other software applications changed to the active states.

### Claim 19 (depends on 1)

The wearable device of claim 1, further comprising:
a communication circuit,
wherein the instructions further cause, when executed by the processor, the wearable device to:
register, through a software application, the schedule associated with the place including the region to which the graphic region is set,
based on the registration, transmit, via the communication circuit to a server, information on the schedule, and
provide, through an operating system, data for accessing to the information in the server, to one or more other software applications in the wearable device, the one or more other software applications capable of processing the schedule.

### Claim 20 (depends on 1)

The wearable device of claim 1, wherein the instructions further cause, when executed by the processor, the wearable device to:
register, through a software application, the schedule associated with the place including the region to which the graphic region is set, and
provide, through an operating system to one or more other software applications in the wearable device, data indicating a location in which information on the schedule is stored according to the registration, the one or more other software applications capable of processing the schedule.
