# US 2023/0058340 A1 · Wearable electronic device for displaying augmented reality object and method for operating the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0058340 A1
- Document ID: US20230058340A1
- Status: Published application
- Kind: A1
- Application number: 17/893,605
- Filed: 2022-08-23
- Published: 2023-02-23
- Earliest claimed: 2021-08-23
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jinhong JEONG; Eunsu JEONG; Minji CHO; Seokhyun KIM; Gajin SONG; Sunkey LEE; Chaigil LIM
- Web page: https://patentgrep.com/patent/US20230058340A1

## CPC

- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G09G 5/38: with means for controlling the display position
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/01: Head-up displays
- G02B 27/0172: {characterised by optical features}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G06F 3/00: Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G09G 5/373: for modifying the size of the graphic pattern
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G09G 2340/0464: Positioning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A wearable electronic device is provided. The electronic device includes a camera, a communication circuit, a display including a transparent lens and displaying content through the lens, and a processor, wherein the processor may be configured to obtain first information about a first device indicated by a first object through the communication circuit when the first object is selected from among a plurality of objects for controlling devices displayed on an external electronic device, identify a first position for displaying the first information corresponding to the first object as an augmented reality image, based on a gaze direction of a user identified through the camera, determine a property of the augmented reality image, based on a user input, and control the display to display the augmented reality image having the property at the first position.

## Claims

### Claim 1

A wearable electronic device comprising:
a camera;
a communication circuit;
a display including a transparent lens and displaying content through the lens; and
a processor,
wherein the processor is configured to:
obtain first information about a first device indicated by a first object through the communication circuit when the first object is selected from among a plurality of objects for controlling devices displayed on an external electronic device,
identify a first position for displaying the first information corresponding to the first object as an augmented reality image, based on a gaze direction of a user identified through the camera,
identify a property of the augmented reality image, based on a user input, and
control the display to display the augmented reality image having the property at the first position.

### Claim 2 (depends on 1)

The wearable electronic device of claim 1, wherein the processor is further configured to adjust at least one of a size, form, shape, transparency, slope, direction, color, or position of the augmented reality image, based on the user input.

### Claim 3 (depends on 2)

The wearable electronic device of claim 2, wherein the processor is further configured to identify the user input, based on a gesture of the user identified through a sensor comprised in the wearable electronic device.

### Claim 4 (depends on 2)

The wearable electronic device of claim 2, wherein the processor is further configured to determine the user input, based on an input to the external electronic device.

### Claim 5 (depends on 1)

The wearable electronic device of claim 1, wherein the processor is further configured to:
identify whether the user gazes at the first object for a specified time through the camera, and
select the first object when the user gazes at the first object for the specified time.

### Claim 6 (depends on 5)

The wearable electronic device of claim 5, wherein the processor is further configured to:
identify an identifier of the first object comprised in the first object displayed on the external electronic device through the camera, and
identify whether the user gazes at the first object using the identified identifier.

### Claim 7 (depends on 1)

The wearable electronic device of claim 1, wherein the processor is further configured to receive information indicating selection of the first object and the first information about the device indicated by the first object from the external electronic device when the first object is selected by a user input in the external electronic device.

### Claim 8 (depends on 1)

The wearable electronic device of claim 1, wherein the processor is further configured to:
obtain three-dimensional (3D) space coordinate information about an area indicated by the gaze direction, and
identify the first position, based on a first coordinate corresponding to the gaze direction among coordinates of a closed space comprised in the 3D coordinate information.

### Claim 9 (depends on 1)

The wearable electronic device of claim 1, wherein the processor is further configured to control the display to display an image showing a path between a position indicated by a first coordinate and the wearable electronic device.

### Claim 10 (depends on 1)

The wearable electronic device of claim 1, wherein the processor is further configured to control the display to display the augmented reality image to be fixed at the first position.

### Claim 11

An operating method of a wearable electronic device, the method comprising:
obtaining first information about a first device indicated by a first object through a communication circuit of the wearable electronic device when the first object is selected from among a plurality of objects for controlling devices displayed on an external electronic device;
identifying a first position for displaying the first information corresponding to the first object as an augmented reality image, based on a gaze direction of a user identified through a camera of the wearable electronic device;
identifying a property of the augmented reality image, based on a user input; and
displaying the augmented reality image having the property at the first position through a display including a transparent lens comprised in the wearable electronic device.

### Claim 12 (depends on 11)

The method of claim 11, wherein the identifying of the property of the augmented reality image, based on the user input, comprises adjusting at least one of a size, form, shape, transparency, slope, direction, color, or position of the augmented reality image, based on the user input.

### Claim 13 (depends on 12)

The method of claim 12, wherein the identifying of the property of the augmented reality image, based on the user input, comprises identfying the user input, based on a gesture of the user identified through a sensor comprised in the wearable electronic device.

### Claim 14 (depends on 12)

The method of claim 12, wherein the identifying of the property of the augmented reality image, based on the user input, comprises determining the user input, based on an input to the external electronic device.

### Claim 15 (depends on 11)

The method of claim 11, further comprising:
identifying whether the user gazes at the first object for a specified time through the camera; and
selecting the first object when the user gazes at the first object for the specified time.

### Claim 16 (depends on 15)

The method of claim 15, wherein the identifying whether the user gazes at the first object comprises:
identifying an identifier of the first object comprised in the first object displayed on the external electronic device through the camera; and
identifying whether the user gazes at the first object using the identified identifier.

### Claim 17 (depends on 11)

The method of claim 11, wherein the identifying of the first position comprises:
obtaining three-dimensional (3D) space coordinate information about an area indicated by the gaze direction; and
identfying the first position, based on a first coordinate corresponding to the gaze direction among coordinates of a closed space comprised in the 3D coordinate information.

### Claim 18 (depends on 11)

The method of claim 11, further comprising:
displaying an image showing a path between a position indicated by a first coordinate and the wearable electronic device through the display.

### Claim 19 (depends on 11)

The method of claim 11, wherein the displaying of the augmented reality image at the first position comprises displaying the augmented reality image to be fixed at the first position through the display.

### Claim 20

A non-transitory recording medium storing a program, the program comprising instructions configured to, when executed by at least one processor of a wearable electronic device, cause the wearable electronic device to:
obtain first information about a first device indicated by a first object through a communication circuit of the wearable electronic device when the first object is selected from among a plurality of objects for controlling devices displayed on an external electronic device;
identify a first position for displaying the first information corresponding to the first object as an augmented reality image, based on a gaze direction of a user identified through a camera of the wearable electronic device;
identify a property of the augmented reality image, based on a user input; and
display the augmented reality image having the property at the first position through a display including a transparent lens comprised in the wearable electronic device.

### Claim 21 (depends on 20)

The non-transitory recording medium of claim 20, wherein the gaze direction is based on coordinates of the first position in real space.

### Claim 22 (depends on 20)

The non-transitory recording medium of claim 20, wherein the user input includes at least one of a touch input, a gesture input, or a voice input.

### Claim 23 (depends on 20)

The non-transitory recording medium of claim 20, wherein the camera includes a camera for tracking a hand and a camera for tracking an eye.
