# US 2021/0065447 A1 · Xr device and method for controlling the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0065447 A1
- Document ID: US20210065447A1
- Status: Published application
- Kind: A1
- Application number: 16/588,514
- Filed: 2019-09-30
- Published: 2021-03-04
- Earliest claimed: 2019-09-02
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Wonbeom Lee
- Web page: https://patentgrep.com/patent/US20210065447A1

## CPC

- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2210/16: Cloth
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G06T 2219/2024: Style variation
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An XR device includes a camera, a camera configured to capture a peripheral region of the XR device, and a display configured to display data captured by the camera and XR content based on information stored in the memory. The XR content may include an avatar representing a user captured by the camera, and a controller connected to each of the memory, the camera, and the display. A method for controlling an XR device includes capturing, by a camera, a peripheral region of the XR device, displaying, by the display, data captured by the camera and XR content based on information stored in the memory of the XR device, the XR content including an avatar representing a user captured by the camera, and controlling the avatar by a controller connected to each of the memory, the camera, and the display.

## Claims

### Claim 1

An XR device comprising:
a camera;
a camera configured to capture a peripheral region of the XR device; and
a display configured to display data captured by the camera and XR content based on information stored in the memory,
wherein the XR content includes
an avatar representing a user captured by the camera, and
a controller connected to each of the memory, the camera, and the display.

### Claim 2 (depends on 1)

The XR device according to claim 1, wherein:
the avatar is updated based on information stored in the memory and skeleton information of the user; and
the avatar is estimated based on history information stored in the memory.

### Claim 3 (depends on 2)

The XR device according to claim 2, wherein:
the memory stores skeleton information of the user;
the controller estimates the avatar based on the stored skeleton information; and
the display displays clothing recommendation information for the user using the estimated avatar.

### Claim 4 (depends on 1)

The XR device according to claim 1, wherein:
in response to a user input signal including user-selected clothing information received from the user,
the display displays the avatar based on XR content about the user-selected clothing information; and
if the XR content about the user-selected clothing information is inappropriate for the avatar, the display notifies of modification information of the XR content suitable for the avatar, modifies the XR content to be suitable for the avatar, displays the modified XR content, estimates the avatar based on information stored in the memory, and displays the resultant XR content.

### Claim 5 (depends on 1)

The XR device according to claim 1, wherein:
in response to a user input signal including user-selected clothing information received from the user,
the display displays the avatar based on XR content about the user-selected clothing information, estimates the avatar based on history information of the memory, displays the XR content, and displays information about a relationship between the XR content and the estimated avatar.

### Claim 6 (depends on 1)

The XR device according to claim 1, wherein:
the display displays the avatar, and creates a past appearance of the avatar or a future appearance of the avatar based on information stored in the memory by referring to the user-selected clothing information and a gesture signal of the user.

### Claim 7 (depends on 1)

The XR device according to claim 1, wherein:
the controller estimates the avatar based on schedule information stored in the memory,
the display notifies of matching information between the estimated avatar and clothing information, and displays history information of the clothing information, and
the controller creates guidance information for the clothing information based on information stored in the memory.

### Claim 8 (depends on 1)

The XR device according to claim 1, wherein:
the display displays information representing plural clothing of the user;
the controller creates an avatar related to a past time, an avatar related to a current time, and an avatar related to a future time based on information stored in the memory, compares the clothing of the user with the avatars, and determines whether the clothing is suitable for the avatar so as to recognize the presence or absence of suitability information;
the display displays the suitability information based on the past time, the current time, and the future time;
the controller acquires weather information based on the current time and the future time; and
the display filters out some clothing not suitable for the current time based on the weather information.

### Claim 9 (depends on 1)

The XR device according to claim 1, wherein:
if the avatar is estimated based on skeleton information of the user, the controller creates at least two estimated types of avatars, creates a first weight about the first-type estimated avatar from among the at least two estimated avatars and a second weight about the second-type estimated avatar from among the at least two estimated avatars; and
the display classifies information representing plural clothing of the user based on the first weight and the second weight.

### Claim 10 (depends on 1)

The XR device according to claim 1, wherein:
the memory includes skeleton information of a virtual fitting avatar;
the controller matches the virtual fitting avatar to clothing information; and
the display notifies of the matched clothing information.

### Claim 11

A method for controlling an XR device comprising:
capturing, by a camera, a peripheral region of the XR device;
displaying, by the display, data captured by the camera and XR content based on information stored in the memory of the XR device, the XR content including an avatar representing a user captured by the camera; and
controlling the avatar by a controller connected to each of the memory, the camera, and the display.

### Claim 12 (depends on 11)

The method according to claim 11, wherein:
the avatar is updated based on information stored in the memory and skeleton information of the user; and
the avatar is estimated based on history information stored in the memory.

### Claim 13 (depends on 12)

The method according to claim 12, wherein:
the memory stores skeleton information of the user;
the controller estimates the avatar based on the stored skeleton information; and
the display displays clothing recommendation information for the user using the estimated avatar.

### Claim 14 (depends on 11)

The method according to claim 11, wherein:
in response to a user input signal including user-selected clothing information received from the user,
the display displays the avatar based on XR content about the user-selected clothing information; and
if the XR content about the user-selected clothing information is inappropriate for the avatar, the display notifies of modification information of the XR content suitable for the avatar, modifies the XR content to be suitable for the avatar, displays the modified XR content, estimates the avatar based on information stored in the memory, and displays the resultant XR content.

### Claim 15 (depends on 11)

The method according to claim 11, wherein:
in response to a user input signal including user-selected clothing information received from the user,
the display displays the avatar based on XR content about the user-selected clothing information, estimates the avatar based on history information of the memory, displays the XR content, and displays information about a relationship between the XR content and the estimated avatar.

### Claim 16 (depends on 11)

The method according to claim 11, wherein:
the display displays the avatar, and creates a past appearance of the avatar or a future appearance of the avatar based on information stored in the memory by referring to the user-selected clothing information and a gesture signal of the user.

### Claim 17 (depends on 11)

The method according to claim 11, wherein:
the controller estimates the avatar based on schedule information stored in the memory,
the display notifies of matching information between the estimated avatar and clothing information, and displays history information of the clothing information, and
the controller creates guidance information for the clothing information based on information stored in the memory.

### Claim 18 (depends on 11)

The method according to claim 11, wherein:
the display displays information representing plural clothing of the user;
the controller creates an avatar related to a past time, an avatar related to a current time, and an avatar related to a future time based on information stored in the memory, compares the clothing of the user with the avatars, and determines whether the clothing is suitable for the avatar so as to recognize the presence or absence of suitability information;
the display displays the suitability information based on the past time, the current time, and the future time;
the controller acquires weather information based on the current time and the future time; and
the display filters out some clothing not suitable for the current time based on the weather information.

### Claim 19 (depends on 11)

The method according to claim 11 wherein:
if the avatar is estimated based on skeleton information of the user, the controller creates at least two estimated types of avatars, creates a first weight about the first-type estimated avatar from among the at least two estimated avatars and a second weight about the second-type estimated avatar from among the at least two estimated avatars; and
the display classifies information representing plural clothing of the user based on the first weight and the second weight.

### Claim 20 (depends on 11)

The method according to claim 11, wherein:
the memory includes skeleton information of a virtual fitting avatar;
the controller matches the virtual fitting avatar to clothing information; and
the display notifies of the matched clothing information.
