# US 2021/0174602 A1 · Integrated rendering method for various extended reality modes and device having thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174602 A1
- Document ID: US20210174602A1
- Status: Published application
- Kind: A1
- Application number: 17/036,119
- Filed: 2020-09-29
- Published: 2021-06-10
- Earliest claimed: 2019-12-10
- Assignees: Korea Institute of Science and Technology
- Applicants: Korea Institute of Science and Technology
- Inventors: Byounghyun Yoo; Yongjae Lee
- Web page: https://patentgrep.com/patent/US20210174602A1

## CPC

- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Relating to an the integrated rendering method for various extended reality modes and a device having thereof, loading an XR-scene content including at least one virtual object content representing an extended reality image from a storage and representing a virtual object included in the extended reality image; inputting a selection, from a user, of any one extended reality mode among a plurality of extended reality modes including a virtual reality mode and an augmented reality mode; and maintaining or converting a property of each of a plurality of rendering options for at least one virtual object content according to the selected extended reality mode, and rendering at least one virtual object content having the maintained or converted property. Therefore, a virtual reality image and an augmented reality image can be generate from one XR-scene content.

## Claims

### Claim 1

An integrated rendering method for various extended reality modes, the method comprising:
a step of loading an extended reality (XR) scene content representing an XR image and including at least one virtual object content representing a virtual object included in the extended reality image from a storage;
a step of inputting a selection, from a user, of any one extended reality mode among a plurality of extended reality modes including a virtual reality mode and an augmented reality mode; and
a step of maintaining or converting a property of each of a plurality of rendering options for the at least one virtual object content according to the selected extended reality mode, and rendering the at least one virtual object content having the maintained or converted property.

### Claim 2 (depends on 1)

The integrated rendering method for various extended reality modes of claim 1,
wherein in the step of rendering,
when the selected extended reality mode is the virtual reality mode, maintaining the property of each of the plurality of rendering options and rendering the at least one virtual object content according to the maintained property, and
when the selected extended reality mode is the augmented reality mode, converting the property of each of the plurality of rendering options, and rendering the at least one virtual object content according to the converted property.

### Claim 3 (depends on 2)

The integrated rendering method for various extended reality modes of claim 2,
wherein the step of rendering includes
a step of converting, from visible to invisible, a property of a visible option instructing visible or invisible of the virtual object among the plurality of rendering options of the virtual object content, when the selected extended reality mode is the augmented reality mode;
a step of detecting an augmented target object of the augmented reality mode from reality space image data indicating a reality space generated by a camera module;
a step of converting, from invisible to visible, the property of the visible option of the virtual object content included in the XR-scene content corresponding to the detected augmented target object; and
a step of rendering a virtual object in which the property of the visible option of the virtual object content is visible in the XR-scene content.

### Claim 4 (depends on 3)

The integrated rendering method for various extended reality modes of claim 3,
wherein in the step of converting, from invisible to visible, the property of the visible option,
converting, from visible to invisible, a visible option of a remaining virtual object content except for a lighting-related content in the XR-scene content.

### Claim 5 (depends on 3)

The integrated rendering method for various extended reality modes of claim 3,
wherein the step of rendering further includes
a step of converting a ground color option included in the XR-scene content to transparent and converting a background of the extended reality image to the reality space image data, when the selected extended reality mode is the augmented reality mode.

### Claim 6 (depends on 5)

The integrated rendering method for various extended reality modes of claim 5,
wherein the step of rendering further includes
a step of converting, to white, the ground color option included in the XR-scene content and converting, to white, the background of the extended reality image.

### Claim 7 (depends on 3)

The integrated rendering method for various extended reality modes of claim 3,
wherein in the step of detecting the augmented target object,
extracting a shape included in the reality space image data, comparing the extracted shape with a shape of the augmented target object, and detecting a shape matching the shape of the augmented target object as the augmented target object.

### Claim 8 (depends on 1)

A computer-readable recording medium recording a program for executing the method of claim 1 on a computer.

### Claim 9

A user terminal for integrated rendering of various extended reality modes comprising:
a processor that loads an extended reality (XR) scene content representing an XR image and including at least one virtual object content representing a virtual object included in the extended reality image from a storage;
an input module that inputs a selection, from a user, of any one extended reality mode of a plurality of extended reality modes including a virtual reality mode and an augmented reality mode;
a rendering option conversion unit that maintains or converts a property of each of a plurality of rendering options for the at least one virtual object content according to the selected extended reality mode; and
a rendering unit that renders the at least one virtual object content having the maintained or converted property.

### Claim 10

A recording medium on which an XR-scene content including at least one of a virtual object content for a virtual reality and a virtual object content for an augmented reality, and a virtual object content for an extended reality is recorded,
wherein the virtual object content for virtual reality includes a type tag indicating the virtual object content for the virtual reality, and a virtual object tag indicating metadata representing a virtual object for the virtual reality,
wherein the virtual object content for the augmented reality includes a type tag indicating the virtual object content for the augmented reality, and a virtual object tag indicating metadata representing a virtual object for the augmented reality, and
wherein the virtual object content for the extended reality includes a type tag indicating the virtual object content for the extended reality, and a virtual object tag indicating metadata representing a virtual object for the extended reality.

### Claim 11 (depends on 10)

The recording medium on which an XR-scene content is recorded of claim 10,
wherein the virtual object content for the virtual reality is capable of being rendered in a virtual reality mode,
wherein the virtual object content for the augmented reality is capable of being rendered in an augmented reality mode, and
wherein the virtual object content for the extended reality is capable of being rendered in each of the virtual reality mode and the augmented reality mode.
