# US 2021/0233315 A1 · Xr device for providing ar mode and vr mode and method for controlling the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0233315 A1
- Document ID: US20210233315A1
- Status: Published application
- Kind: A1
- Application number: 16/820,198
- Filed: 2020-03-16
- Published: 2021-07-29
- Earliest claimed: 2020-01-29
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Hansaem JUNG
- Web page: https://patentgrep.com/patent/US20210233315A1

## CPC

- G06F 3/012: {Head tracking input arrangements}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06V 20/20: in augmented reality scenes
- H04B 1/385: {Transceivers carried on the body, e.g. in helmets}
- G06T 2215/16: Using real world measurements to influence rendering
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04B: TRANSMISSION

## Abstract

An XR device and a method for controlling the same are disclosed. The method comprises recognizing fixed objects and a background specific area from VR image; checking a sensed angular velocity of the XR device when the fixed objects move to a first direction within a first predetermined time and a distance between the fixed objects and the background specific area is changed; if the angular velocity is a preset first angular velocity or more, controlling a display to display VR image corresponding to a front view by moving the VR image to a second direction opposite to the first direction at the angular velocity; and if movement of the fixed objects is stopped, controlling the display to display the VR image corresponding to the front view by moving the VR image to a position of the fixed objects in the first direction at a second angular velocity different from the first angular velocity, whereby a user's view is recovered to an original state corresponding to the front view of the fixed objects from the existing view.

## Claims

### Claim 1

An XR device comprising:
a wireless communication module configured to transcieve data with an external device;
a display configured to display VR image;
a sensor module configured to sense an angular velocity of the XR device; and
a controller configured to:
recognize fixed objects, which mean objects continuously displayed on a certain area of the VR image, and a background specific area, which means a partial area of the VR image, from the VR image,
check the sensed angular velocity of the XR device when the fixed objects move to a first direction within a first predetermined time and a distance between the fixed objects and the background specific area is changed,
when the angular velocity is a preset first angular velocity or more, control the display to display VR image corresponding to a front view by moving the VR image to a second direction opposite to the first direction at the angular velocity, and
when movement of the fixed objects is stopped for a predetermined time, control the display to display the VR image corresponding to the front view by moving the VR image to a position of the fixed objects in the first direction at a second angular velocity different from the first angular velocity.

### Claim 2 (depends on 1)

The XR device of claim 1, wherein the VR image includes an image where the fixed objects are separated from a background.

### Claim 3 (depends on 1)

The XR device of claim 1, wherein the controller is further configured to control the display to display the fixed objects and the background specific area independently from each other.

### Claim 4 (depends on 1)

The XR device of claim 1, wherein the controller is further configured to controls the display to display the background specific area by enlarging the background specific area when the fixed objects approach the background specific area.

### Claim 5 (depends on 1)

The XR device of claim 1, wherein the controller is further configured to controls the display to display the background specific area by downsizing the background specific area when the fixed objects are far away from the background specific area.

### Claim 6 (depends on 1)

The XR device of claim 1, wherein the controller is further configured to control the display to display a new background specific area on a center of a screen when the background specific area disappears in accordance with movement of the fixed objects.

### Claim 7 (depends on 1)

The XR device of claim 1, wherein the controller is further configured to set the second angular velocity to be slower than the first angular velocity.

### Claim 8 (depends on 1)

The XR device of claim 1, wherein the controller is further configured to:
analyze a timeline of the VR image before displaying the VR image if the VR image is a VR video file type, and
control the display to display the background specific area per analyzed timeline.

### Claim 9 (depends on 1)

The XR device of claim 1, wherein the VR image includes VR image captured by a first person view.

### Claim 10 (depends on 1)

The XR device of claim 1, wherein the controller is further configured to selects a fixed object having the highest weight value among a plurality of fixed objects if the VR image includes the plurality of fixed objects.

### Claim 11

A method for controlling an XR device, the method comprising:
controlling a display to display VR image;
controlling a sensor module to sense an angular velocity of the XR device;
recognizing fixed objects, which mean objects continuously displayed on a certain area of the VR image, and a background specific area, which means a partial area at a center of the VR image, from the VR image;
checking the sensed angular velocity of the XR device when the fixed objects move to a first direction within a first predetermined time and a distance between the fixed objects and the background specific area is changed;
when the angular velocity is a preset first angular velocity or more, controlling the display to display VR image corresponding to a front view by moving the VR image to a second direction opposite to the first direction at the angular velocity; and
when movement of the fixed objects is stopped for a predetermined time, controlling the display to display the VR image corresponding to the front view by moving the VR image to a position of the fixed objects in the first direction at a second angular velocity different from the first angular velocity.

### Claim 12 (depends on 11)

The method of claim 11, wherein the VR image includes an image where the fixed objects are separated from a background.

### Claim 13 (depends on 11)

The method of claim 11, further comprising controlling the display to display the fixed objects and the background specific area independently from each other.

### Claim 14 (depends on 11)

The method of claim 11, further comprising controlling the display to display the background specific area by enlarging the background specific area when the fixed objects approach the background specific area.

### Claim 15 (depends on 11)

The method of claim 11, further comprising controlling the display to display the background specific area by downsizing the background specific area when the fixed objects are far away from the background specific area.

### Claim 16 (depends on 11)

The method of claim 11, further comprising controlling the display to display a new background specific area on a center of a screen when the background specific area disappears in accordance with movement of the fixed objects.

### Claim 17 (depends on 11)

The method of claim 11, further comprising setting the second angular velocity to be slower than the first angular velocity.

### Claim 18 (depends on 11)

The method of claim 11, further comprising controlling analyzing a timeline of the VR image before displaying the VR image if the VR image is a VR video file type, and controlling the display to display the background specific area per analyzed timeline.

### Claim 19 (depends on 11)

The method of claim 11, wherein the VR image includes VR image captured by a first person view.

### Claim 20 (depends on 11)

The method of claim 11, further comprising selecting a fixed object having the highest weight value among a plurality of fixed objects if the VR image includes the plurality of fixed objects.
