# US 2019/0172264 A1 · Appratus and method of monitoring vr sickness prediction model for virtual reality content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172264 A1
- Document ID: US20190172264A1
- Status: Published application
- Kind: A1
- Application number: 16/137,228
- Filed: 2018-09-20
- Published: 2019-06-06
- Earliest claimed: 2017-12-05
- Assignees: Electronics and Telecommunications Research Institute
- Applicants: Electronics and Telecommunications Research Institute
- Inventors: Hee Seok OH; Seung Woo NAM; Wook Ho SON; Beom Ryeol LEE
- Web page: https://patentgrep.com/patent/US20190172264A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06N 20/00: Machine learning
- G01N 2800/40: Disorders due to exposure to physical agents, e.g. heat disorders, motion sickness, radiation injuries, altitude sickness, decompression illness
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)

## Abstract

Disclosed is an apparatus and method of monitoring a VR (Virtual Reality) sickness prediction model for virtual reality content. A method of monitoring a VR sickness prediction model according to the present disclosure includes: displaying the virtual reality content on a display unit; acquiring an user input; analyzing the virtual reality content on a basis of the acquired user input; and displaying an analysis result for the virtual reality content on the display unit.

## Claims

### Claim 1

An apparatus for monitoring a VR (Virtual Reality) sickness prediction model for virtual reality content, the apparatus comprising:
a display unit displaying the virtual reality content;
a user input unit acquiring a user input; and
a control unit performing control such that the virtual reality content is analyzed on a basis of the acquired user input and an analysis result for the virtual reality content is displayed on the display unit.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the virtual reality content includes at least one of a first virtual reality content produced in advance and a second virtual reality content displayed on a head mounted display (HMD) device worn by a user as an image corresponding to the first virtual reality content.

### Claim 3 (depends on 2)

The apparatus according to claim 2, wherein the user input includes an input to select at least one playback time of the virtual reality content, and
the controller performs control such that the analysis result for the virtual reality content is displayed on the display unit at a playback section corresponding to the selected at least one playback time.

### Claim 4 (depends on 3)

The apparatus according to claim 3, wherein the user input further includes a first data related to the virtual reality content, a second data acquired by processing the first data, and an input selected so that at least one of a prediction image on the second virtual reality content or a simulation result on the virtual reality content is displayed on the display unit;
the first data includes at least one of VR sickness inducing-factors of the virtual reality content, a first VR sickness information, a second VR sickness information, and a correlation information between the VR sickness-inducing factors determined in advance via machine learning and a VR sickness list;
the VR sickness-inducing factors of the virtual reality content include movement of a camera, movement of an object, playback information, resolution, binocular parallax, depth of field, angle of view, image feature, special effect, and texture effect;
the VR sickness list includes at least one of discomfort, fatigue, headache, eye fatigue, difficulties with focusing, sweating, nausea, difficulties with attention, brain fog, visual acuity, dizziness, hallucinations, stomachache, cyber sickness, burping, and other symptoms as VR sickness list items;
the first VR sickness information includes at least one of an image of the user acquired from an image capturing sensor and a magnitude of a biological signal of the user acquired from a biological signal detection sensor; and
the second VR sickness information is a degree of at least one of the VR sickness list items input from the user in response to a request for inputting the degree of the VR sickness for the virtual reality content.

### Claim 5 (depends on 4)

The apparatus according to claim 4, wherein, when the user input is an input selected to display the first data related to the virtual reality content on the display unit, the controller performs control such that the virtual reality content is analyzed, thereby displaying at least one of the VR sickness inducing-factors of the virtual reality content, the first VR sickness information, the second VR sickness information, and the correlation information between the VR sickness-inducing factors determined in advance via machine learning and the VR sickness list, on the display unit.

### Claim 6 (depends on 4)

The apparatus according to claim 4, wherein, when the user input is an input selected to display the second data on the display unit, the controller performs control such that at least one of the first data is substituted for one of the VR sickness inducing-factors and a result of the substitution is displayed on the display unit.

### Claim 7 (depends on 4)

The apparatus according to claim 4, wherein, when the user input is an input selected to display the prediction image for the second virtual reality content on the display unit, the controller performs control such that the first virtual reality content and the first data are analyzed, thereby determining the prediction image for the second virtual reality content and displaying the determined image on the display unit.

### Claim 8 (depends on 4)

The apparatus according to claim 4, wherein, when the user input is an input selected to display the simulation result for the virtual reality content on the display unit, the controller performs control such that a value of at least one VR sickness list item in the VR sickness list is changed, and the changed VR sickness list is displayed on the display unit using a graphical user interface (GUI), as the user input is additionally acquired in order to change a value of at least one of the VR sickness-inducing factors.

### Claim 9

A method of monitoring a VR (Virtual Reality) sickness prediction model for virtual reality content, the method comprising:
displaying the virtual reality content on a display unit;
acquiring an user input;
analyzing the virtual reality content on a basis of the acquired user input; and
displaying an analysis result for the virtual reality content on the display unit.

### Claim 10 (depends on 9)

The method according to claim 9, wherein the virtual reality content includes at least one of a first virtual reality content produced in advance and a second virtual reality content displayed on an HMD device worn by a user as an image corresponding to the first virtual reality content.

### Claim 11 (depends on 10)

The method according to claim 10, wherein the user input includes an input to select at least one playback time of the virtual reality content, and
the displaying of the analysis result for the virtual reality content on the display unit includes displaying the analysis result for the virtual reality content on the display unit at a playback section corresponding to the selected at least one playback time.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the user input further includes a first data related to the virtual reality content, a second data acquired by processing the first data, and an input selected so that at least one of a prediction image on the second virtual reality content or a simulation result on the virtual reality content is displayed on the display unit;
the first data includes at least one of VR sickness inducing-factors of the virtual reality content, a first VR sickness information, a second VR sickness information, and a correlation information between the VR sickness-inducing factors determined in advance via machine learning and a VR sickness list;
the VR sickness-inducing factors of the virtual reality content include movement of a camera, movement of an object, playback information, resolution, binocular parallax, depth of field, angle of view, image feature, special effect, and texture effect;
the VR sickness list includes at least one of discomfort, fatigue, headache, eye fatigue, difficulties with focusing, sweating, nausea, difficulties with attention, brain fog, visual acuity, dizziness, hallucinations, stomachache, cyber sickness, burping, and other symptoms as VR sickness list items;
the first VR sickness information includes at least one of an image of the user acquired from an image capturing sensor and a magnitude of a biological signal of the user acquired from a biological signal detection sensor; and
the second VR sickness information is a degree of at least one of the VR sickness list items input from the user in response to a request for inputting the degree of the VR sickness for the virtual reality content.

### Claim 13 (depends on 12)

The method according to claim 12, wherein, when the user input is an input selected to display the first data related to the virtual reality content on the display unit, the displaying of the analysis result for the virtual reality content on the display unit includes analyzing the virtual reality content, thereby displaying at least one of the VR sickness inducing-factors of the virtual reality content, the first VR sickness information, the second VR sickness information, and the correlation information between the VR sickness-inducing factors determined in advance via machine learning and the VR sickness list, on the display unit.

### Claim 14 (depends on 12)

The method according to claim 12, wherein, when the user input is an input selected to display the second data on the display unit, the displaying of the analysis result for the virtual reality content on the display unit includes substituting at least one of the first data for one of the VR sickness inducing-factors and displaying a result of the substitution on the display unit.

### Claim 15 (depends on 12)

The method according to claim 12, wherein, when the user input is an input selected to display the prediction image for the second virtual reality content on the display unit, the displaying of the analysis result for the virtual reality content on the display unit includes analyzing the first virtual reality content and the first data, thereby determining the prediction image for the second virtual reality content and displaying the determined image on the display unit.

### Claim 16 (depends on 12)

The method according to claim 12, wherein, when the user input is an input selected to display the simulation result for the virtual reality content on the display unit, the displaying of the analysis result for the virtual reality content on the display unit includes changing a value of at least one VR sickness list item in the VR sickness list and displaying the changed VR sickness list on the display unit using a graphical user interface (GUI), as the user input is additionally acquired in order to change a value of at least one of the VR sickness-inducing factors.
