# US 2019/0171280 A1 · Apparatus and method of generating machine learning-based cyber sickness prediction model for virtual reality content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171280 A1
- Document ID: US20190171280A1
- Status: Published application
- Kind: A1
- Application number: 16/140,210
- Filed: 2018-09-24
- Published: 2019-06-06
- Earliest claimed: 2017-12-05
- Assignees: Electronics and Telecommunications Research Institute
- Applicants: Electronics and Telecommunications Research Institute
- Inventors: Wook Ho SON; Seung Woo NAM; Hee Seok OH; Beom Ryeol LEE
- Web page: https://patentgrep.com/patent/US20190171280A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- A61B 5/6887: {mounted on external non-worn devices, e.g. non-medical devices}
- A61B 5/7267: {involving training the classification device}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06F 17/18: for evaluating statistical data {, e.g. average values, frequency distributions, probability functions, regression analysis (forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04)}
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G06N 20/10: using kernel methods, e.g. support vector machines [SVM]
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 27/017: {Head mounted}
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Disclosed is an apparatus and method of generating a VR sickness prediction model. A method of generating a VR sickness prediction model according to the present disclosure includes: displaying virtual reality content on a display unit; detecting first VR sickness information of a user who experiences the virtual reality content using a sensor; determining second VR sickness information using a user input that is input from the user in response to a request for inputting a degree of VR sickness for the virtual reality content; performing machine learning based on supervised learning using VR sickness-inducing factors for the virtual reality content, the first VR sickness information, and the second VR sickness information; and determining a correlation between the VR sickness-inducing factors and a list of VR sickness symptoms on a basis of the performed machine learning.

## Claims

### Claim 1

A method of generating a VR sickness prediction model, the method comprising:
displaying virtual reality content on a display unit;
detecting first VR sickness information of a user who experiences the virtual reality content using a sensor;
determining second VR sickness information using a user input that is input from the user in response to a request for inputting a degree of VR sickness for the virtual reality content;
performing machine learning based on supervised learning using VR sickness-inducing factors for the virtual reality content, the first VR sickness information, and the second VR sickness information; and
determining a correlation between the VR sickness-inducing factors and a list of VR sickness symptoms on a basis of the performed machine learning.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the VR sickness-inducing factors of the virtual reality content includes at least one of movement of a camera, movement of an object, playback information, resolution, binocular parallax, depth of field, angle of view, image feature, special effect, and texture effect.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the list of VR sickness symptoms includes at least one of discomfort, fatigue, headache, eye fatigue, difficulties with focusing, sweating, nausea, difficulties with attention, brain fog, visual acuity, dizziness, hallucinations, stomachache, cyber sickness, burping, and other symptoms.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the determining of the correlation between the VR sickness-inducing factors and the list of VR sickness symptoms includes
determining a quantitative correlation between the VR sickness-inducing factors and the list of VR sickness symptoms, by causing at least one of items in the list of VR sickness symptoms to be gradually changed in magnitude as the VR sickness-inducing factors for the virtual reality content change.

### Claim 5 (depends on 3)

The method according to claim 3, wherein the sensor includes at least one of an image capturing sensor and a biological signal detection sensor;
the first VR sickness information is at least one of an image of the user acquired from the image capturing sensor and a magnitude of biological signal of the user acquired from the biological signal detection sensor; and
the second VR sickness information is a degree of at least one of the items in the list of VR sickness symptoms input from the user in response to the request for inputting the degree of the VR sickness for the virtual reality content.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the performing of the machine learning based on supervised learning includes:
determining a feature vector acquired using the first VR sickness information as data in the machine learning based on supervised learning;
determining the second VR sickness information as a label for the data in the machine learning based on supervised learning; and
performing the machine learning based on supervised learning using the data and the label for the data.

### Claim 7 (depends on 1)

The method according to claim 1, further comprising:
displaying the correlation between the determined VR sickness-inducing factors and the list of VR sickness symptoms on a display unit using a graphical user interface GUI.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising:
predicting the correlation between the VR sickness-inducing factors and the list of VR sickness symptoms for given virtual reality content on a basis of the performed machine learning.

### Claim 9

An apparatus for generating a VR sickness prediction model, the apparatus comprising:
a display unit displaying virtual reality content;
a user input unit; and
a control unit detecting first VR sickness information of a user who experiences the virtual reality content using a sensor, determining second VR sickness information using a user input that is input from the user in response to a request for inputting a degree of VR sickness for the virtual reality content, performing machine learning based on supervised learning using VR sickness-inducing factors for the virtual reality content, the first VR sickness information, and the second VR sickness information, and determining a correlation between the VR sickness-inducing factors and a list of VR sickness symptoms on a basis of the performed machine learning.

### Claim 10 (depends on 9)

The apparatus according to claim 9, wherein the VR sickness-inducing factors of the virtual reality content includes at least one of movement of a camera, movement of an object, playback information, resolution, binocular parallax, depth of field, angle of view, image feature, special effect, and texture effect.

### Claim 11 (depends on 9)

The apparatus according to claim 9, wherein the list of VR sickness symptoms includes at least one of discomfort, fatigue, headache, eye fatigue, difficulties with focusing, sweating, nausea, difficulties with attention, brain fog, visual acuity, dizziness, hallucinations, stomachache, cyber sickness, burping, and other symptoms.

### Claim 12 (depends on 11)

The apparatus according to claim 11, wherein the control unit determines a quantitative correlation between the VR sickness-inducing factors and the list of VR sickness symptoms, by causing at least one of items in the list of VR sickness symptoms to be gradually changed in magnitude as the VR sickness-inducing factors for the virtual reality content change.

### Claim 13 (depends on 11)

The apparatus according to claim 11, wherein the sensor includes at least one of an image capturing sensor and a biological signal detection sensor;
the first VR sickness information is at least one of an image of the user acquired from the image capturing sensor and a magnitude of biological signal of the user acquired from the biological signal detection sensor; and
the second VR sickness information is a degree of at least one of the items in the list of VR sickness symptoms input from the user in response to the request for inputting the degree of the VR sickness for the virtual reality content.

### Claim 14 (depends on 13)

The apparatus according to claim 13, wherein the control unit determines a feature vector acquired using the first VR sickness information as data in the machine learning based on supervised learning, determines the second VR sickness information as a label for the data in the machine learning based on supervised learning, and performs the machine learning based on supervised learning using the data and the label for the data.

### Claim 15 (depends on 9)

The apparatus according to claim 9, wherein the control unit displays the correlation between the determined VR sickness-inducing factors and the list of VR sickness symptoms on a display unit using a graphical user interface GUI.

### Claim 16 (depends on 9)

The apparatus according to claim 9, wherein the control unit predicts the correlation between the VR sickness-inducing factors and the list of VR sickness symptoms for given virtual reality content on a basis of the performed machine learning.
