# US 2021/0343084 A1 · Systems and methods for augmented-or virtual reality-based decision-making simulation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343084 A1
- Document ID: US20210343084A1
- Status: Published application
- Kind: A1
- Application number: 17/242,574
- Filed: 2021-04-28
- Published: 2021-11-04
- Earliest claimed: 2020-04-30
- Inventors: Tanner Fred; Joseph Fields
- Web page: https://patentgrep.com/patent/US20210343084A1

## CPC

- A63F 13/20: Input arrangements for video game devices
- G06T 19/003: {Navigation within 3D models or images}
- A61B 5/1122: {of movement trajectories}
- A61B 5/16: Devices for psychotechnics (using teaching or educational appliances G09B1/00 - G09B7/00); Testing reaction times {; Devices for evaluating the psychological state}
- A61B 5/6803: {Head-worn items, e.g. helmets, masks, headphones or goggles}
- A62C 99/0081: {Training methods or equipment for fire-fighting}
- A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity
- A63F 13/26: having at least one additional display device, e.g. on the game controller or outside a game booth
- A63F 13/42: by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
- A63F 13/45: Controlling the progress of the video game
- A63F 13/53: involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G16H 20/70: relating to mental therapies, e.g. psychological therapy or autogenous training
- G16H 50/50: for simulation or modelling of medical disorders
- A61B 5/02438: {with portable devices, e.g. worn by the patient}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 2503/20: Workers
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A62C: FIRE-FIGHTING (fire-extinguishing compositions, use of chemical substances in extinguishing fires A62D1/00; spraying, applying liquids or other fluent materials to surfaces in general B05; alarm arrangements G08B, e.g. fire alarms actuated by smoke or gases G08B17/10)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

A system for display for an augmented/virtual reality-based decision-making simulation includes a controller configured to receive input from a user, at least one of an augmented reality or a virtual reality device configured to display a simulated environment, a processor, and a memory coupled to the processor. The memory stores one or more computer-readable instructions, which, when executed by the processor, cause the system to: receive input by the user from the controller, indicating a selected scenario; display, on the at least one of the augmented reality or the virtual reality device, the selected scenario; receive input from the user, from the controller, to interact with the selected scenario; monitor one or more parameters associated with the execution of tasks in the selected scenario using the controller; and evaluate the user based on the monitored one or more parameters.

## Claims

### Claim 1

A system for display for an augmented/virtual reality-based decision-making simulation comprising:
a controller configured to receive input from a user;
at least one of an augmented reality or a virtual reality device configured to display a simulated environment;
a processor; and
a memory coupled to the processor and storing one or more computer-readable instructions, wherein the computer-readable instructions cause, when executed by the processor, the system to:
receive user input from the controller indicating a selected scenario;
display the selected scenario on the at least one of the augmented reality or the virtual reality device;
receive input from the controller indicating user interaction with the selected scenario;
monitor one or more parameters associated with the execution of tasks in the selected scenario using the controller; and
evaluate the user based on the monitored one or more parameters.

### Claim 2 (depends on 1)

The system of claim 1, wherein the evaluation is performed using machine learning.

### Claim 3 (depends on 1)

The system of claim 1, wherein the instructions, when executed by the processor, further cause the system to:
display, on at least one of the augmented reality or the virtual reality display, a layout of decisions that were made by the user during the selected scenario.

### Claim 4 (depends on 3)

The system of claim 3, wherein the instructions, when executed by the processor, further cause the system to:
display, on at least one of the augmented reality or the virtual reality display, a walk-through of the layout.

### Claim 5 (depends on 1)

The system of claim 1, wherein the instructions, when executed by the processor, further cause the system to:
display, on at least one of the augmented reality or the virtual reality display, an indication of how one or more major decisions impacted an outcome of the selected scenario.

### Claim 6 (depends on 1)

The system of claim 1, wherein the selected scenario includes at least one of: being in a top floor of a building that is on fire; being inside a school where there is an active shooter; waking up to find somebody has broken into a home of the user and is still there; a phobia of spiders; a phobia of heights; being lost in a forest; or being a passenger on a plane.

### Claim 7 (depends on 1)

The system of claim 1, further comprising a heart rate monitor configured to generate a signal indicative of a heart rate of the user.

### Claim 8 (depends on 7)

The system of claim 7, wherein the instructions, when executed by the processor, further cause the system to:
receive the signal from the heart rate monitor; and
modify the simulated environment based on the signal.

### Claim 9 (depends on 1)

The system of claim 1, wherein the at least one of the augmented reality or the virtual reality device further includes a sensor configured to sense head movement and communicate to the processor a signal indicative of a head movement of the user, and
wherein the instructions, when executed by the processor, further cause the system to:
receive further input from the at least one of the augmented reality or the virtual reality device based on the user's head movements; and
move the user in the simulated environment based on the further input.

### Claim 10 (depends on 7)

The system of claim 7, wherein the instructions, when executed by the processor, further cause the system to:
display on the at least one of the augmented reality or the virtual reality device an indication of the input chosen by the user.

### Claim 11

A computer-implemented method for an augmented/virtual reality-based decision-making simulated environment, the method comprising:
receiving, from a controller configured to receive input from a user, user input indicating a selected scenario;
displaying, on at least one of an augmented reality or a virtual reality device, the selected scenario;
receiving input from the controller indicating user interaction with the selected scenario;
monitoring one or more parameters associated with the execution of tasks in the selected scenario using the controller; and
evaluating the user based on the monitored one or more parameters.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein the evaluation is performed using machine learning.

### Claim 13 (depends on 11)

The computer-implemented method of claim 11, further comprising:
displaying, on at least one of the augmented reality or the virtual reality display a layout of decisions that were made by the user during the selected scenario.

### Claim 14 (depends on 13)

The computer-implemented method of claim 13, further comprising:
displaying, on at least one of the augmented reality or the virtual reality display a walk-through of the layout.

### Claim 15 (depends on 11)

The computer-implemented method of claim 11, further comprising:
displaying, on at least one of the augmented reality or the virtual reality display an indication of how one or more major decisions impacted an outcome of the selected scenario.

### Claim 16 (depends on 11)

The computer-implemented method of claim 11, wherein receiving input by a user indicating a selected scenario includes indicating a scenario selected from: being in a top floor of a building that is on fire; being inside a school where there is an active shooter; waking up to find somebody has broken into a home of the user, and is still there; a phobia of spiders; a phobia of heights; being lost in a forest; or being a passenger on a plane.

### Claim 17 (depends on 11)

The computer-implemented method of claim 11, further comprising:
receiving a signal from a heart rate monitor configured to generate a signal indicative of a heart rate of the user; and
modifying the simulated environment based on the signal.

### Claim 18 (depends on 11)

The computer-implemented method of claim 11, wherein the at least one of the augmented reality or the virtual reality device further includes a sensor configured to sense head movement, and
wherein the computer-implemented method further comprises:
receiving further input from the at least one of the augmented reality or the virtual reality device based on the user's head movements; and
moving the user in the simulated environment based on the further input.

### Claim 19 (depends on 11)

The computer-implemented method of claim 11, further comprising:
displaying on the at least one of the augmented reality or the virtual reality device an indication of the input chosen by the user.

### Claim 20

A non-transitory computer-readable storage medium in which is stored instructions for causing a processor to execute a computer-implemented method for an augmented/virtual reality-based decision-making simulated environment, the method comprising:
receiving, from a controller configured to receive input from a user, user input indicating a selected scenario;
displaying, on at least one of an augmented reality or a virtual reality display, the selected scenario;
receiving input from the controller, indicating user interaction with the selected scenario;
monitoring one or more parameters associated with the execution of tasks in the selected scenario using the controller; and
evaluating the user based on the monitored one or more parameters.