# US 11,688,297 B2 · Virtual reality with virtualization in trainers and test environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,688,297 B2
- Document ID: US11688297B2
- Status: Granted
- Kind: B2
- Application number: 16/195,117
- Filed: 2018-11-19
- Published: 2020-05-21
- Granted: 2023-06-27
- Earliest claimed: 2018-11-19
- Assignees: The Boeing Company
- Applicants: The Boeing Company
- Inventors: Jonathan N. Hotra; Leighton J. Carr; Antony R. Hunt
- Web page: https://patentgrep.com/patent/US11688297B2

## CPC

- G09B 9/30: Simulation of view from aircraft
- G09B 9/307: {by helmet-mounted projector or display (G09B9/36 takes precedence; optical parts of head-up displays G02B27/01)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G09B 9/28: Simulation of stick forces or the like
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods are disclosed for virtual reality (VR) aircraft test and training environments that simultaneously leverage a high quality immersive environment engine and an operational flight program (OFP) running on a virtual flight management computer (FMC) by using a communication channels that couples the immersive VR environment engine with the virtual FMC. Existing investment in flight simulators, test environment core components, and any of navigation simulation, data link simulation, air traffic control simulation, and flight visualization modules can be advantageously employed to provide high-quality, realistic testing and training capability.

## Claims

### Claim 1

A virtual reality (VR) environment platform comprising:
a virtualization system comprising a hardware device, the hardware device comprising one or more computer storage devices having computer-executable instructions stored thereon for operating the VR environment platform, which, on execution by the hardware device, cause the hardware device to cause:
an immersive VR environment engine comprising aircraft control and display units to provide an immersive VR environment of an aircraft;
a virtual flight management computer (FMC) to run an operational flight program (OFP); and
a protocol buffer coupling the immersive VR environment engine with the virtual FMC to emulate FMC communication protocols to permit the immersive VR environment engine to interact with the virtual FMC using actual packed input/output (I/O) of the aircraft.

### Claim 2 (depends on 1)

The VR environment platform of claim 1 further comprising:
a head mounted display (HMD) for displaying a view of an immersive VR environment.

### Claim 3 (depends on 1)

The VR environment platform of claim 1 further comprising:
virtual interaction points providing aircraft flight deck control inputs for the immersive VR environment.

### Claim 4 (depends on 1)

The VR environment platform of claim 1 further comprising:
a physical interaction point simulating an aircraft control and providing physical feedback to a user of the VR environment platform.

### Claim 5 (depends on 1)

The VR environment platform of claim 1 further comprising:
a flight simulator component interfacing with the immersive VR environment engine and the virtual FMC.

### Claim 6 (depends on 5)

The VR environment platform of claim 5 further comprising:
an instructor operator station component interfacing with the flight simulator component.

### Claim 7 (depends on 5)

The VR environment platform of claim 5 further comprising:
a software integration test environment (SITE) component interfacing with the flight simulator component, the immersive VR environment engine, and the virtual FMC.

### Claim 8 (depends on 7)

The VR environment platform of claim 7 further comprising:
at least one component interfacing with the SITE component and selected from the list consisting of:
navigation simulation, data link simulation, air traffic control simulation, and flight visualization.

### Claim 9

A method of operating an immersive virtual reality (VR) environment platform, the method comprising:
operating an immersive VR environment engine comprising aircraft control and display units to provide an immersive VR environment of an aircraft;
operating a virtual flight management computer (FMC) running an operational flight program (OFP); and
coupling the immersive VR environment engine with the virtual FMC to emulate FMC communication protocols to permit the immersive VR environment engine to interact with the virtual FMC using actual packed input/output (I/O) of the aircraft.

### Claim 10 (depends on 9)

The method of claim 9 further comprising:
displaying a view of an immersive VR environment on a head mounted display (HMD).

### Claim 11 (depends on 9)

The method of claim 9 further comprising:
receiving aircraft flight deck control inputs for the immersive VR environment through virtual interaction points.

### Claim 12 (depends on 9)

The method of claim 9 further comprising:
providing physical feedback to a user of the VR environment platform through a physical interaction point simulating an aircraft control.

### Claim 13 (depends on 9)

The method of claim 9 further comprising:
operating a flight simulator component interfacing with the immersive VR environment engine and the virtual FMC.

### Claim 14 (depends on 13)

The method of claim 13 further comprising:
operating an instructor operator station component interfacing with the flight simulator component.

### Claim 15 (depends on 13)

The method of claim 13 further comprising:
operating a software integration test environment (SITE) component interfacing with the flight simulator component, the immersive VR environment engine, and the virtual FMC.

### Claim 16 (depends on 15)

The method of claim 15 further comprising:
interfacing with the SITE component, at least one component selected from the list consisting of:
navigation simulation, data link simulation, air traffic control simulation, and flight visualization.

### Claim 17

One or more computer storage devices having computer-executable instructions stored thereon for operating an immersive virtual reality (VR) environment platform, which, on execution by a computer, cause the computer to perform operations comprising:
operating an immersive VR environment engine comprising aircraft control and display units to provide an immersive VR environment of an aircraft;
displaying a view of an immersive VR environment on a head mounted display (HMD);
receiving aircraft flight deck control inputs for the immersive VR environment through virtual interaction points;
operating a virtual flight management computer (FMC) to run an operational flight program (OFP);
providing physical feedback to a user of the VR environment platform through a physical interaction point simulating an aircraft control;
operating a flight simulator component interfacing with the immersive VR environment engine and the virtual FMC, and
coupling the immersive VR environment engine with the virtual FMC to emulate FMC communication protocols to permit the immersive VR environment engine to interact with the virtual FMC using actual packet input/output (I/O) of the aircraft.

### Claim 18 (depends on 17)

The one or more computer storage devices of claim 17 wherein the operations further comprise:
operating an instructor operator station component interfacing with the flight simulator component.

### Claim 19 (depends on 17)

The one or more computer storage devices of claim 17 wherein the operations further comprise:
operating a software integration test environment (SITE) component interfacing with the flight simulator component, the immersive VR environment engine, and the virtual FMC.

### Claim 20 (depends on 19)

The one or more computer storage devices of claim 19 wherein the operations further comprise:
interfacing with the SITE component, at least one component selected from the list consisting of:
navigation simulation, data link simulation, air traffic control simulation, and flight visualization.
