# US 2022/0044593 A1 · Virtual reality simulation and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044593 A1
- Document ID: US20220044593A1
- Status: Published application
- Kind: A1
- Application number: 17/278,913
- Filed: 2019-10-14
- Published: 2022-02-10
- Earliest claimed: 2018-10-12
- Assignees: Quality Executive Partners, Inc.
- Applicants: Quality Executive Partners, Inc.
- Inventors: Crystal Mersh; Brian Duncan; Nicole Monachino; Rebecca Brewer; Robert Ferer; Vanessa Figueroa; Tyler DeWitt; Ken Wieber; Katayoun Meyer; Scott Driscoll; Michael Orndorff
- Web page: https://patentgrep.com/patent/US20220044593A1

## CPC

- G09B 23/24: for chemistry
- G06T 19/003: {Navigation within 3D models or images}
- G09B 9/00: Simulators for teaching or training purposes (for the use of weapons F41; computing aspects G06; {protocols for games, networked simulations or virtual reality H04L67/131})
- G16H 10/40: for data related to laboratory analysis, e.g. patient specimen analysis
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/67: for remote operation
- Y02A 90/10: Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- Y02A: TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE

## Abstract

One aspect of the present disclosure include a method and system for providing an interactive virtual reality simulation for virtual reality training. A headset, controllers, and/or one or more sensors communicate with a processor to display the interactive virtual reality simulation on a user display within the headset. The interactive virtual reality training for use in facilitating virtually reality simulations including a microscope simulation, a bacteria streaking simulation, and/or a visually inspecting containers simulation.

## Claims

### Claim 1

A non-transitory computer readable medium storing instructions executable by an associated processor to perform a method for implementing a bacteria streaking simulation comprising:
generating a three-dimensional initial view based upon a view selection input by a user;
sending instructions to present the initial view to a user display of a headset, the user display comprised within the headset;
receiving an input from a controller comprising at least one sensor indicating user movement within the initial view;
accessing memory to identify an assigned status of a loop; and
responsive to the loop being coupled to a user icon within the initial view, storing a pattern of interaction between the loop and a streaking plate comprised within the initial view, storing the pattern comprising:
generating a series of waypoints and connecting them to comprise the pattern;
assigning a decreasing bacterial concentration to the loop, wherein the concentration of the loop at the location of a waypoint creation is assigned to the waypoint, wherein each progressive waypoint within the series of waypoints being created by the loop has a decreasing bacterial concentration;
responsive to the pattern of interaction overlapping one or more existing waypoint of one or more existing patterns, assigning an altered bacterial concentration to the loop based upon the assigned value of the one or more existing waypoints and the assigned bacterial concentration of the loop at the location of the overlap; and
storing the series of waypoints and their assigned bacterial concentrations.

### Claim 2 (depends on 1)

The method of claim 1, wherein assigning the decreasing bacterial concentration to the loop comprises assigning an exponentially decreasing bacterial concentration, further wherein each progressive waypoint within the series of waypoints being created by the loop has the exponentially decreasing bacterial concentration.

### Claim 3 (depends on 1)

The method of claim 1, generating a first rectangle extending toward a previous waypoint in the series of waypoints and a second rectangle extending toward a next waypoint in the series of waypoints.

### Claim 4 (depends on 3)

The method of claim 3, calculating a cell potential of the first and second rectangles based upon the assigned bacterial concentration of the waypoint, and a randomly assigning cell placement with the first and second rectangles based upon the cell potential.

### Claim 5 (depends on 4)

The method of claim 4, simulating bacterial growth on the streaking plate based upon the cell placement within the first and second rectangles.

### Claim 6 (depends on 5)

The method of claim 5, calculating an outcome of the bacterial growth and comparing the outcome to a threshold and providing the outcome relative to the threshold on the user display.

### Claim 7

A virtual reality system for providing a bacterial streaking simulation, the system comprising:
a processing device having a processor configured to perform a predefined set of operations in response to receiving a corresponding input from at least one of virtual reality headset and at least one controller, the processing device comprising memory, wherein a three-dimensional initial view of the bacterial streaking simulation is stored, the initial view comprising a streaking plate, a heating element, and a loop;
the processor instructs the initial view to be presented on a user display comprised within the headset;
the at least one controller sends an input to the processor indicating the controller is moving within the initial view;
the processor instructs the movement of the controller of the at least one controllers be presented on the user display;
responsive to an input from the controller, the processor assigns the loop to be controlled by movement of the controller;
the controller sends an input indicating that the controller is moving and interacting with the streaking plate;
the processor generates and stores a pattern of interaction between the loop and the streaking plate, wherein the processor generates the pattern by assigning an exponentially decreasing bacterial concentration to the loop responsive to a distance traveled by said loop while interacting with the streaking plate, the processor generates a series of waypoints, wherein the bacterial concentration of the loop at the location of a waypoint creation is assigned to the waypoint, the processor instructs the user display to illustrate the waypoints as a line forming the pattern on the streaking plate;
the processor generates a first rectangle extending toward a previous waypoint in the series of waypoints and a second rectangle extending toward a next waypoint in the series of waypoints, the processor calculates a cell potential of the first and second rectangles based upon the assigned bacterial concentration of the waypoint;
the processor randomly assigns cell placement with the first and second rectangles based upon the cell potential; and
the processor simulates bacterial growth on the streaking plate based upon the cell placement within the first and second rectangles.

### Claim 8 (depends on 7)

The system of claim 7, responsive to the controller sending a signal to the processor that the loop as interacted with an existing pattern, the processor assigns an altered bacterial concentration to the loop based upon the assigned value of the one or more existing waypoints and the assigned bacterial concentration of the loop at the location of the overlap.

### Claim 9 (depends on 7)

The system of claim 7, wherein responsive to an input from the at least one controller indicating user movement within a loop activation volume corresponding to the loop of the initial view, the processor assigns the loop to be controlled by movement of the controller.

### Claim 10

A non-transitory computer readable medium storing instructions executable by an associated processor to perform a method for implementing a visual inspection simulation comprising:
generating a three-dimensional initial view based upon a view selection input by a user;
sending instructions to present the initial view to a user display of a headset, the user display comprised within the headset;
receiving an input from a controller comprising at least one sensor indicating user movement within the initial view;
accessing memory to identify an assigned status of a selected container of one or more containers;
responsive to an input from the controller, the processor assigns the selected container to be controlled by movement of the controller;
continuously generating a fluid flow pattern utilizing a visualization state machine, wherein a single point mass on a mass spring with a lateral damper is virtually attached to a fixed point in a center of the container;
responsive to receiving an input from the controller that the container moved in a defined direction, swinging the single point mass back and forth along the defined direction then settling the single point mass into an original position.
displaying a two-dimensional liquid top surface as following the orientation of the single point mass, wherein the liquid to surface is continually oriented to face a line of sight from the user display.

### Claim 11 (depends on 10)

The method of claim 10, designating the selected container as within a first background responsive to the container being between the line of sight and the first background, responsive to assigning particles to be first visual indicator particles, instructing the first visual indicator particles to be invisible or nearly invisible, wherein the first background and the first visual indicator particles are assigned non-contrasting colors, and responsive to assigning particles to be second visual indicator particles, instructing the second visual indicator particles to be visible, wherein the first background and the second visual indicator particles are assigned contrasting colors.

### Claim 12 (depends on 10)

The method of claim 10, randomly assigning particles to one or more containers and revealing said particles when present responsive to the controller being inverted over an inversion threshold and rotated over a rotation threshold.

### Claim 13 (depends on 12)

The method of claim 12, responsive to particles being assigned to the selected container, generating and displaying a two-dimensional liquid side surface by displaying images of a sequence of image particles in various rotations.

### Claim 14

A virtual reality system for providing a visual inspection simulation, the system comprising:
a processing device having a processor configured to perform a predefined set of operations in response to receiving a corresponding input from at least one of virtual reality headset and at least one controller, the processing device comprising memory, wherein a three-dimensional initial view of a visual inspection simulation is stored, the initial view comprising at least one container;
the processor instructs the initial view to be presented on a user display comprised within the headset;
the at least one controller sends an input to the processor indicating the controller is moving within the initial view;
the processor instructs the movement of the controller of the at least one controller be presented on the user display;
responsive to an input from the controller, the processor assigns a selected container of the at least one container to be controlled by movement of the controller;
the controller sends an input indicating that the controller is moving the selected container;
the processor generates a continuous fluid flow pattern utilizing a visualization state machine, wherein the visualization state machine comprises a single point mass on a mass spring with a lateral damper virtually attached to a fixed point in a center of the container;
the controller sends a signal to the processor that the container moved in a defined direction; and
the processor swings the single point mass back and forth along the defined direction then has the single point mass return to an initial position, wherein the processor instructs the user display to display a two-dimensional liquid top surface as following the orientation of the single point mass, wherein the process instructs the user display to display the liquid to surface to be continually oriented to face a line of sight.

### Claim 15 (depends on 14)

The system of claim 14, responsive to the controller sending a signal to the processor that the selected container is within the first background, the processor having assigned particles to be first visual indicator particles instructs the user display to the display the first visual indicator particles to be invisible or nearly invisible wherein the first background and the first visual indicator particles are assigned non-contrasting colors, and the processor having assigned particles to be second visual indicator particles instructs the user display to the display the second visual indicator particles to be visible wherein the first background and the second visual indicator particles are assigned contrasting colors.

### Claim 16 (depends on 15)

The system of claim 15, responsive to particles being assigned to the selected container, the processor generates and instruct the user display to display a two-dimensional liquid side surface by displaying images of a sequence of image particles in various rotations.

### Claim 17

A non-transitory computer readable medium storing instructions executable by an associated processor to perform a method for implementing a microscope simulation comprising:
generating a three-dimensional initial view based upon a view selection input by a user;
sending instructions to present the initial view to a user display of a headset, the user display comprised within the headset;
receiving an input from a controller comprising at least one sensor indicating user movement within the initial view;
accessing memory to identify an assigned status of a microscope including lateral wheel, longitudinal wheel, objective wheel and focus wheel inputs;
responsive to an input from the controller, instructing the user display to display one of the lateral wheel, the longitudinal wheel, the objective wheel and the focus wheel;
wherein responsive to a slide present on the microscope being assigned bacteria, retrieving bacteria from memory and instructing the user display to display the bacteria on the slide present on the microscope and on a heads-up display displaying a microscope view;
responsive to the controller sending a signal that the controller is moving and interacting with the objective wheel, instructing the user display to display the objective wheel rotating based upon the controller movement and to display the heads-up display displaying a microscope view having an altered magnification; and
responsive to the controller sending a signal that the controller is moving and interacting with the focus wheel, instructing the user display to display the focus wheel rotating based upon the controller movement and to display the heads-up display displaying the microscope view having an altered blurriness, wherein the slide and the bacteria are presented as having the altered blurriness.

### Claim 18 (depends on 17)

The method of claim 17, responsive to the controller sending a signal that the controller is moving and interacting with the objective wheel to alter the objective over an objective threshold, determining if oil is present from memory, responsive to oil being present, instructing the user display to display the objective wheel rotating to an objective over the objective threshold, further instructing a lens corresponding to the objective over the objective threshold to be positioned over the slide.

### Claim 19 (depends on 17)

The method of claim 17, responsive to the controller sending a signal that the controller is moving and interacting with the objective wheel to alter the objective over an objective threshold, determining if oil is present from memory, responsive to oil not being present, instructing the user display to display an add oil notification.

### Claim 20 (depends on 18)

The method of claim 18, the instructing the user display to display the objective wheel rotating comprising instructing a series of lenses coupled to the microscope to rotate.

### Claim 21

A virtual reality system for providing a microscope simulation, the system comprising:
a processing device having a processor configured to perform a predefined set of operations in response to receiving a corresponding input from at least one of virtual reality headset and at least one controller, the processing device comprising memory, wherein a three-dimensional initial view of a microscope simulation is stored, the initial view comprising a microscope;
the processor instructs the initial view to be presented on a user display comprised within the headset;
the at least one controller sends an input to the processor indicating the controller is moving within the initial view;
the processor instructs the movement of the controller of the at least one controller be presented on the user display;
responsive to an input from the controller, the processor instructs the user display to display one of the lateral wheel, the longitudinal wheel, the objective wheel and the focus wheel;
wherein responsive to the processor having assigned a slide present on the microscope no bacteria, the processor retrieves a blank slide from memory and instructs the user display to display the slide present on the microscope and on a heads-up display displaying a microscope view;
responsive to the controller sending a signal that the controller is moving and interacting with the objective wheel, the processor instructs the user display to display the objective wheel rotating based upon the controller movement and to display the heads-up display displaying the microscope view having an altered magnification; and
responsive to the controller sending a signal that the controller is moving and interacting with the focus wheel, the processor instructs the user display to display the focus wheel rotating based upon the controller movement and to display the heads-up display displaying the microscope view having an altered blurriness, wherein the slide is presented as having the altered blurriness.

### Claim 22 (depends on 21)

The system of claim 21, wherein responsive to the processor having assigned a slide present on the microscope bacteria, the processor retrieves a bacteria slide from memory and instructs the user display to display the slide present on the microscope and on the heads-up display displaying the microscope view.

### Claim 23 (depends on 22)

The system of claim 22, responsive to the controller sending the signal that the controller is moving and interacting with the focus wheel, the processor instructs the user display to display the heads-up display displaying the microscope view having an altered blurriness, wherein the slide and the bacteria are presented as having the altered blurriness.

### Claim 24 (depends on 21)

The system of claim 21, responsive to the controller sending a signal that the controller is moving and interacting with the objective wheel to alter the objective over an objective threshold, the processor determines if oil is present from memory, responsive to oil being present, the processor instructs the user display to display the objective wheel rotating to an objective over the objective threshold, further the processor instructs the user display to display a lens corresponding to the objective over the objective threshold to be positioned over the slide.

### Claim 25 (depends on 21)

The system of claim 21, the processor instructs the user display to display the objective wheel rotating comprising the processor instructing the user display to display a series of lenses coupled to the microscope rotating.
