# US 11,442,533 B2 · System for mixed reality experiences

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,442,533 B2
- Document ID: US11442533B2
- Status: Granted
- Kind: B2
- Application number: 17/020,429
- Filed: 2020-09-14
- Published: 2021-03-18
- Granted: 2022-09-13
- Earliest claimed: 2019-09-13
- Assignees: iPMachine, LLC
- Applicants: iPMachine, LLC
- Inventors: Stephen P. Gaconnier
- Web page: https://patentgrep.com/patent/US11442533B2

## CPC

- A63F 13/24: Constructional details thereof, e.g. game controllers with detachable joystick handles
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- A63F 13/25: Output arrangements for video game devices
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- A63F 13/90: Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The disclosure provides a system that provides a mixed reality experience for users. Mixed reality is the blending of real and virtual (or digital) worlds to produce environments and visualizations where both physical and digital objects co-exist and can also interact in real time. The disclosure provide a MR system for the interaction of users, computers, and an environment in which users can experience using all five senses. In one example, the disclosure provides a mixed reality system that includes: (1) a structure, (2) a vehicle configured to support at least one user, wherein the vehicle is suspended from the structure via an articulating universal connection mount, and (3) a system controller configured to provide virtual reality video content to a virtual reality interface in response to interactions of the user with the vehicle and the virtual reality interface, wherein the virtual reality video content corresponds to the real world of the vehicle.

## Claims

### Claim 1

A mixed reality system, comprising:
a structure;
a vehicle configured to support multiple users, wherein the vehicle is suspended from the structure via an articulating universal connection mount; and
a system controller comprising a processor configured to provide virtual reality video content to a virtual reality interface of each of the multiple users in response to one or more active interactions of each of the multiple users with their respective virtual reality interface, in response to one or more active interactions of at least one of the multiple users with at least one control of the vehicle, and in response to movement of at least one of the multiple users with respect to the vehicle, wherein the virtual reality video content corresponds to a real world of the vehicle and action of any one of the multiple users within the vehicle affects all of the virtual reality video content provided to each one of the multiple users.

### Claim 2 (depends on 1)

The mixed reality system as recited in claim 1, further comprising safety sensors associated with the vehicle and configured to limit or end operation of the mixed reality system in response to exceeding a threshold, and a manually operated emergency kill switch mounted on the structure and configured to end the operation of the mixed reality system and automatically lower the vehicle to an original position, wherein the safety sensors include a floor contact sensor, a maximum height sensor, and a temperature sensor.

### Claim 3 (depends on 1)

The mixed reality system as recited in claim 1, wherein the vehicle is a balloon basket.

### Claim 4 (depends on 1)

The mixed reality system as recited in claim 1, wherein the virtual reality interface is a virtual reality head mounted display.

### Claim 5 (depends on 3)

The mixed reality system as recited in claim 3, wherein the system controller further includes a separate microcontroller communicatively coupled to the processor, wherein the microcontroller includes proprietary software that generates commands for sensory feedback to the multiple users in response to the one or more active interactions with the at least one control of the vehicle and the movement of the at least one of the users, and generates commands for the processor to provide the virtual reality video content for each one of the multiple users.

### Claim 6 (depends on 1)

The mixed reality system as recited in claim 1, further comprising a movement device coupled to the articulating universal connection mount, wherein the articulating universal connection mount translates movement from the movement device to the vehicle in response to the one or more active interactions of the user with the at least one control of the vehicle.

### Claim 7 (depends on 1)

The mixed reality system as recited in claim 1, wherein the vehicle is in the real world and replicated in a virtual world of the virtual reality video content.

### Claim 8 (depends on 1)

The mixed reality system as recited in claim 1, further comprising one or more heaters that direct heat to the user in response to the one or more active interactions of the user with the at least one control of the vehicle.

### Claim 9 (depends on 1)

The mixed reality system as recited in claim 1, further comprising a forced feedback device that provides sensory feedback to the user in response to the one or more active interactions.

### Claim 10 (depends on 1)

The mixed reality system as recited in claim 1, wherein the vehicle is a first vehicle and the mixed reality system includes a second vehicle, wherein the system controller is configured to provide virtual reality video content to a user of the second vehicle that is influenced by the interaction or movement of one of the multiple users of the first vehicle.

### Claim 11 (depends on 1)

The mixed reality system as recited in claim 1, wherein the vehicle is a first vehicle and the mixed reality system includes a second vehicle, wherein the system controller is configured to provide virtual reality video content to at least one of the multiple users of the first vehicle that is influenced by an interaction or movement of a user of the second vehicle.

### Claim 12 (depends on 1)

The mixed reality system as recited in claim 1, wherein the vehicle does not constrain movement of the multiple users within the vehicle.

### Claim 13 (depends on 12)

The mixed reality system as recited in claim 12, further comprising a three dimensional virtual reality tracking array that corresponds to the virtual reality interface and tracks the movement of the multiple users within the vehicle, and a hand tracking device that detects hand movement of at least one of the multiple users, wherein the system controller is further configured to provide the virtual reality video content in response to the hand movement.

### Claim 14

A mixed reality system, comprising:
a stationary structure;
a vehicle configured to support multiple users, wherein the vehicle is suspended from the stationary structure via an articulating universal connection mount;
a vertical lifting device coupled to the articulating universal connection mount; and
a system controller comprising a processor configured to provide virtual reality video content to a virtual reality head mounted display of each of the multiple users in response to one or more active interactions of each of the multiple users with their respective virtual reality head mounted display, in response to active interactions of the multiple users with controls of the vehicle, and in response to movement of the multiple users with respect to the vehicle, wherein the articulating universal connection mount translates movement from the vertical lifting device to the vehicle in response to the active interactions of the multiple users with the controls of the vehicle, wherein the virtual reality video content corresponds to a real world of the vehicle and action of any one of the multiple users within the vehicle affects all of the virtual reality video content provided to another one of the multiple users.

### Claim 15 (depends on 14)

The mixed reality system as recited in claim 14, wherein the vehicle is a shark cage.

### Claim 16 (depends on 14)

The mixed reality system as recited in claim 14, further comprising a screen that displays the virtual reality video content external to the structure.

### Claim 17 (depends on 14)

The mixed reality system as recited in claim 14, wherein the vehicle is a balloon basket and the at least one control is a burner valve.

### Claim 18 (depends on 17)

The mixed reality system as recited in claim 17, further comprising one or more heaters that direct heat to the user in response to the one or more active interactions of the user with the at least one control of the vehicle.

### Claim 19 (depends on 17)

The mixed reality system as recited in claim 17, further comprising a forced feedback device that provides sensory feedback to the user in response to the one or more active interactions.

### Claim 20

A mixed reality system, comprising:
a structure;
a vehicle configured to support multiple users, wherein the vehicle is suspended from the structure via an articulating universal connection mount;
a system controller configured to provide virtual reality video content to a virtual reality head mounted display of each of the multiple users in response to one or more active interactions of each of the multiple users with their respective virtual reality head mounted display, in response to one or more active interactions of at least one of the multiple users with at least one control of the vehicle, and in response to movement of at least one of the multiple users with respect to the vehicle,
wherein the system controller includes a processor and a separate microcontroller communicatively coupled to the processor, wherein the microcontroller includes proprietary software that generates commands for sensory feedback to the multiple users in response to the one or more active interactions with the at least one control of the vehicle and movement of at least one of the multiple users, and generates commands for the processor to generate the virtual reality video content for each one of the multiple users,
wherein the vehicle is in a real world and is replicated in a virtual world of the virtual reality video content, which corresponds to the real world of the vehicle and the one or more active interactions with the at least one control of the vehicle and action of any one of the multiple users within the vehicle affects all of the virtual reality video content provided to each one of the multiple users.
