# US 11,112,266 B2 · Method for motion-synchronized AR or VR entertainment experience

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,112,266 B2
- Document ID: US11112266B2
- Status: Granted
- Kind: B2
- Application number: 15/042,543
- Filed: 2016-02-12
- Published: 2017-08-17
- Granted: 2021-09-07
- Earliest claimed: 2016-02-12
- Assignees: Disney Enterprises, Inc.
- Applicants: Disney Enterprises, Inc.
- Inventors: Josiah Eatedali; James P. Madden; Mark Arana
- Web page: https://patentgrep.com/patent/US11112266B2

## CPC

- G01C 21/3697: {Output of additional, non-guidance related information, e.g. low fuel level (G01C21/3679 takes precedence)}
- G01C 21/3688: {Systems comprising multiple parts or multiple output devices (not client-server), e.g. detachable faceplates, key fobs or multiple output screens}
- H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Systems and methods for synchronizing movement, such as the movement of a vehicle with an augmented reality (AR) or virtual reality (VR) story-telling or narrative experience is provided. For example, the AR or VR experience can be adapted to justify the movement of the vehicle based on trip criterion, such as a navigational path upon which the vehicle has embarked. Alternatively, trip criterion, such as the navigational path upon which the vehicle will embark, can be adapted to comport with one or more events of the AR or VR experience.

## Claims

### Claim 1

A computer-implemented method, comprising:
determining a route of a vehicle from a starting point to a destination;
presenting a simulated audio or visual (A/V) experience to a passenger of the vehicle;
sensing ride information via a vehicle sensor directly coupled to the vehicle, the ride information corresponding to a motion of the vehicle as the vehicle travels along the route;
obtaining a trip criterion relevant to the route;
presenting a plurality of simulated event occurrences within the simulated A/V experience, wherein the simulated event occurrences are based on the ride information and the trip criterion;
adapting the simulated A/V experience based upon the ride information and the trip criterion, wherein the simulated A/V experience comprises an augmented reality (AR) story-telling narrative; and
receiving a passenger input selecting a quantity of simulated event occurrences, wherein a level of immersiveness of the simulated A/V experience is configured to be adjusted based on the selected quantity of simulated event occurrences.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein adapting the simulated A/V experience comprises presenting one or more AR elements in a context of the AR story-telling narrative configured to comport with one or more events identified in the trip criterion or the ride information.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the trip criterion is obtained from at least one of a navigation system or the vehicle sensor.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the trip criterion is obtained from at least the navigation system, and wherein the navigation system comprises one of an in-vehicle navigation system or a navigation system implemented remotely from the vehicle.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein adapting the simulated A/V experience comprises customizing the simulated A/V experience for the passenger based upon the ride information.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the simulated A/V experience is one of plurality of simulated A/V experiences that are contextually linked.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the ride information corresponds to a change in a condition of an environment external to the vehicle as the vehicle travels along the route.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, wherein the condition comprises weather, temperature, humidity, lighting, or traffic.

### Claim 9 (depends on 7)

The computer-implemented method of claim 7, wherein the vehicle sensor comprises a clock, an image sensor, a temperature sensor, a vibration sensor, a light detection sensor, a vehicle speed sensor, a wheel speed sensor, a motion sensor, an accelerometer, a tilt sensor, an inclination sensor, an angular rate sensor, a gyroscope, a navigation sensor, a geolocation sensor, a magnetometer, a radar sensor, a proximity sensor, a distance sensor, or an engine control module sensor, and the vehicle sensor is configured to sense the change in the condition.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the route comprises a route along a road.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, wherein the route comprises a commuting route.

### Claim 12 (depends on 1)

The computer-implemented method of claim 1, wherein the simulated A/V experience is based on a prior simulated A/V experience.

### Claim 13 (depends on 1)

The computer-implemented method of claim 1, wherein the vehicle includes a window and the computer-implemented method further comprises displaying the simulated A/V experience on the window.

### Claim 14 (depends on 1)

The computer-implemented method of claim 1, further comprising adapting the simulated A/V experience based on a user position in the vehicle.

### Claim 15

A computer-implemented method, comprising:
receiving information regarding a simulated audio or visual (A/V) experience;
generating a trip criterion and a ride information to comport with one or more events of the simulated A/V experience, wherein the ride information corresponds to a motion of a vehicle sensed by a vehicle sensor directly coupled to the vehicle; and
presenting a plurality of simulated event occurrences within the simulated A/V experience in conjunction with the trip criterion and the ride information;
adapting the simulated A/V experience based upon the ride information and the trip criterion, wherein the simulated A/V experience comprises an augmented reality (AR) story-telling narrative; and
receiving a passenger input selecting a quantity of simulated event occurrences, wherein a level of immersiveness of the simulated A/V experience is configured to be adjusted based on the selected quantity of simulated event occurrences.

### Claim 16 (depends on 15)

The computer-implemented method of claim 15, wherein the AR story-telling narrative is developed with a pre-determined event requiring a kinetic response.

### Claim 17 (depends on 16)

The computer-implemented method of claim 16, further comprising parsing a digital representation of the AR story-telling narrative to extract the pre-determined event.

### Claim 18 (depends on 16)

The computer-implemented method of claim 16, further comprising adapting the simulated A/V experience in response to a determination that the at least one of the trip criterion or the ride information cannot meet at least one kinetic response requirement associated with the predetermined event.

### Claim 19 (depends on 15)

The computer-implemented method of claim 15, wherein the trip criterion comprises a path to at least one destination.

### Claim 20

A system, comprising:
a simulation device including a processor, wherein the processor is configured to create a simulated augmented reality (AR) story-telling narrative;
a viewing surface configured to present the AR story-telling narrative to a passenger of a vehicle;
a sensor configured to generate and provide navigational information associated with the vehicle to the simulation device, wherein the processor is further configured to:
generate a simulated audio or visual (A/V) experience based on the navigational information in a context of the AR story-telling narrative,
present a plurality of simulated event occurrences within the simulated A/V experience, wherein the simulated event occurrences are based on a motion of the vehicle due to an external element sensed by a vehicle sensor directly coupled to the vehicle;
adapt the simulated A/V experience based on the motion of the vehicle due to the external element sensed by the vehicle sensor to generate an adapted simulated A/V experience,
receive a passenger input selecting a quantity of simulated event occurrences, wherein a level of immersiveness of the simulated A/V experience is configured to be adjusted based on the selected quantity of simulated event occurrences; and
display the adapted simulated A/V experience to the passenger.

### Claim 21 (depends on 20)

The system of claim 20, wherein the adapted simulated A/V experience justifies the navigational information.

### Claim 22 (depends on 20)

The system of claim 20, wherein the processor is further configured to customize the simulated AR story-telling narrative based on a variable associated with the passenger.

### Claim 23 (depends on 20)

The system of claim 20, wherein the simulated AR story-telling narrative is a portion of a broader story-telling experience.
