# US 2021/0279893 A1 · Interactive entertainment system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279893 A1
- Document ID: US20210279893A1
- Status: Published application
- Kind: A1
- Application number: 16/832,703
- Filed: 2020-03-27
- Published: 2021-09-09
- Earliest claimed: 2020-03-09
- Assignees: Disney Enterprises, Inc.
- Applicants: Disney Enterprises, Inc.
- Inventors: Przemyslaw Iwanowski; Bob Hickman; Brent D. Strong; Sarit Ghildayal; Matthew S. Daly; Jeffrey Elbert
- Web page: https://patentgrep.com/patent/US20210279893A1

## CPC

- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
- A63F 13/803: Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
- A63G 31/00: Amusement arrangements
- A63G 31/16: creating illusions of travel
- A63G 33/00: Devices allowing competitions between several persons, not otherwise provided for
- G06N 20/00: Machine learning
- G06T 7/248: {involving reference images or patches}
- G06T 7/292: Multi-camera tracking
- G06T 7/75: {involving models}
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06V 10/143: Sensing or illuminating at different wavelengths
- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06V 10/764: using classification, e.g. of video objects
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06V 40/113: {Recognition of static hand signs}
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G06T 2207/10048: Infrared image
- G06T 2207/20081: Training; Learning
- G06T 2207/30196: Human being; Person
- G06T 2207/30208: Marker matrix
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63G: MERRY-GO-ROUNDS; SWINGS; ROCKING-HORSES; CHUTES; SWITCHBACKS; SIMILAR DEVICES FOR PUBLIC AMUSEMENT
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The present disclosure describes a method for providing an interactive experience. The method includes illuminating, by an enhancer, an area with light having wavelength invisible to humans. A plurality of image detectors capture at least two images of a person in the area including a portion of the light reflected from the person. A processing element determines a first skeletal feature of the person based on the at least two images. The processing element determines a position characteristic of the first skeletal feature; constructs, from the first skeletal feature, a vector in three dimensions corresponding to the position characteristic; and outputs an interactive effect based on the position characteristic.

## Claims

### Claim 1

A method for providing an interactive experience comprising:
illuminating, by an enhancer, an area with light having a wavelength invisible to humans;
receiving, by a plurality of image detectors, at least two images of a person in the area including a portion of the light emitted by the enhancer and reflected from the person;
determining, by a processing element, a first skeletal feature of the person based on the at least two images;
determining, by the processing element, a position characteristic of the first skeletal feature;
constructing from the first skeletal feature, by the processing element, a vector in three dimensions corresponding to the position characteristic; and
outputting an interactive effect based on the position characteristic.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least two images are captured at substantially a same time by different image detectors.

### Claim 3 (depends on 1)

The method of claim 1 further comprising determining a motion characteristic of the first skeletal feature based on a change of the vector over time.

### Claim 4 (depends on 3)

The method of claim 3 further comprising determining a first gesture of the person based on the position characteristic or the motion characteristic of the first skeletal feature.

### Claim 5 (depends on 4)

The method of claim 4, wherein the position characteristic or the motion characteristic is predicted based on a past position characteristic or motion characteristic.

### Claim 6 (depends on 4)

The method of claim 4, wherein the interactive effect is a visual object displayed on a display and based on one of the position characteristic, the motion characteristic, or the first gesture.

### Claim 7 (depends on 4)

The method of claim 4, further comprising:
receiving, by the plurality of image detectors, additional images of the person;
determining, by the processing element, a second skeletal feature of the person from the additional images, wherein the second skeletal feature is smaller than the first skeletal feature.

### Claim 8 (depends on 7)

The method of claim 7, wherein the at least two images and the additional images are captured adjacent one another in time, separated by a predetermined amount of time.

### Claim 9 (depends on 8)

The method of claim 8, wherein the predetermined amount of time is determined by a frame rate of the plurality of image detectors.

### Claim 10 (depends on 7)

The method of claim 7 further comprising determining, by the processing element, a position characteristic of the second skeletal feature.

### Claim 11 (depends on 10)

The method of claim 10 further comprising determining a motion characteristic of the second skeletal feature based on a change in the position characteristic of the second skeletal feature over time.

### Claim 12 (depends on 11)

The method of claim 11 further comprising determining a second gesture of the person based on the position characteristic or the motion characteristic of the second skeletal feature.

### Claim 13 (depends on 3)

The method of claim 3, wherein the motion characteristic is one of a speed, velocity, or acceleration of the first skeletal feature.

### Claim 14 (depends on 1)

The method of claim 1, wherein the enhancer and the plurality of image detectors are fixed to a vehicle including an area adapted to receive the person.

### Claim 15 (depends on 14)

The method of claim 14, wherein the vehicle is in motion.

### Claim 16 (depends on 1)

The method of claim 1, wherein the wavelength is in an infrared band.

### Claim 17 (depends on 16)

The method of claim 16, wherein the wavelength is above 850 nanometers.

### Claim 18 (depends on 1)

The method of claim 1, wherein each of the plurality of image detectors has a field of view that overlaps the field of view of at least one other of the plurality of image detectors.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
detecting a reference point in a calibration target in one of the at least two images; and
adjusting a calibration of one of the plurality of image detectors.

### Claim 20 (depends on 19)

The method of claim 19, wherein the calibration target includes a creative graphic.

### Claim 21 (depends on 12)

The method of claim 12 further comprising determining a compound gesture of the person based on the first and second gesture.

### Claim 22 (depends on 1)

The method of claim 1, wherein the processing element determines the first skeletal feature using an artificial intelligence or machine learning algorithm.

### Claim 23

A method of calibrating a camera comprising:
positioning a calibration target within a field of view of a camera;
capturing, by the camera, an image of the calibration target;
determining a difference between the image of the target and a physical characteristic of the calibration target;
determining a characteristic of the camera based on the difference; and
moving the target automatically by an actuator on a predefined path within the field of view of the camera.

### Claim 24 (depends on 23)

The method of claim 23 further comprising detecting a reference point in the calibration target in the image.

### Claim 25

A method of calibrating a camera system comprising:
positioning a calibration target in a physical environment within a field of view of a plurality of cameras;
capturing, by each of the plurality of cameras, an image of the calibration target;
determining a reference point in the image;
determining a respective position of the reference point with respect to each of the plurality of cameras;
adjusting position information of the camera based on the respective position of the reference point;
constructing a virtual representation of the field of view in three dimensions based on the reference point in the physical environment.

### Claim 26 (depends on 25)

The method of claim 25, wherein the calibration target includes a creative graphic.

### Claim 27

A system for augmenting a user experience comprising:
a wearable article adapted to be worn by a person, a wearable article including:
a processing element that encodes data related to a virtual characteristic of the wearable article,
a transmitter that transmits the encoded data to an entertainment environment;
a detector in the entertainment environment that detects the transmitted data;
a processing element that receives the data detected by the transmitter and changes a characteristic of the entertainment environment according to the virtual characteristic of a wearable article.

### Claim 28 (depends on 27)

The system of claim 27, wherein the transmitter is an LED that transmits the encoded data in a pattern of flashes.

### Claim 29 (depends on 27)

The system of claim 27, wherein the wearable article includes an interface adapted to receive an additional virtual characteristic.

### Claim 30 (depends on 27)

The system of claim 27, wherein the wearable article is a garment.
