# US 2025/0095163 A1 · Systems and methods for tracking an interactive object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095163 A1
- Document ID: US20250095163A1
- Status: Published application
- Kind: A1
- Application number: 18/886,640
- Filed: 2024-09-16
- Published: 2025-03-20
- Earliest claimed: 2023-09-18
- Applicants: Universal City Studios LLC
- Inventors: Wei Cheng Yeh; Rachel Elise Rodgers
- Web page: https://patentgrep.com/patent/US20250095163A1

## CPC

- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- G01B 11/002: {for measuring two or more coordinates}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06V 10/141: Control of illumination
- G06T 2207/10048: Infrared image
- G06V 2201/07: Target detection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An interactive object control system includes processing circuitry with one or more processors and memory storing instructions, that when executed by the processing circuitry cause the processing circuitry to send instructions to an interactive object to cause one or more object emitters of the interactive object to emit light; receive photodiode array data from one or more photodiode arrays, wherein the photodiode array data is indicative of detection of the light emitted by the one or more object emitters of the interactive object; determine a position of the interactive object in an interactive environment based on the photodiode array data; receive image data from one or more cameras; identify the interactive object in the image data based on the position of the interactive object in the interactive environment and an indication of reflected light in the image data.

## Claims

### Claim 1

An interactive object control system, comprising:
processing circuitry comprising one or more processors; and
memory storing instructions, that when executed by the processing circuitry, cause the processing circuitry to:
send instructions to an interactive object to cause one or more object emitters of the interactive object to emit light;
receive photodiode array data from one or more photodiode arrays, wherein the photodiode array data is indicative of detection of the light emitted by the one or more object emitters of the interactive object;
determine a position of the interactive object in an interactive environment based on the photodiode array data;
receive image data from one or more cameras;
identify the interactive object in the image data based on the position of the interactive object in the interactive environment and an indication of reflected light in the image data;
track motion of the interactive object based on the image data; and
provide output instructions to generate special effect outputs based on the motion of the interactive object.

### Claim 2 (depends on 1)

The interactive object control system of claim 1, wherein the image data from the one or more cameras comprises infrared (IR) image data from one or more IR cameras.

### Claim 3 (depends on 1)

The interactive object control system of claim 1, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to determine the position of the interactive object relative to a grid mapped to the interactive environment based on the photodiode array data, wherein the grid overlaps with a field of view of the one or more cameras.

### Claim 4 (depends on 1)

The interactive object control system of claim 1, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to adjust a field of view of the one or more cameras based on the position of the interactive object.

### Claim 5 (depends on 1)

The interactive object control system of claim 1, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to provide the output instructions to the one or more object emitters to generate the special effect outputs based on the motion of the interactive object.

### Claim 6 (depends on 1)

The interactive object control system of claim 1, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to provide the output instructions to a special effect system in the interactive environment to generate the special effect outputs based on the motion of the interactive object.

### Claim 7 (depends on 1)

The interactive object control system of claim 1, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to receive identification data from an identifier from the interactive object, and to access a profile associated with the interactive object based on the identifier.

### Claim 8 (depends on 7)

The interactive object control system of claim 7, wherein the identifier comprises one or more characteristics of the light emitted by the one or more object emitters, additional light reflected by one or more object reflectors of the interactive object, one or more radiofrequency (RFID) tags, one or more readable codes, or any combination thereof.

### Claim 9 (depends on 7)

The interactive object control system of claim 7, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to send the instructions to the interactive object as object-specific instructions based on the profile to cause the one or more object emitters of the interactive object to emit the light.

### Claim 10 (depends on 8)

The interactive object control system of claim 8, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to:
determine a wavelength of the light based on the photodiode array data; and
compare the wavelength of the light to an expected light in the profile to confirm that the interactive object is associated with the profile.

### Claim 11 (depends on 7)

The interactive object control system of claim 7, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to provide the output instructions to the one or more object emitters generate the special effect outputs based on the motion of the interactive object and the profile.

### Claim 12 (depends on 7)

The interactive object control system of claim 7, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to provide the output instructions to a special effect system in the interactive environment to generate the special effect outputs based on the motion of the interactive object and the profile.

### Claim 13 (depends on 1)

The interactive object control system of claim 1, comprising the interactive object, wherein the interactive object comprises a handheld object or a wearable object.

### Claim 14 (depends on 1)

The interactive object control system of claim 1, comprising one or more filters positioned between the one or more photodiode arrays to block one or more wavelengths of light.

### Claim 15

A method of operating an interactive object control system, the method comprising:
sending, using one or more processors, instructions to an interactive object to cause one or more object emitters of the interactive object to emit light;
receiving, at the one or more processors, photodiode array data from one or more photodiode arrays, wherein the photodiode array data is indicative of detection of the light emitted by the one or more object emitters of the interactive object;
determining, using the one or more processors, a position of the interactive object in an interactive environment based on the photodiode array data;
receiving, at the one or more processors, image data from one or more cameras;
identifying, using the one or more processors, the interactive object in the image data based on the position of the interactive object in the interactive environment and an indication of reflected light in the image data;
tracking, using the one or more processors, motion of the interactive object based on the image data; and
providing, using the one or more processors, output instructions to generate special effect outputs based on the motion of the interactive object.

### Claim 16 (depends on 15)

The method of claim 15, comprising adjusting, using the one or more processors, a field of view of the one or more cameras based on the position of the interactive object.

### Claim 17 (depends on 15)

The method of claim 15, comprising:
receiving, at the one or more processors, an identifier from the interactive object; and
accessing, using the one or more processors, a profile associated with the interactive object based on the identifier.

### Claim 18 (depends on 17)

The method of claim 17, comprising:
sending, using the one or more processors, the instructions to the interactive object as object-specific instructions based on the profile to cause the one or more object emitters of the interactive object to emit the light;
determining, using the one or more processors, a wavelength of the light based on the photodiode array data; and
comparing, using the one or more processors, the wavelength of the light to an expected light in the profile to confirm that the interactive object is associated with the profile.

### Claim 19 (depends on 15)

The method of claim 15, comprising:
detecting, using the one or more processors, presence of a plurality of interactive objects in the interactive environment, wherein the plurality of interactive objects comprises the interactive object as a first interactive object of the plurality of interactive objects;
identifying, using the one or more processors, the first interactive object of the plurality of interactive objects as a best candidate object of the plurality of interactive objects in the interactive environment; and
sending, using the one or more processors and in response to identifying the first interactive object of the plurality of interactive objects as the best candidate object of the plurality of interactive objects, the instructions to the first interactive object of the plurality of interactive objects as object-specific instructions based on the identifier to cause the one or more object emitters of the first interactive object of the plurality of interactive objects to emit the light without causing any respective object emitters of a remainder of the interactive objects of the plurality of interactive objects to emit respective light.

### Claim 20

An interactive object control system, comprising:
an interactive object comprising one or more object emitters and one or more reflectors;
processing circuitry comprising one or more processors; and
memory storing instructions, that when executed by the processing circuitry, cause the processing circuitry to:
receive photodiode array data from one or more photodiode arrays, wherein the photodiode array data is indicative of detection of light emitted by the one or more object emitters of the interactive object;
determine a position of the interactive object in an interactive environment based on the photodiode array data;
receive image data from one or more cameras;
identify the interactive object in the image data based on the position of the interactive object in the interactive environment and an indication of reflected light reflected by the one or more reflectors in the image data;
track motion of the interactive object based on the image data; and
provide output instructions generate special effect outputs based on the motion of the interactive object.

### Claim 21 (depends on 20)

The interactive object control system of claim 20, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to:
receive identification data from an identifier from the interactive object;
access a profile associated with the interactive object based on the identifier; and
send object-specific instructions to the interactive object based on the profile to cause the one or more object emitters of the interactive object to emit the light.

### Claim 22 (depends on 21)

The interactive object control system of claim 21, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to:
determine a wavelength of the light based on the photodiode array data; and
compare the wavelength of the light to an expected light in the profile to confirm that the interactive object is associated with the profile.

### Claim 23 (depends on 20)

The interactive object control system of claim 20, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to provide output instructions to a special effect system in the interactive environment to generate the special effect outputs based on the motion of the interactive object.
