# US 2020/0391105 A1 · Digital character interacting with customer in physical realm

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0391105 A1
- Document ID: US20200391105A1
- Status: Published application
- Kind: A1
- Application number: 15/931,377
- Filed: 2020-05-13
- Published: 2020-12-17
- Earliest claimed: 2019-06-11
- Assignees: Universal City Studios LLC
- Applicants: Universal City Studios LLC
- Inventors: Sarah Scialli; Demian Gordon
- Web page: https://patentgrep.com/patent/US20200391105A1

## CPC

- A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/215: comprising means for detecting acoustic signals, e.g. using a microphone
- A63F 13/23: for interfacing with the game device, e.g. specific interfaces between game controller and console
- A63F 13/56: Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06V 10/147: Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19)
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G10L 25/51: for comparison or discrimination
- A63F 2300/1025: details of the interface with the game device, e.g. USB version detection
- A63F 2300/105: using inertial sensors, e.g. accelerometers, gyroscopes
- A63F 2300/1081: Input via voice recognition
- A63F 2300/1087: comprising photodetecting means, e.g. a camera
- A63J 99/00: Subject matter not provided for in other groups of this subclass
- G06V 40/18: Eye characteristics, e.g. of the iris
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- A63J: DEVICES FOR THEATRES, CIRCUSES, OR THE LIKE; CONJURING APPLIANCES OR THE LIKE

## Abstract

Systems and methods for controlling performance of a digital character depicted at a display device are disclosed. According to at least one embodiment, a method for controlling performance of a digital character depicted at a display device includes: determining a presence of a person located in a physical environment; and in response to determining the presence of the person, facilitating control of the performance of the digital character depicted at the display device by a human operator, by an artificial intelligence (AI) game-engine, or by a combination thereof.

## Claims

### Claim 1

A method for controlling performance of a digital character depicted at a display device, the method comprising:
determining a presence of a person located in a physical environment; and
in response to determining the presence of the person, facilitating control of the performance of the digital character depicted at the display device by a human operator, by an artificial intelligence (AI) game-engine, or by a combination thereof.

### Claim 2 (depends on 1)

The method of claim 1, wherein the determination of the presence of the person is performed based on data received from at least a camera or a microphone located in the physical environment.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining the presence of the person comprises autonomously determining at least one of a characteristic of an appearance of the person, an emotional state of the person, or an audio originating from the person.

### Claim 4 (depends on 3)

The method of claim 3, wherein facilitating control of the performance of the digital character by the human operator comprises providing at least one option selectable by the human operator, for controlling the digital character to address the person according to the determined characteristic or the determined emotional state.

### Claim 5 (depends on 1)

The method of claim 1, wherein facilitating control of the performance of the digital character by the human operator comprises receiving motion capture data corresponding to the human operator.

### Claim 6 (depends on 5)

The method of claim 5, wherein receiving the motion capture data comprises:
receiving data from an optical motion capture system; and
receiving data from an inertial motion capture system.

### Claim 7 (depends on 6)

The method of claim 6, wherein the data received from the optical motion capture system comprises data corresponding to one or more optical markers located at a waist region of the human operator.

### Claim 8 (depends on 6)

The method of claim 6, wherein the data received from the optical motion capture system is for performing drift correction of a position of the human operator that is determined based on the data received from the inertial motion capture system.

### Claim 9 (depends on 1)

The method of claim 1, wherein the control of the performance of the digital character by the human operator is facilitated such that performance of the digital character is concurrently driven by both the human operator and the AI game-engine.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving a request from the person; and
servicing the request by causing a change in the physical environment in which the person is located, wherein servicing the request comprises providing a physical object to be delivered for retrieval by the person.

### Claim 11

An apparatus for controlling performance of a digital character depicted at a display device, the apparatus comprising:
a network communication unit configured to transmit and receive data; and
one or more controllers configured to:
determine a presence of a person located in a physical environment; and
in response to determining the presence of the person, facilitate control of the performance of the digital character depicted at the display device by a human operator, by an artificial intelligence (AI) game-engine, or by a combination thereof.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the determination of the presence of the person is performed based on data received from at least a camera or a microphone located in the physical environment.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein the one or more controllers are configured to determine the presence of the person by autonomously determining at least one of a characteristic of an appearance of the person, an emotional state of the person, or an audio originating from the person.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the one or more controllers are configured to facilitate control of the performance of the digital character by the human operator by providing at least one option selectable by the human operator, for controlling the digital character to address the person according to the determined characteristic or the determined emotional state.

### Claim 15 (depends on 11)

The apparatus of claim 11, wherein the one or more controllers are configured to facilitate control of the performance of the digital character by the human operator by receiving motion capture data corresponding to the human operator.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein receiving the motion capture data comprises:
receiving data from an optical motion capture system; and
receiving data from an inertial motion capture system.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the data received from the optical motion capture system comprises data corresponding to one or more optical markers located at a waist region of the human operator.

### Claim 18 (depends on 16)

The apparatus of claim 16, wherein the data received from the optical motion capture system is for performing drift correction of a position of the human operator that is determined based on the data received from the inertial motion capture system.

### Claim 19 (depends on 11)

The apparatus of claim 11, wherein the control of the performance of the digital character by the human operator is facilitated such that performance of the digital character is concurrently driven by both the human operator and the AI game-engine.

### Claim 20

A machine-readable non-transitory medium having stored thereon machine-executable instructions for controlling performance of a digital character depicted at a display device, the instructions comprising:
determining a presence of a person located in a physical environment; and
in response to determining the presence of the person, facilitating control of the performance of the digital character depicted at the display device by a human operator, by an artificial intelligence (AI) game-engine, or by a combination thereof.
