# US 2018/0025750 A1 · Systems and Methods for Featuring a Person in a Video Using Performance Data Associated with the Person

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025750 A1
- Document ID: US20180025750A1
- Status: Published application
- Kind: A1
- Application number: 15/216,584
- Filed: 2016-07-21
- Published: 2018-01-25
- Earliest claimed: 2016-07-21
- Assignees: Disney Enterprises, Inc.
- Applicants: Disney Enterprises, Inc.
- Inventors: Tony R. Smith; Edward C. Drake; Benjamin Havey; Alexander C. Chen
- Web page: https://patentgrep.com/patent/US20180025750A1

## CPC

- G11B 27/036: Insert-editing
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06Q 10/1053: Employment or hiring
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 40/174: {Facial expression recognition}
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- H04N 21/44: Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/44016: {involving splicing one content stream with another content stream, e.g. for substituting a video clip}
- H04N 21/44029: {for generating different versions}
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/854: Content authoring
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

There is provided a system comprising a non-transitory memory and a hardware processor configured to determine elements of a performance in a video, identify one or more people to feature in the video based on the elements of the performance in the video, receive a user input selecting a person from the one or more people to feature in the video, retrieve performance data for featuring the selected person in the video based on actions performed by the actor in the video, create a personalized video by featuring the selected person in the video using the performance data, and display the personalized video on a user device.

## Claims

### Claim 1

A system comprising:
a non-transitory memory storing an executable code; and
a hardware processor executing the executable code to:
determine elements of a performance in a video;
identify one or more people to feature in the video based on the elements of the performance in the video;
receive a user input selecting a person from the one or more people to feature in the video;
retrieve performance data for featuring the selected person in the video based on actions performed by the actor in the video;
create a personalized video by featuring the selected person in the video using the performance data; and
display the personalized video on a user device.

### Claim 2 (depends on 1)

The system of claim 1, wherein determining the elements of the performance in the video includes analyzing a performance of an actor in an existing video.

### Claim 3 (depends on 1)

The system of claim 1 further comprising a display, wherein the hardware processor executes the executable code to provide a user interface on the display for receiving the user input selecting the person from the one or more people to feature in the video, the user interface including a mood tuner for the one or more people.

### Claim 4 (depends on 1)

The system of claim 1, wherein creating the personalized video includes replacing an actor with the selected person in an existing video.

### Claim 5 (depends on 1)

The system of claim 1, wherein creating the personalized video includes updating a scene of an existing video based on the selected person.

### Claim 6 (depends on 1)

The system of claim 1, wherein, prior to receiving the user input selecting the selected person, the hardware processor further executes the executable code to:
display a list of the one or more people selectable by the user to feature in the video on the user device.

### Claim 7 (depends on 1)

The system of claim 1, wherein the performance data is retrieved from one of a performance data database and an online resource.

### Claim 8 (depends on 1)

The system of claim 1, wherein displaying the personalized video on the user device includes displaying permanent elements of the personalized video on a display device and displaying the selected person on an augmented reality (A/R) headset worn by a viewer.

### Claim 9

A method for use with a system including a non-transitory memory and a hardware processor, the method comprising:
determining, using the hardware processor, elements of a performance in a video;
identifying, using the hardware processor, one or more people to feature in the video based on the elements of the performance in the video;
receiving, using the hardware processor, a user input selecting a person from the one or more people to feature in the video;
retrieving, using the hardware processor, performance data for featuring the selected person in the video based on actions performed by the actor in the video;
creating, using the hardware processor, a personalized video by featuring the selected person in the video using the performance data; and
displaying the personalized video on a user device.

### Claim 10 (depends on 9)

The method of claim 9, wherein determining the elements of the performance in the video includes analyzing a performance of an actor in an existing video.

### Claim 11 (depends on 9)

The method of claim 9, wherein the system further includes a display, and wherein the method further comprises:
providing a user interface on the display for receiving the user input selecting the person from the one or more people to feature in the video, the user interface including a mood tuner for the one or more people.

### Claim 12 (depends on 9)

The method of claim 9, wherein creating the personalized video includes replacing an actor with the selected person in an existing video.

### Claim 13 (depends on 9)

The method of claim 9, wherein creating the personalized video includes updating a scene of an existing video based on the selected person.

### Claim 14 (depends on 9)

The method of claim 9, wherein, prior to receiving the user input selecting the selected person, the method further comprises:
displaying, using the hardware processor, a list of the one or more people to feature in the video on the user device.

### Claim 15 (depends on 9)

The method of claim 9, wherein the performance data is retrieved from one of a performance data database and an online resource.

### Claim 16 (depends on 9)

The method of claim 9, wherein displaying the personalized video on the user device includes displaying permanent elements of the personalized video on a display device and displaying the selected person on an augmented reality (A/R) headset worn by a viewer.

### Claim 17

A system comprising:
a performance data capture device;
a non-transitory memory storing an executable code; and
a hardware processor executing the executable code to:
capture performance data of a person using the performance data capture device;
store the performance data of the person in the non-transitory memory;
receive a user input selecting the person to feature in a video;
create a personalized video featuring the person based on the performance data of the person.

### Claim 18 (depends on 17)

The system of claim 17, wherein the performance data includes at least one of a stature of the person, body motion of the person, and facial expressions of the person.

### Claim 19 (depends on 17)

The system of claim 17, wherein the personalized video is one of a new video and a previously recorded video updated to feature the person.

### Claim 20 (depends on 17)

The system of claim 17, wherein capturing the performance data includes at least one of scanning the person and recording motion-capture data of the person.