# US 2025/0159306 A1 · Generating personalized videos with selective replacement of characters

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0159306 A1
- Document ID: US20250159306A1
- Status: Published application
- Kind: A1
- Application number: 19/028,130
- Filed: 2025-01-17
- Published: 2025-05-15
- Earliest claimed: 2019-03-10
- Inventors: Ben Avi lngel; Ron Zass
- Web page: https://patentgrep.com/patent/US20250159306A1

## CPC

- H04N 21/8106: {involving special audio data, e.g. different tracks for different languages}
- H04N 21/8126: {involving additional data, e.g. news, sports, stocks, weather forecasts}
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 13/033: Voice editing, e.g. manipulating the voice of the synthesiser
- G10L 13/086: {Detection of language}
- G10L 13/10: Prosody rules derived from text; Stress or intonation
- H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/26603: {for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/458: Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules {; time-related management operations (arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10)}
- H04N 21/4755: {for defining user preferences, e.g. favourite actors or genre (retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems, methods and non-transitory computer readable media for generating personalized videos with selective replacement of characters are provided. An input video including at least a depiction of two or more persons may be obtained. A personalized profile associated with a user may be obtained. The input video may be analyzed to determine at least one property for each person of a group of at least two persons of the two or more persons depicted in the input video. The personalized profile and the determined properties may be used to select a first person of the group of at least two persons, where the group of at least two persons also includes a second person. The input video may be used to generate an output video including the depiction of the second person and a depiction of an avatar replacing at least part of the depiction of the first person.

## Claims

### Claim 1

A computer program product for generating personalized videos with selective replacement of characters, the computer program product embodied in a non-transitory computer-readable medium and including instructions that when executed by at least one processor cause the at least one processor to execute a method, the method comprising:
obtaining an input video including at least a depiction of two or more persons;
obtaining a personalized profile associated with a user;
analyzing the input video to determine at least one property for each person of a group of at least two persons of the two or more persons depicted in the input video;
using the personalized profile and the determined properties to select a first person of the group of at least two persons, where the group of at least two persons also includes a second person; and
in response to the selection of the first person, using the input video to generate an output video including the depiction of the second person and a depiction of an avatar replacing at least part of the depiction of the first person.

### Claim 2 (depends on 1)

The computer program product of claim 1, wherein the method further comprises:
using an artificial neural network to analyze the input video to determine the at least one property for each person of a group of at least two persons; and
using the artificial neural network to generate the output video using the input video.

### Claim 3 (depends on 1)

The computer program product of claim 1, wherein the method further comprises:
analyzing the input video to detect the depiction of the first person; and
replacing the detected depiction of the first person with a depiction of an avatar to generate the output video.

### Claim 4 (depends on 1)

The computer program product of claim 1, wherein the at least one property of the first person is a first color, the at least one property of the second person is a second color, and the selection of the first person is based on the first color.

### Claim 5 (depends on 1)

The computer program product of claim 1, wherein the at least one property of the first person is a size associated with the first person, the at least one property of the second person is a size associated with the second person, and the selection of the first person is based on at least one of the size associated with the first person or the size associated with the second person.

### Claim 6 (depends on 5)

The computer program product of claim 5, wherein the size associated with the first person is a size of a body part of the first person, and the size associated with the second person is a size of a body part of the second person.

### Claim 7 (depends on 1)

The computer program product of claim 1, wherein the at least one property of the first person is a texture of a clothing item of the first person, the at least one property of the second person is a texture of a clothing item of the second person, and the selection of the first person is based on at least one of the texture of the clothing item of the first person or the texture of the clothing item of the second person.

### Claim 8 (depends on 1)

The computer program product of claim 1, wherein the at least one property of the first person is a gender associated with the first person, the at least one property of the second person is a gender associated with the second person, and the selection of the first person is based on at least one of the gender associated with the first person or the gender associated with the second person.

### Claim 9 (depends on 1)

The computer program product of claim 1, wherein the at least one property of the first person is a shape of at least part of the first person, the at least one property of the second person is a shape of at least part of the second person, and the selection of the first person is based on at least one of the shape of the at least part of the first person or the shape of the at least part of the second person.

### Claim 10 (depends on 1)

The computer program product of claim 1, wherein the at least one property of the first person is a property of a voice of the first person, the at least one property of the second person is a property of a voice of the second person, and the selection of the first person is based on at least one of the property of the voice of the first person or the property of the voice of the second person.

### Claim 11 (depends on 1)

The computer program product of claim 1, wherein the at least one property of the first person is an age of the first person, the at least one property of the second person is an age of the second person, and the selection of the first person is based on at least one of the age of the first person or the age of the second person.

### Claim 12 (depends on 1)

The computer program product of claim 1, wherein the at least one property of the first person is a modesty level associated with the first person, the at least one property of the second person is a modesty level associated with the second person, and the selection of the first person is based on at least one of the modesty level associated with the first person or the modesty level associated with the second person.

### Claim 13 (depends on 1)

The computer program product of claim 1, wherein the at least one property of the first person is an emotional state associated with the first person, the at least one property of the second person is an emotional state associated with the second person, and the selection of the first person is based on at least one of the emotional state associated with the first person or the emotional state associated with the second person.

### Claim 14 (depends on 1)

The computer program product of claim 1, wherein at least one characteristic of the avatar is based on the personalized profile.

### Claim 15 (depends on 14)

The computer program product of claim 14, wherein the personalized profile is based on a geographical destination associated with the user, and the at least one characteristic of the avatar is based on the geographical destination associated with the user.

### Claim 16 (depends on 14)

The computer program product of claim 14, wherein the personalized profile is based on a cultural tradition associated with the user, and the at least one characteristic of the avatar is based on the cultural tradition.

### Claim 17 (depends on 14)

The computer program product of claim 14, wherein the personalized profile is based on a socioeconomic status of the user, and the at least one characteristic of the avatar is based on the socioeconomic status.

### Claim 18 (depends on 14)

The computer program product of claim 14, wherein the personalized profile is based on an emotional state of the user, and the at least one characteristic of the avatar is based on the emotional state.

### Claim 19

A system for generating personalized videos with selective replacement of characters, the system comprising at least one processor configured to:
obtain an input video including at least a depiction of two or more persons;
obtain a personalized profile associated with a user;
analyze the input video to determine at least one property for each person of a group of at least two persons of the two or more persons depicted in the input video;
use the personalized profile and the determined properties to select a first person of the group of at least two persons, where the group of at least two persons also includes a second person; and
in response to the selection of the first person, use the input video to generate an output video including the depiction of the second person and a depiction of an avatar replacing at least part of the depiction of the first person.

### Claim 20

A method for generating personalized videos with selective replacement of characters, the method comprising:
obtaining an input video including at least a depiction of two or more persons;
obtaining a personalized profile associated with a user;
analyzing the input video to determine at least one property for each person of a group of at least two persons of the two or more persons depicted in the input video;
using the personalized profile and the determined properties to select a first person of the group of at least two persons, where the group of at least two persons also includes a second person; and
in response to the selection of the first person, using the input video to generate an output video including the depiction of the second person and a depiction of an avatar replacing at least part of the depiction of the first person.
