# US 2024/0205465 A1 · Customized Program Insertion System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205465 A1
- Document ID: US20240205465A1
- Status: Published application
- Kind: A1
- Application number: 18/397,140
- Filed: 2023-12-27
- Published: 2024-06-20
- Earliest claimed: 2007-01-10
- Inventors: Steven SCHRAGA
- Web page: https://patentgrep.com/patent/US20240205465A1

## CPC

- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- G11B 27/036: Insert-editing
- H04N 7/17318: {Direct or substantially direct transmission and handling of requests}
- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/2743: Video hosting of uploaded data from client
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4753: {for user identification, e.g. by entering a PIN or password (cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08)}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Segments of code are provided, configured to cause a camera of a device to in real time, take a sequence of images of a subject, the device being a computer that is a portable telephone device, having memory and a processor, and having the camera and a display, the sequence of images being stored. Segments of code are also provided that are configured to cause detecting of portions from each of the sequence of images, the portions corresponding to an object of the subject having features moving in time. The computer-readable media may be the memory of the device, wherein the code is executable by a controller provided in the device. The object in one aspect is a human face. Segments of code may also be provided that are configured to cause the device identifying, for each of plural images within the sequence, a set of object features from the detected portions. The device determines and defines movements of the object features. The device may also insert, in real time as the taken sequence of images are received by the device, a model insertion object into the taken images of the sequence in correspondence with the detected portions, thereby providing new inserted features corresponding to the object features. The device moves the new inserted features similar to the defined movements of the object features.

## Claims

### Claim 1

A non-transitory computer-readable medium encoded with code executable by a computer, the code comprising;
segments of code configured to cause a camera of a device to, in real time, take a sequence of images of a subject, the device being a computer that is a portable telephone device, having memory and a processor, and having the camera and a display, the sequence of images being stored; and
segments of code configured to cause detecting of portions from each of the sequence of images, the portions corresponding to an object of the subject having features moving in time.

### Claim 2 (depends on 1)

The non-transitory computer-readable medium according to claim 1, wherein the computer-readable media is the memory of the device, and wherein the code is executable by a controller provided in the device.

### Claim 3 (depends on 1)

The non-transitory computer-readable medium according to claim 1, wherein the sequence of images are stored in the memory of the device.

### Claim 4 (depends on 1)

The non-transitory computer-readable medium according to claim 1, wherein the object is a human face.

### Claim 5 (depends on 4)

The non-transitory computer-readable medium according to claim 4, wherein the code comprises segments of code configured to cause identification of the moving features in the stored images, the identification including obtaining histogram of the object.

### Claim 6 (depends on 5)

The non-transitory computer-readable medium according to claim 5, wherein the code comprises segments of code configured to cause determining motion vectors associated with the identified features.

### Claim 7 (depends on 6)

The non-transitory computer-readable medium according to claim 6, wherein the code comprises segments of code configured to cause determining an image capture perspective angle in relation to the human face.

### Claim 8 (depends on 7)

The non-transitory computer-readable medium according to claim 7, wherein the determining of an image capture perspective angle includes determining a distance between select ones of the detected features.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium according to claim 8, wherein the distance, between the select ones of the detected features, is determined based on the histograms and motion vectors corresponding to the select ones of the detected features.

### Claim 10 (depends on 8)

The non-transitory computer-readable medium according to claim 8, wherein the select ones include the eyes and nose of the human face.

### Claim 11 (depends on 8)

The non-transitory computer-readable medium according to claim 8, wherein the select ones include the eyes and hairline of the human face.

### Claim 12 (depends on 8)

The non-transitory computer-readable medium according to claim 8, wherein the select ones include points along a perimeter of the head of the human face.

### Claim 13 (depends on 1)

The non-transitory computer-readable medium according to claim 1, the code further comprising:
segments of code configured to cause the device to identify, for each of plural images within the sequence, a set of object features from the detected portions; and
segments of code configured to cause the device to determine and define movements of the object features.

### Claim 14 (depends on 13)

The non-transitory computer-readable medium according to claim 13, the code further comprising:
segments of code configured to cause the device to display the taken sequence of images on the display;
segments of code configured to cause the device to insert, in real time as the taken sequence of images are received by the device, a model insertion object into the received images of the taken sequence of images in correspondence with the detected portions, thereby providing new inserted features corresponding to the object features; and
segments of code configured to cause the device to move the new inserted features similar to the defined movements of the object features.

### Claim 15 (depends on 1)

The non-transitory computer-readable medium according to claim 1, the code further comprising:
segments of code configured to cause forming, for display by an audience including the device, a video signal from the sequence of images, and over a plurality of such images, obtaining histograms to identify individual features of the object; and
segments of code configured to cause determining motion vectors respectively associated with the identified features of the object.

### Claim 16

A non-transitory computer-readable medium encoded with code executable by a computer, the code causing the generation of a three-dimensional (3D) model of a subject for insertion in a program, the code comprising:
segments of code configured to cause determining and recording 3D positions of the subject relative to a position of an image capture device, and repeating the determining and recording of the relative 3D positions at plural positions surrounding the subject;
segments of code configured to cause capturing an image of the subject at each of the plural positions surrounding the subject;
segments of code configured to cause recording image capture perspective angles in relation to the subject for each of the recorded relative 3D coordinates; and
segments of code configured to cause creating a 3D model of the subject based on the captured surrounding images and associated recorded relative 3D positions and image capture perspective angles.

### Claim 17 (depends on 16)

The non-transitory computer-readable medium according to claim 16, wherein the plural positions of the image capture device include at least a first position capturing a face of the subject.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium according to claim 17, wherein the first position capturing the face of the subject corresponds to an image capture perspective azimuth angle of zero degrees.

### Claim 19 (depends on 17)

The non-transitory computer-readable medium according to claim 17, the code further comprising:
segments of code configured to cause extracting a portion of the 3D model image to provide a model insertion image; and
segments of code configured to cause inserting the model insertion image into a program so as to correspond to features of an object in the program.
