# US 2017/0374399 A1 · Computing infrastructure for movie making, product placements and distribution

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0374399 A1
- Document ID: US20170374399A1
- Status: Published application
- Kind: A1
- Application number: 15/195,065
- Filed: 2016-06-28
- Published: 2017-12-28
- Earliest claimed: 2016-06-23
- Inventors: BINDU RAMA RAO
- Web page: https://patentgrep.com/patent/US20170374399A1

## CPC

- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/234318: {by decomposing into objects, e.g. MPEG-4 objects}
- H04N 21/2543: Billing {, e.g. for subscription services (payment schemes, architectures or protocols G06Q20/00; e-commerce G06Q30/00; arrangements for billing for the use of broadcast information or broadcast-related information H04H60/21)}
- H04N 21/2547: Third Party Billing, e.g. billing of advertiser
- H04N 21/262: Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists {(scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62)}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/47202: {for requesting content on demand, e.g. video on demand}
- H04N 21/475: End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N 21/854: Content authoring
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A computing infrastructure for movie making, product placements in the movie, etc. It provides movie creation and post-production services and supports clearance. Product placement services are provided for digital media of all kinds such as movies, video clips, audio clips, etc. The processing starts when a new digital media is created/uploaded by a user. Then detection of placeholder objects (one or more) is facilitated. The output is a catalog of placeholder objects. The user can review this output and modify it, and store it for subsequent processing. Then the user can replace placeholder objects with product placement material to create a modified digital media that is distributed.

## Claims

### Claim 1

A infrastructure for processing digital media, the infrastructure comprising:
a digital media upload service that provides a first digital media received from a remote source;
a product placement capture service that provides a first product placement interface data, the first product placement interface data including at least one product placement item;
a first product finder service, that processes the first digital media to find a plurality of distinguishable objects and stores them as placeholder objects, along with their frequency of occurrence and corresponding locations in the first digital media;
a first product replacement service that processes the first digital media to replace at least one of the placeholder objects with at least one of the at least one product placement item, to create a modified first digital media.

### Claim 2 (depends on 1)

The infrastructure of claim 1 wherein the first digital media is a movie;

### Claim 3 (depends on 1)

The infrastructure of claim 1 further comprising:
a digital media distribution service that distributes the modified first digital media to a plurality of client devices.

### Claim 4 (depends on 1)

The infrastructure of claim 1 further comprising:
a used products list for the digital media that is also provided in the first digital media data, that the digital media upload service stores for subsequent processing;
the first product finder service employing the used products list in determining the plurality of distinguishable objects and their corresponding locations in the first digital media.

### Claim 5 (depends on 1)

The infrastructure of claim 1 wherein the product placement capture service scales the at least one of the at least one product placement item as necessary before using them to replace corresponding ones of the at least one of the placeholder objects.

### Claim 6 (depends on 1)

The infrastructure of claim 1 further comprising:
a billing service that charges a billing amount to an account associated with an organization managing the at least one product placement item for services rendered, wherein a portion of a billing amount is paid to a second account associated with a second organization as payment for placement of the least one product placement item in the digital media.

### Claim 7

A infrastructure for enhancing movies, the infrastructure comprising:
a digital media;
a product placement placeholder determination service that provides a first interface data received via a promotion capture interface of a first promoter system, to a first product placement placeholder determination software application, the first interface data including first promotion data using which the product placement placeholder determination software application processes the digital media to produce a first promoter placeholder objects listing that it makes available via a product placement management interface for management from the first promoter system;
a promotion database;
the product placement placeholder determination service storing first promotion data and the first promoter placeholder objects listing, the first promotion data having first product marketing items list, a first configuration, and a first identifier code;
a digital media advertisement update service that provides an update interface to an update software application that navigates through each occurrence in the digital media of the individual items of the first promoter placeholder objects listing, enabling selective replacements of the individual items of the first promoter placeholder objects listing with corresponding ones from the first product marketing items list, the update software application creating a modified digital media after replacements; and
the digital media advertisement update service enabling review and approval of the modified digital media using a second software application.

### Claim 8 (depends on 7)

The infrastructure for enhancing movies of claim 7 further comprising:
a billing service that provides access to a billing software application that processes the modified digital media to determine a billing amount that the billing software application communicates to the first promoter system.

### Claim 9 (depends on 7)

The infrastructure for enhancing movies of claim 7 further comprising:
a digital media distributing service that provides a digital media distributing interface to a plurality of remote client devices through which the infrastructure distributes the modified digital media after its approval.

### Claim 10 (depends on 7)

The infrastructure for enhancing movies of claim 7 further comprising:
a digital media distributing service that provides a digital media distributing interface to an external media server through which the external media server retrieves the modified digital media for eventual distribution to a plurality of client devices.

### Claim 11 (depends on 7)

The infrastructure for enhancing movies of claim 7 further comprising:
the product placement placeholder determination service providing a second interface data received via the promotion capture interface of a second promoter system, to a second product placement placeholder determination software application, the second interface data including second promotion data using which the second product placement placeholder determination software application processes the digital media to produce a second promoter placeholder objects listing that it makes available via the product placement management interface for management from the second promoter system;
the digital media advertisement update service providing the update interface to the update software application that navigates through each occurrence in the digital media of the individual items of a second promoter placeholder objects listing, enabling selective replacements of the individual items of the second promoter placeholder objects listing with corresponding ones from a second product marketing items list, the update software application creating a second modified digital media after replacements; and
a distribution ready software application merging the modified digital media and the second modified digital media to create a final modified digital media that is ready for distribution and sharing.

### Claim 12

A server for processing movies, the server comprising a storage, a memory and a processor, the server comprising:
an image upload manager that receives and stores a plurality of images to be used as product placement;
a movie processing manager that receives and stores a movie;
the movie processing manager searches for the occurrence of placeholder objects in the movie and assembles a placeholder objects list and corresponding locations in the movie where they are determined to occur; and
a movie updater replaces specific occurrences of placeholder objects in the movie with corresponding ones of plurality of images, and creates a modified movie.

### Claim 13 (depends on 12)

The server for processing movies of claim 12 further comprising:
a distributing manager that communicates the modified movie to a video server infrastructure for subsequent distribution.

### Claim 14 (depends on 12)

The server for processing movies of claim 12 wherein the placeholder objects are provided by a user.

### Claim 15 (depends on 12)

The server for processing movies of claim 12 wherein a user specific placeholder objects provided by a user is added to the placeholder objects list, to create an updated placeholder objects list, wherein the movie updater replaces specific occurrences, in the movie, of placeholder objects from the updated placeholder objects list, with corresponding ones of plurality of images, and creates a modified movie.

### Claim 16 (depends on 12)

The server for processing movies of claim 12 further comprising:
a placeholder objects manager that provides access to the placeholder objects list from a plurality of client devices communicatively coupled to the server;
the placeholder objects manager facilitates browsing of the placeholder objects list and selection of items from the placeholder objects list, by a product promoter, as targets for replacement; and
the movie updater replaces specific occurrences of the placeholder objects in the movie that are specified as targets for replacement, with corresponding ones of plurality of images, and creates the modified movie.

### Claim 17 (depends on 12)

The server for processing movies of claim 12 further comprising:
the image upload manager receives and stores a plurality of images to be used as product placement, from each of a plurality of users, and aggregates them in an aggregated plurality of images;
the movie processing manager searches, for each of the plurality of users, for the occurrence of placeholder objects in the movie and assembles a placeholder objects list, for each of the plurality of users, and corresponding locations in the movie where they are determined to occur;
a placeholder objects manager creates an aggregated placeholder objects list from the placeholder objects list created for each of the plurality of users; and
the movie updater replaces any of the specific occurrences of the placeholder objects from the aggregated placeholder objects list in the movie, employing corresponding ones of the aggregated plurality of images, in creating the modified movie.

### Claim 18 (depends on 12)

The server for processing movies of claim 12 wherein the movie updater provides screens for manual replacement of any of the specific occurrences of the placeholder objects in the movie by an authorized user, employing corresponding ones of plurality of images, in creating the modified movie.

### Claim 19 (depends on 12)

The server for processing movies of claim 12 wherein the movie processing manager provides screens for manual searches of the movie by a plurality of users for the determination of placeholder objects in the movie, and assembles the placeholder objects list and corresponding locations based on the manual searches.

### Claim 20 (depends on 12)

The server for processing movies of claim 12 wherein the each of the plurality of users provide a user specific list of anticipated objects to be used in movie processing manager provides screens for manual searches of the movie by a plurality of users.
