# US 2019/0174157 A1 · Dynamic content rendering in media

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0174157 A1
- Document ID: US20190174157A1
- Status: Published application
- Kind: A1
- Application number: 16/256,957
- Filed: 2019-01-24
- Published: 2019-06-06
- Earliest claimed: 2017-04-25
- Assignees: Accenture Global Solutions Limited
- Applicants: Accenture Global Solutions Limited
- Inventors: Christian Souche; Edouard Mathon; Alexandre Naressi
- Web page: https://patentgrep.com/patent/US20190174157A1

## CPC

- G06Q 30/0277: {Online advertisement}
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06Q 30/0241: Advertisements
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G06T 7/13: Edge detection
- G06T 7/75: {involving models}
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 15/205: {Image-based rendering}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/25825: {involving client display capabilities, e.g. screen resolution of a mobile phone (optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06)}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system for rendering media having content displayed comprises a receiving unit to receive media, a scanner to detect an object in the media for placing a placeholder, a checker to provide the placeholder to a user for feedback and receive the feedback. The system also includes a template generator to generate a template indicating the placeholder in the media, The system also includes a rendering unit in communication with the template generator to render, upon receiving a request for watching the media, the media having content to display to the user, based on at least one of a storage space and a processing capacity.

## Claims

### Claim 1

A system for rendering media having content displayed therein, the system comprising:
a receiving unit to receive media, wherein the media includes one of an image and a video;
a scanner in communication with the receiving unit to:
detect a potential object in the media for placing a placeholder, based on at least one of a semantic segmentation technique and an edge detection technique; and
determine a position of the placeholder to be placed in the object of the media, based on the detection of the object;
a checker, in communication with the scanner, the checker to:
provide the placeholder being positioned in the media to a user for feedback; and
receive the feedback of the user for the placeholder, wherein the feedback is indicative of one of an approval, a rejection, and a pending status of the placeholder;
a template generator in communication with the scanner and the checker to generate a template indicating the placeholder in the media, wherein the template includes at least one of details pertaining to the media and details pertaining to the approved placeholder; and
a rendering unit in communication with the template generator to:
detect, when the media is the video, frames of the video having the placeholder, based on the details of the media and the approved placeholder indicated in the template;
classify the frames into frames with placeholders and frames without placeholders, based on the detection; and
render, upon receiving a request for watching the media, the media having content to display to the user, based on at least one of a storage space and a processing capacity, wherein the rendering includes:
when a remote player for playing the media allows the media to be played in two or more pieces:
providing portions of the media having the frames without the placeholders, and
rendering portions of the media having the frames with the placeholders while the portions of the media having the frames without the placeholders are being simultaneously watched; and
when the remote player allows the media to be played in one piece:
rendering portions of the media having the frames with the placeholders, and
providing the media having the frames without the placeholders and the frames with the placeholders, when the rendering is finished.

### Claim 2 (depends on 1)

The system of claim 1, wherein the rendering unit to further,
detect, when the media is the video, a position of the placeholder in the media, based on the details pertaining to the placeholder indicated in the template;
cut portions of the media having the placeholder, from the media, based on the detection;
crop the portions having the placeholder after cutting the portions from the media; and
render, upon receiving a request for watching the media, the cropped portions of the media having the placeholder to the user, wherein the rendering includes:
when a remote player for playing the media allows the media to be played in two or more pieces:
providing portions of the media without the placeholder, and
rendering the cropped portions of the media having the placeholder while the portions of the media without the placeholders are being simultaneously watched, based on the details pertaining to the placeholder indicated in the template; and
when the remote player allows the media to be played in one piece:
rendering portions of the media with the placeholders, and
providing the media having the portions without the placeholder and the portions with the placeholder, when the rendering is finished.

### Claim 3 (depends on 1)

The system of claim 1, wherein the rendering unit is further to:
abort the rendering of a portion of the media having the frames with the placeholders, if the rendering is not finished till the time the remote player reaches the portion; and
provide the portion of the media without the placeholders, after the abortion.

### Claim 4 (depends on 1)

The system of claim 1, wherein the scanner is to further track, when the media is the video, the placeholder in different frames of the video, based on a comparison of coordinates of the placeholder in the different frames.

### Claim 5 (depends on 1)

The system of claim 1, wherein in order to provide the placeholder to the user for the feedback, the checker to highlight, for the user, at least one zone for placing the content on a frame of the media, in form of a semi-transparent rectangle.

### Claim 6 (depends on 1)

The system of claim 1, wherein for providing the placeholder to the user for the feedback, the checker is to insert the content in at least one zone of a frame of the media.

### Claim 7 (depends on 1)

The system of claim 1 further comprising a dynamic integrator in communication with the template generator, the dynamic integrator to insert the content in the placeholder of the media indicated in the template, wherein dimensions of the content correspond to dimensions of the placeholder.

### Claim 8 (depends on 7)

The system of claim 7, wherein the content is an advertisement and the receiving unit is to further receive the advertisement to be inserted in the placeholder of the media from an advertisement network.

### Claim 9 (depends on 1)

The system of claim 1, wherein the details pertaining to the media includes at least one of a name, a description, a location of the media on a storage server, and metadata.

### Claim 10 (depends on 1)

The system of claim 1, wherein the details pertaining to the placeholder include at least one of a position of the placeholder, dimensions of the placeholder, and a frame of the placeholder.

### Claim 11 (depends on 1)

The system of claim 1 further comprising:
an instruction receiving unit in communication with the checker, the instruction receiving unit to receive, when the placeholder is approved, instructions from the user for adding special effects to the placeholder, wherein the special effects include at least one of a color correction, a contrast, a brightness, a saturation, and a blur;
a machine learner in communication with the scanner, the checker, and the instruction receiving unit, the machine learner to monitor, for predefined time intervals, the detection of the object, the determination of the position of the placeholder, the feedback of the user for the placeholder, and selection of the special effects for the placeholder; and
the scanner in communication with the machine learner and the receiving unit, the scanner to further:
detect another object in the media or at least another media;
determine a position of another placeholder to be placed in the other object; and
suggest special effects for addition to the other placeholder, based on the monitoring.

### Claim 12 (depends on 11)

The system of claim 11, wherein the instruction receiving unit is to:
replace the placeholder with a neutral image on the media, wherein the neutral image is indicative of the content without the special effects; and
change an appearance of the neutral image, based on selection of one of more of the special effects.

### Claim 13

A system for rendering media having content displayed therein, the system comprising:
a receiving unit to receive media, wherein the media includes one of an image and a video;
a scanner in communication with the receiving unit, the scanner to:
detect a potential object in the media for placing a placeholder, based on at least one of a semantic segmentation technique, and an edge detection technique; and
determine a position of the placeholder to be placed in the object of the media, based on the detection of the object;
a checker, in communication with the scanner, the checker to:
provide the placeholder being positioned in the media to a user for feedback; and
receive the feedback of the user for the placeholder, wherein the feedback is indicative of one of an approval, a rejection, and a pending status of the placeholder;
a template generator in communication with the scanner and the checker, the template generator to generate a template indicating the placeholder in the media, wherein the template includes at least one of details pertaining to the media and details pertaining to the approved placeholder; and
a rendering unit in communication with the template generator, the rendering unit to:
receive information pertaining to specification of a remote machine being used to watch the media;
determine whether the remote machine is compatible to render the media, based on the specification of the remote machine;
provide the media, the content, and the template to the remote machine; and
integrate the content with each frame of the media, based on the template, while portions of the media without the placeholder are being played by the remote machine.

### Claim 14 (depends on 13)

The system of claim 13, wherein the rendering unit is further to:
abort the rendering of a portion of the media having the frames with the placeholders, if the rendering is not finished till the time the remote player reaches the portion; and
provide the portion of the media without the placeholders after the abortion.

### Claim 15 (depends on 13)

The system of claim 13, wherein the scanner is to further track, when the media is the video, the placeholder in different frames of the video, based on a comparison of coordinates of the placeholder in the different frames.

### Claim 16

A method comprising:
receiving, by a processor, media including one of an image and a video;
detecting, by the processor, a potential object in the media for placing a placeholder, based on at least one of a semantic segmentation technique and an edge detection technique; and
determining, by the processor, a position of the placeholder to be placed in the object of the media, based on the detection of the object;
providing, by the processor, the placeholder being positioned in the media to a user, for feedback;
receiving, by the processor, the feedback of the user for the placeholder, wherein the feedback is indicative of one of an approval, a rejection, and a pending status of the placeholder;
generating, by the processor, a template indicating the placeholder in the media, wherein the template includes at least one of details pertaining to the media and details pertaining to the approved placeholder;
inserting, by the processor, content in the placeholder of the media indicated in the template, wherein dimensions of the content correspond to dimensions of the placeholder;
detecting, by the processor, when the media is the video, frames of the video having the placeholder, based on the details of the media and the approved placeholder indicated in the template;
classifying, by the processor, the frames into frames with placeholders and frames without placeholders, based on the detection; and
rendering, by the processor, upon receiving a request for watching the media, the media having the content displayed therein, based on at least one of a storage capacity and a processing power, wherein the rendering includes:
in response to determining that a remote player for playing the media allows the media to be played in two or more pieces,
providing portions of the media having the frames without the placeholders, and
rendering portions of the media having the frames with the placeholders while the portions of the media having the frames without the placeholders are being simultaneously watched; and
in response to determining that the remote player allows the media to be played in one piece,
rendering portions of the media having the frames with the placeholders, and
providing the media having the frames without the placeholders and the frames with the placeholders, when the rendering is finished.

### Claim 17 (depends on 16)

The method of claim 16 further comprising:
detecting, by the processor, when the media is the video, a position of the placeholder in the media, based on the details pertaining to the placeholder indicated in the template;
cutting by the processor, portions of the media having the placeholder, from the media, based on the detection;
cropping, by the processor, the portions having the placeholder after cutting the portions from the media; and
rendering, by the processor, upon receiving a request for watching the media, the cropped portions of the media having the placeholder to the user, wherein the rendering includes:
in response to determining that the remote player for playing the media allows portions of the media without the placeholder,
providing portions of the media without the placeholder, and
rendering the cropped portions of the media having the placeholder while the portions of the media without the placeholders are being simultaneously watched, based on the details pertaining to the placeholder indicated in the template; and
when the remote player allows the media to be played in one piece,
rendering portions of the media with the placeholders, and
providing the media having the portions without the placeholder and the portions with the placeholder, when the rendering is finished.

### Claim 18 (depends on 16)

The method of claim 16 further comprising:
receiving, by the processor, information pertaining to specification of a remote machine being used to watch the media;
determining, by the processor, whether the remote machine is compatible to render the media, based on the specification of the remote machine;
providing, by the processor, the media, the content, and the template to the remote machine; and
integrating, by the processor, the content with each frame of the media, based on the template, while portions of the media without the placeholder are already being played by the remote machine.