# US 2023/0053886 A1 · Method to insert ad content into a video scene

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0053886 A1
- Document ID: US20230053886A1
- Status: Published application
- Kind: A1
- Application number: 17/893,213
- Filed: 2022-08-23
- Published: 2023-02-23
- Earliest claimed: 2017-07-07
- Assignees: Nagravision Sarl
- Applicants: Nagravision SàRl
- Inventors: Philippe Stransky-Heilkron
- Web page: https://patentgrep.com/patent/US20230053886A1

## CPC

- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 5/2723: {Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement (data processing systems or methods specially adapted for marketing G06Q30/02)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/2343: involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)}
- H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/4334: {Recording operations (recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/440245: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A post-processing of video content in order to provide a capability to insert ad content, having a method to produce a modified video content from an original video content. The method comprising: analyzing the original video content to detect at least one marker, said marker comprising a marker surface delimited by a marker identification; loading profile data of a target user; determining, based at least on the profile data a replacement content; adjusting the replacement content into the marker surface; and replacing into the original video content the marker surface by the adjusted replacement content to produce the modified video content.

## Claims

### Claim at position 1

1-11. (canceled)

### Claim 12

A computing device to produce a modified video content from an original video content, said computing device comprising:
at least one memory for storing the original video content;
at least one processor;
a marker detector module configured to detect, from the original video content, at least one marker, said marker comprising a marker surface surrounded by a marker identification, and to determine a marker value from the marker identification;
a management center configured to receive a request for the modified video content from a user of a client module, and to determine, based on the request and the marker value, a replacement content; and
a replacement module configured to replace the marker surface of the original video content with the replacement content to produce the modified video content.

### Claim 13 (depends on 12)

The computing device of claim 12, wherein the computing device is a server computer.

### Claim 14 (depends on 12)

The computing device of claim 12, wherein the replacement module is further configured to adjust the replacement content into the marker surface.

### Claim 15 (depends on 14)

The computing device of claim 14, wherein the replacement module is further configured to:
determine a shape of the marker surface;
compare the shape of the marker surface with a shape of the replacement content; and
apply a morphing function to the replacement content to keep a perspective ratio while adjusting the replacement content to correspond to the marker surface.

### Claim 16 (depends on 12)

The computing device of claim 12, wherein the marker identification exhibits a binary marker value that is decodable.

### Claim 17 (depends on 12)

The computing device of claim 12, wherein the marker identification is in a form of a dotted line exhibiting a marker value.

### Claim 18 (depends on 12)

The computing device of claim 12, wherein the request comprises a user's profile.

### Claim 19 (depends on 12)

The computing device of claim 12, wherein the computing device is further configured to:
transmit the modified content to a client module;
receive a snapshot of a current image of the modified content containing the replacement content from the client module;
receive an interaction of the user in reference with the modified content from the client module;
transmit the snapshot, the user's interaction, and a client identification to the management center;
detect the replacement content from the current image and the user's interaction; and
record, in a record related to the client identification, the interaction with the replacement content.

### Claim 20 (depends on 12)

The computing device of claim 12, wherein the marker value defines a marker category, said marker category being used to determine the replacement content.

### Claim 21 (depends on 12)

The computing device of claim 12, wherein the management center is further configured to:
receive, together with the request, a client identification; and
store in a record related to the client identification, the marker value and a reference of the replacement content.
