# US 2019/0356965 A1 · Service signaling recovery for multimedia content using embedded watermarks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356965 A1
- Document ID: US20190356965A1
- Status: Published application
- Kind: A1
- Application number: 16/397,288
- Filed: 2019-04-29
- Published: 2019-11-21
- Earliest claimed: 2014-12-18
- Assignees: Verance Corporation
- Applicants: Verance Corporation
- Inventors: Joseph M. Winograd; Rade Petrovic; Jian Zhao
- Web page: https://patentgrep.com/patent/US20190356965A1

## CPC

- H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)}
- G06F 16/7837: {using objects detected or recognised in the video content}
- H04N 21/23892: {involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level}
- H04N 21/262: Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists {(scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62)}
- H04N 21/26291: {for providing content or additional data updates, e.g. updating software modules, stored at the client (deployment, distribution, installation, update of software G06F8/65; error detection or correction during software upgrading G06F11/1433; arrangements for updating broadcast information or broadcast-related information H04H60/25)}
- H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)}
- H04N 21/4722: for requesting additional data associated with the content
- H04N 21/8586: {by using a URL (processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02)}
- H04N 21/4627: Rights management {associated to the content (security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, devices, systems and computer program products facilitate accessing metadata associated with a primary audio visual content. Upon reception of a primary content, one or more watermark messages are extracted from the primary content obtain a server code and an interval code. A query to a metadata server is initiated based on the information obtained from the extracted watermark messages. In response to the query, service recovery information is received that includes information identifying one or more timed events, where each timed event identifies an operation to be performed at a corresponding instance in time as the primary content is being presented by the receiver device. One or more operations identified the timed events are initiated at the corresponding instance(s) in time.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method for presentation of an advertisement associated with a primary content, comprising:
receiving the primary content at a receiver device, the receiver device including a watermark client and a watermark detector that are coupled to one another;
extracting one or more watermark messages from the primary content using the watermark detector that is implemented at least partially in hardware, the one or more extracted watermark messages including information that enables identification of at least one interval of the primary content;
using the information extracted from the one or more watermark messages to obtain advertisement signaling information that includes timing information of one or more advertisements associated with the primary content;
based on the advertisement signaling information, initiating a timer request by the watermark client, the timer request specifying a particular time instance at which the watermark client is to be notified by the watermark detector;
receiving, at the watermark client, a timer event notification from the watermark detector indicating that the particular time instance has been reached; and
in response to receiving the timer event notification at the watermark detector, initiating presentation of a particular advertisement at the particular time instance.

### Claim 22 (depends on 21)

The method of claim 21, wherein the receiver device includes a program player, an advertisement player and a switcher, and initiating presentation of the particular advertisement comprises using the switcher to route the output of the advertisement player to an output of the receiver device.

### Claim 23 (depends on 21)

The method of claim 21, wherein the receiver device is one of a home gateway or a streaming server that receives the primary content, the advertisement signaling information and the particular advertisement's content, and transmits the primary program in addition to the particular advertisement's content to a client device for presentation.

### Claim 24 (depends on 21)

The method of claim 21, wherein
the information extracted from the one or more watermark messages includes a server code and an interval code that enables identification of a metadata server, and the method comprises initiating a query to the metadata server using the information extracted from the one or more watermark messages to obtain advertising signaling information.

### Claim 25 (depends on 24)

The method of claim 24, wherein
the query is initiated upon a determination that at least the server code differs from a previously extracted server code.

### Claim 26 (depends on 24)

The method of claim 24, wherein the query is initiated upon a detection of a channel change of the primary program.

### Claim 27 (depends on 21)

The method of claim 21, wherein an insertion point of the particular advertisement is specified by (n×L)+m/r, where n is a start location of a last complete watermark message prior to the insertion point of the particular advertisement, L is duration of each of the one or more watermark messages, m is a number of samples between an end location of watermark n and the insertion point of the particular advertisement, and r is a sample rate of the primary content.

### Claim 28 (depends on 21)

The method of claim 21, wherein during the presentation of the particular advertisement, the presentation of the particular advertisement is halted upon detection of a change to a different primary program at the receiver device.

### Claim 29 (depends on 28)

The method of claim 28, further comprising presenting the different primary program at the receiver device.

### Claim 30 (depends on 21)

The method of claim 21, wherein after initiating the timer request and prior to the presentation of the particular advertisement, the presentation of the particular advertisement is not initiated upon detection of a change to different primary program at the receiver device.

### Claim 31 (depends on 21)

The method of claim 21, further comprising conducting watermark detection operations continuously to detect additional watermark messages to update service signaling information.

### Claim 32 (depends on 31)

The method of claim 31, wherein the additional watermark messages are used for one or more of the following:
(a) launching interactive service associated with the ads [0201];
(c) upon completion of the presentation of the particular advertisement, initiate termination of an interactive service associated with the primary program [0201];
(e) terminating a service earlier than scheduled;
(f) terminating one service and starting another service; or
(g) resuming a service after end of another service. [Par. 190 of US 2017/0251282]

### Claim 33 (depends on 21)

The method of claim 21, further comprising detecting an additional watermark message from the primary program that includes a flag indicative of an early termination of the particular advertisement and terminating presentation of the particular advertisement in response thereto.

### Claim 34 (depends on 33)

The method of claim 33, further comprising providing a signal to a switcher to immediately route an output of a program player to an output of the receiver device.

### Claim 35

A method for presentation of an advertisement associated with a content, comprising:
receiving content from a distribution source;
presenting the received content to a viewer;
receiving advertisement signaling information associated with the received content from a server;
detecting timing data based on the received content;
based on the timing data detected in the received content and the advertisement signaling information, providing exact insertion point information of the replaceable advertisement in the content to a switcher; and
using the switcher to switch from the presentation of the replaceable advertisement in the content to initiate presentation of a replacement advertisement at an insertion point in the content.

### Claim 36 (depends on 35)

The method of claim 35, wherein the advertisement signaling information includes timing information of a replaceable advertisement in the content.

### Claim 37

A method for presentation of an advertisement associated with a content, comprising:
receiving content from a distribution source;
presenting the received content to a viewer;
receiving advertisement signaling information associated with the received content from a server;
detecting a watermark from the received content;
based on timing data detected in the watermark and the advertisement signaling information, providing exact insertion point information of the replaceable advertisement in the content to a switcher; and
using the switcher to switch from the presentation of the replaceable advertisement in the content to initiate presentation of a replacement advertisement at an insertion point in the content.

### Claim 38 (depends on 37)

The method of claim 37, wherein the advertisement signaling information includes timing information of a replaceable advertisement in the content.

### Claim 39

A device capable of presenting an advertisement associated with a primary content, comprising:
a processor; and
a memory comprising instructions included therein, wherein upon execution of the instructions by the processor, the device is configured to:
receive the primary content at the device, the device including a watermark client and a watermark detector that are coupled to one another;
extract one or more watermark messages from the primary content using the watermark detector, the one or more extracted watermark messages including information that enables identification of at least one interval of the primary content;
use the information extracted from the one or more watermark messages to obtain advertisement signaling information that includes timing information of one or more advertisements associated with the primary content;
based on the advertisement signaling information, initiate a timer request by the watermark client, the timer request specifying a particular time instance at which the watermark client is to be notified by the watermark detector;
receive, at the watermark client, a timer event notification from the watermark detector indicating that the particular time instance has been reached; and
in response to receiving the timer event notification at the watermark detector, initiate presentation of a particular advertisement at the particular time instance.

### Claim 40 (depends on 39)

The device of claim 39, including a program player, an advertisement player and a switcher, wherein upon execution of the instructions by the processor, the device is configured to initiate presentation of the particular advertisement by instructing the switcher to route the output of the advertisement player to an output of the device.
