# US 2021/0344981 A1 · Dynamic watermarking of media based on transport-stream metadata, to facilitate action by downstream entity

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344981 A1
- Document ID: US20210344981A1
- Status: Published application
- Kind: A1
- Application number: 17/305,759
- Filed: 2021-07-14
- Published: 2021-11-04
- Earliest claimed: 2020-02-06
- Assignees: The Nielsen Company (US), LLC
- Applicants: The Nielsen Company (US), LLC
- Inventors: Shashank C. Merchant; Benjamin J. Ropke; John S. Stavropoulos
- Web page: https://patentgrep.com/patent/US20210344981A1

## CPC

- H04N 21/23892: {involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level}
- H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/23614: {Multiplexing of additional data and video streams (arrangements for simultaneous broadcast of plural pieces of information H04H20/28)}
- H04N 21/4305: {Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets (arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083)}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N 21/8545: for generating interactive applications
- H04N 21/8547: involving timestamps for synchronizing content
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method and system for dynamically watermarking media content based on transport-stream metadata, to facilitate action by a downstream entity. An intermediary in a media-distribution path could receive a transport stream carrying media content and carrying metadata that is not watermarked in the media content. The intermediary could then obtain from the transport stream the metadata that is not watermarked in the media content and could modify the media content at least by encoding into the media content a watermark that represents the obtained metadata. And the intermediary could then output at least the modified media content for transmission to a downstream entity. The downstream entity could thus obtain from the watermark in the media content the metadata and could use the metadata to facilitate carrying out one or more useful actions.

## Claims

### Claim 1

A method comprising:
receiving, into a computing system, a packet-based transport stream carrying a media stream that defines media content and carrying metadata that is not watermarked in the media stream, wherein the metadata specifies a splice time point in the media stream as a time-offset value measured from a point in the media stream where the metadata is carried;
obtaining, by the computing system, from the transport stream, the metadata that is not watermarked in the media stream, wherein obtaining the metadata from the transport stream comprises obtaining the specified splice time point from the transport stream;
computing, by the computing system, an absolute time point in the media stream, based on the obtained splice time point;
modifying, by the computing system, the media stream by at least (i) encoding in a watermark in the media stream the computed absolute time point and (ii) encoding at a specific time point in the media stream a timestamp of the specific time point, whereby the timestamp is usable by a downstream entity as a basis to establish synchronous lock in order to map the absolute time to time according to a clock of the downstream entity; and
outputting from the computing system, for transmission to the downstream entity, at least the modified media stream.

### Claim 2 (depends on 1)

The method of claim 1, wherein encoding the timestamp of the specific point is in the watermark.

### Claim 3 (depends on 1)

The method of claim 1, wherein the splice time point defines when in the media stream a dynamic content revision should be performed.

### Claim 4 (depends on 3)

The method of claim 3, wherein the dynamic content revision comprises dynamic ad insertion.

### Claim 5 (depends on 1)

The method of claim 1, wherein the media stream defines a sequence of frames, and wherein the absolute time point is a timestamp of one of the frames.

### Claim 6 (depends on 1)

The method of claim 1, wherein the metadata further indicates a duration of a dynamic content revision that should be performed as to the media stream, and wherein the watermark also represents the indicated duration.

### Claim 7 (depends on 1)

The method of claim 1, wherein the metadata further indicates of a type of content revision to apply with respect to the media stream, and wherein the watermark also represents the indicated type of content revision, wherein the type of content revision is selected from the group consisting of a splice-in and a splice-out.

### Claim 8 (depends on 1)

The method of claim 1, wherein the metadata further comprises information for obtaining replacement content to replace a portion of the media stream, and wherein the watermark also represents the information.

### Claim 9 (depends on 1)

The method of claim 1, wherein the metadata further comprises media-content identification information to facilitate media-consumption reporting, and wherein the watermark also represents the media-content identification information.

### Claim 10 (depends on 1)

The method of claim 1, wherein the watermark defines a trigger for the downstream entity to engage in revision of the media stream.

### Claim 11

A computing system comprising:
one or more communication interfaces through which to receive a packet-based transport stream carrying a media stream and through which to output along a media-distribution path at least a modified version of the media stream for transmission to a downstream entity;
a processing unit;
non-transitory data storage; and
program instructions stored in the non-transitory data storage and executable by the processing unit to carry out operations including:
obtaining, from the transport stream, metadata that is carried by the transport stream and that is not watermarked in the media stream, wherein the metadata specifies a splice time point in the media stream as a time-offset value measured from a point in the media stream where the metadata is carried, wherein obtaining the metadata from the transport stream comprises obtaining the specified splice time point from the transport stream;
computing an absolute time point in the media stream, based on the obtained splice time point,
generating the modified version of the media stream by at least (i) encoding in a watermark in the media stream the computed absolute time point and (ii) encoding at a specific time point in the media stream a timestamp of the specific time point, whereby the timestamp is usable by the downstream entity as a basis to establish synchronous lock in order to map the absolute time to time according to a clock of the downstream entity, and
outputting, for transmission along the media-distribution path to the downstream entity, the modified version of the media stream.

### Claim 12 (depends on 11)

The computing system of claim 11, wherein encoding the timestamp of the specific point is in the watermark.

### Claim 13 (depends on 11)

The computing system of claim 11, wherein the media-distribution path extends at least from a content source to the downstream entity, and wherein the computing system comprises an intermediary in the media-distribution path.

### Claim 14 (depends on 11)

The computing system of claim 11, wherein the splice time point defines when in the media stream a dynamic content revision should be performed.

### Claim 15 (depends on 14)

The computing system of claim 14, wherein the dynamic content revision comprises dynamic ad insertion.

### Claim 16 (depends on 11)

The computing system of claim 11, wherein the metadata further indicates a duration of a dynamic content revision that should be performed as to the media stream, and wherein the watermark also represents the indicated duration.

### Claim 17 (depends on 11)

The computing system of claim 11, wherein the metadata further indicates of a type of content revision to apply with respect to the media stream, and wherein the watermark also represents the indicated type of content revision, wherein the type of content revision is selected from the group consisting of a splice-in and a splice-out.

### Claim 18 (depends on 11)

The computing system of claim 11, wherein the metadata further comprises information for obtaining replacement content to replace a portion of the media stream, and wherein the watermark also represents the information.

### Claim 19

A non-transitory computer-readable medium embodying instructions executable by a computing system to carry out operations including:
receiving a packet-based transport stream carrying a media stream that defines media content and carrying metadata that is not watermarked in the media stream, wherein the metadata specifies a splice time point in the media stream as a time-offset value measured from a point in the media stream where the metadata is carried;
obtaining from the transport stream, the metadata that is not watermarked in the media stream, wherein obtaining the metadata from the transport stream comprises obtaining the specified splice time point from the transport stream;
computing an absolute time point in the media stream, based on the obtained splice time point;
modifying the media stream by at least (i) encoding in a watermark in the media stream the computed absolute time point and (ii) encoding at a specific time point in the media stream a timestamp of the specific time point, whereby the timestamp is usable by a downstream entity as a basis to establish synchronous lock in order to map the absolute time to time according to a clock of the downstream entity; and
outputting from the computing system, for transmission to the downstream entity, at least the modified media stream.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein encoding the timestamp of the specific point is in the watermark.
