# US 2020/0404348 A1 · Use of Steganographically-Encoded Data as Basis to Disambiguate Fingerprint-Based Channel-Multi-Match

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404348 A1
- Document ID: US20200404348A1
- Status: Published application
- Kind: A1
- Application number: 15/929,217
- Filed: 2020-02-06
- Published: 2020-12-24
- Earliest claimed: 2019-06-18
- Assignees: The Nielsen Company (US), LLC
- Applicants: The Nielsen Company (US), LLC
- Inventors: Shashank C. Merchant; Andrew L. Ashbacher
- Web page: https://patentgrep.com/patent/US20200404348A1

## CPC

- H04N 21/23892: {involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level}
- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
- H04N 21/44204: {Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched (monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31)}
- H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The disclosure provides for use of steganographically-encoded data as a basis to disambiguated a fingerprint-based channel-multimatch. A fingerprint-matching server or other entity could detect a channel-multi-match scenario by determining that query fingerprints representing media content being rendered by a content presentation device match reference fingerprints respectively representing multiple channels. In view of that detected channel-multi-match scenario, the content presentation device could then provide channel-identification information that the content presentation device extracts from a watermark that is steganographically encoded in the media content of the channel that the content presentation device is rendering, for use of the extracted channel-identification information to determine which channel the content presentation device is rendering. Identifying the channel being rendered could then facilitate channel-specific action, such as then detecting a content-modification opportunity on the identified channel and preparing and enabling the content presentation device to carry out an associated content modification.

## Claims

### Claim 1

A method comprising:
detecting a fingerprint-based channel-multi-match with respect to a channel of media content being rendered by a content presentation device; and
responsive to the detecting of the fingerprint-based channel-multi-match, using channel-identification information extracted from a watermark encoded in the media content as a basis to determine which channel the content presentation device is rendering.

### Claim 2 (depends on 1)

The method of claim 1, further comprising, based on the determining of which channel the content presentation device is rendering, causing the content presentation device to carry out a content modification in the determined channel.

### Claim 3 (depends on 2)

The method of claim 2, wherein the content modification comprise dynamic ad insertion.

### Claim 4 (depends on 1)

The method of claim 1,
wherein the channel of media content being rendered by the content presentation device comprises a video component and an audio component,
wherein the fingerprint-based channel-multi-match is with respect to the video component of the channel, and
wherein the channel-identification information is extracted from an audio watermark encoded in the media content.

### Claim 5 (depends on 1)

The method of claim 1, wherein the channel-identification information is extracted by the content presentation device from the watermark encoded in the media content.

### Claim 6 (depends on 1)

The method of claim 1, wherein the method is carried out by an entity other than the content presentation device, the method further comprising:
requesting and receiving from the content presentation device the channel-identification information extracted from the watermark encoded in the media content.

### Claim 7

A method comprising:
generating by a content presentation device query fingerprints representing a channel of media content being rendered by the content presentation device, and transmitting by the content presentation device the generated query fingerprints to a server;
receiving by the content presentation device from the server, based on the server having detected that the query fingerprints match reference fingerprints respectively representing multiple channels, a request for channel-identification information extracted from steganographic encoding in the channel of media content being rendered by the content presentation device;
responsive to the request, transmitting by the content presentation device to the server the channel-identification information extracted from the steganographic encoding in the channel of media content being rendered by the content presentation device, for use by the server to determine which of the multiple channels the content presentation device is rendering.

### Claim 8 (depends on 7)

The method of claim 7, wherein the steganographic encoding in the channel of media content comprises a watermark in the channel of media content.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
responsive to the request, decoding by the content presentation device the watermark, and determining by the content presentation device, from the decoded watermark, the channel-identification information to transmit to the server.

### Claim 10 (depends on 8)

The method of claim 8,
wherein the channel of media content being rendered by the content presentation device comprises a video component and an audio component,
wherein the detecting that the query fingerprints match the reference fingerprints respectively representing multiple channels is with respect to video, and
wherein the watermark is an audio watermark.

### Claim 11

A method comprising:
detecting, by a computing system, that query fingerprints of media content being rendered by a content presentation device match reference fingerprints respectively of multiple channels;
responsive to detecting that the query fingerprints of the media content being rendered by the content presentation device match the reference fingerprints respectively of the multiple channels, performing disambiguation based at least in part on channel-identification information that is steganographically encoded in the media content being rendered by the content presentation device, the disambiguation identifying which of the multiple channels the content presentation device is rendering; and
taking action based on the identifying of the channel.

### Claim 12 (depends on 11)

The method of claim 11, wherein the computing system is an entity other than the content presentation device, and wherein the query fingerprints of the media content being rendered by the content presentation device are generated by the content presentation device, the method further comprising:
receiving by the computing system, from the content presentation device, the query fingerprints of media content being rendered by the content presentation device.

### Claim 13 (depends on 11)

The method of claim 11, further comprising receiving by the computing system the reference fingerprints from one or more content distribution systems.

### Claim 14 (depends on 11)

The method of claim 11, wherein performing the disambiguation based at least in part on the channel-identification information that is steganographically encoded in the media content being rendered by the content presentation device comprises:
causing the content presentation device to report the channel-identification information that is steganographically encoded in the media content being rendered by the content presentation device.

### Claim 15 (depends on 14)

The method of claim 14, wherein causing the content presentation device to report the channel-identification information that is steganographically encoded in the media content being rendered by the content presentation device comprises:
transmitting to the content presentation device a request that causes the content presentation device to decode and report the steganographically encoded channel-identification.

### Claim 16 (depends on 11)

The method of claim 11, wherein the channel-identification information is watermark encoded in the media content.

### Claim 17 (depends on 11)

The method of claim 11,
wherein the media content being rendered by the content presentation device comprises a video component and an audio component,
wherein the query fingerprints and reference fingerprints both represent video, and
wherein the channel-identification information is steganographically encoded in the audio component of the media content being rendered by the content presentation device.

### Claim 18 (depends on 11)

The method of claim 11, wherein taking the action based on the identified channel comprises:
detecting a content-modification opportunity in the identified channel based on a comparison of reference fingerprints of the identified channel with fingerprints of a modifiable-content segment; and
responsive to detecting the content-modification opportunity in the identified channel, enabling and preparing the content presentation device to carry out a content modification with respect to the detected content-modification opportunity.

### Claim 19 (depends on 18)

The method of claim 18, wherein the modifiable-content segment is a replaceable advertisement, and wherein the content modification is playout of a replacement advertisement in place of the replaceable advertisement.

### Claim 20 (depends on 11)

The method of claim 11, wherein taking the action based on the identified channel comprises reporting presentation of the identified channel for use in a channel ratings system.
