# US 2022/0284729 A1 · Content-Modification System with Fingerprint Data Match and Mismatch Detection Feature

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284729 A1
- Document ID: US20220284729A1
- Status: Published application
- Kind: A1
- Application number: 17/825,465
- Filed: 2022-05-26
- Published: 2022-09-08
- Earliest claimed: 2019-05-10
- Assignees: Roku, Inc.
- Applicants: Roku, Inc.
- Inventors: David Edward Armstrong; Andrew Laurence Ashbacher; John L. Haynes
- Web page: https://patentgrep.com/patent/US20220284729A1

## CPC

- G06V 40/1365: {Matching; Classification}
- G06F 16/535: Filtering based on additional data, e.g. user or group profiles
- G06F 16/583: using metadata automatically derived from the content
- G06V 40/40: Spoof detection, e.g. liveness detection
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In one aspect, a method includes receiving a first portion of query fingerprint data representing content transmitted by a content-distribution system. The method also includes detecting a match between the first portion of the query fingerprint data and a first portion of reference fingerprint data representing a modifiable content-segment. The method also includes after detecting the match: (i) receiving a second portion of the query fingerprint data, wherein the second portion of the query fingerprint data is different from the first portion of the query fingerprint data; and (ii) detecting a mismatch between the second portion of the query fingerprint data and a second portion of the reference fingerprint data representing the modifiable content-segment, wherein the second portion of the reference fingerprint data is different from the first portion of the reference fingerprint data. The method also includes responsive to detecting the mismatch, performing an action.

## Claims

### Claim 1

A method comprising:
receiving, from a content-distribution system, a first portion of query fingerprint data representing a content segment of a linear sequence of content segments transmitted by the content-distribution system and received by a content-presentation device;
detecting a match between the first portion of the query fingerprint data and a first portion of reference fingerprint data representing a modifiable content-segment;
after detecting the match: (i) receiving, from the content-distribution system, a second portion of the query fingerprint data representing the content segment, wherein the second portion of the query fingerprint data is different from the first portion of the query fingerprint data; and
(ii) detecting a mismatch between the second portion of the query fingerprint data and a second portion of the reference fingerprint data representing the modifiable content-segment, wherein the second portion of the reference fingerprint data is different from the first portion of the reference fingerprint data; and
responsive to detecting the mismatch, performing an action that causes the content-presentation device to abort performance of a remaining portion of a partially-performed content-modification operation, such that the content-presentation device stops modifying the content segment.

### Claim 2 (depends on 1)

The method of claim 1, wherein the query fingerprint data is generated by the content-distribution system before the content-presentation device receives the content segment.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
responsive to detecting the mismatch, removing from memory a preexisting stored mapping of an identifier of the modifiable content-segment to the first portion of the query fingerprint data.

### Claim 4 (depends on 1)

The method of claim 1, wherein performing the action that causes the content-presentation device to abort performance of the remaining portion of the partially-performed content-modification operation comprises transmitting, to the content-presentation device, an instruction for the content-presentation device to not perform a remaining portion of the partially-performed content-modification operation

### Claim 5 (depends on 1)

The method of claim 1, wherein the second portion of the query fingerprint data represents a second portion of the content transmitted by the content-distribution system to the content-presentation device, and wherein the second portion of the content immediately succeeds the first portion of the content.

### Claim 6 (depends on 1)

The method of claim 1, wherein the second portion of the query fingerprint data represents a second portion of the content transmitted by the content-distribution system to the content-presentation device, and wherein the second portion of the content succeeds the first portion of the content, but does not immediately succeed the first portion.

### Claim 7 (depends on 1)

The method of claim 1, wherein the method is performed by a fingerprint-matching server of a content-modification system.

### Claim 8

A non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by a processor, cause performance of a set of operations comprising:
receiving, from a content-distribution system, a first portion of query fingerprint data representing a content segment of a linear sequence of content segments transmitted by the content-distribution system and received by a content-presentation device;
detecting a match between the first portion of the query fingerprint data and a first portion of reference fingerprint data representing a modifiable content-segment;
after detecting the match: (i) receiving, from the content-distribution system, a second portion of the query fingerprint data representing the content segment, wherein the second portion of the query fingerprint data is different from the first portion of the query fingerprint data; and (ii) detecting a mismatch between the second portion of the query fingerprint data and a second portion of the reference fingerprint data representing the modifiable content-segment, wherein the second portion of the reference fingerprint data is different from the first portion of the reference fingerprint data; and
responsive to detecting the mismatch, performing an action that causes the content-presentation device to abort performance of a remaining portion of a partially-performed content-modification operation, such that the content-presentation device stops modifying the content segment.

### Claim 9 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, wherein the query fingerprint data is generated by the content-distribution system before the content-presentation device receives the content segment.

### Claim 10 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, the set of operations further comprising:
responsive to detecting the mismatch, removing from memory a preexisting stored mapping of an identifier of the modifiable content-segment to the first portion of the query fingerprint data.

### Claim 11 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, wherein performing the action that causes the content-presentation device to abort performance of the remaining portion of the partially-performed content-modification operation comprises transmitting, to the content-presentation device, an instruction for the content-presentation device to not perform a remaining portion of the partially-performed content-modification operation

### Claim 12 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, wherein the second portion of the query fingerprint data represents a second portion of the content transmitted by the content-distribution system to the content-presentation device, and wherein the second portion of the content immediately succeeds the first portion of the content.

### Claim 13 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, wherein the second portion of the query fingerprint data represents a second portion of the content transmitted by the content-distribution system to the content-presentation device, and wherein the second portion of the content succeeds the first portion of the content, but does not immediately succeed the first portion.

### Claim 14

A computing system comprising:
a processor; and
a non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by the processor, cause performance of a set of operations comprising:
receiving, from a content-distribution system, a first portion of query fingerprint data representing a content segment of a linear sequence of content segments transmitted by the content-distribution system and received by a content-presentation device;
detecting a match between the first portion of the query fingerprint data and a first portion of reference fingerprint data representing a modifiable content-segment;
after detecting the match: (i) receiving, from the content-distribution system, a second portion of the query fingerprint data representing the content segment, wherein the second portion of the query fingerprint data is different from the first portion of the query fingerprint data; and (ii) detecting a mismatch between the second portion of the query fingerprint data and a second portion of the reference fingerprint data representing the modifiable content-segment, wherein the second portion of the reference fingerprint data is different from the first portion of the reference fingerprint data; and
responsive to detecting the mismatch, performing an action that causes the content-presentation device to abort performance of a remaining portion of a partially-performed content-modification operation, such that the content-presentation device stops modifying the content segment.

### Claim 15 (depends on 14)

The computing system of claim 14, wherein the query fingerprint data is generated by the content-distribution system before the content-presentation device receives the content segment.

### Claim 16 (depends on 14)

The computing system of claim 14, the set of operations further comprising:
responsive to detecting the mismatch, removing from memory a preexisting stored mapping of an identifier of the modifiable content-segment to the first portion of the query fingerprint data.

### Claim 17 (depends on 14)

The computing system of claim 14, wherein performing the action that causes the content-presentation device to abort performance of the remaining portion of the partially-performed content-modification operation comprises transmitting, to the content-presentation device, an instruction for the content-presentation device to not perform a remaining portion of the partially-performed content-modification operation

### Claim 18 (depends on 14)

The computing system of claim 14, wherein the second portion of the query fingerprint data represents a second portion of the content transmitted by the content-distribution system to the content-presentation device, and wherein the second portion of the content immediately succeeds the first portion of the content.

### Claim 19 (depends on 14)

The computing system of claim 14, wherein the second portion of the query fingerprint data represents a second portion of the content transmitted by the content-distribution system to the content-presentation device, and wherein the second portion of the content succeeds the first portion of the content, but does not immediately succeed the first portion.

### Claim 20 (depends on 14)

The computing system of claim 14, wherein the computing system is a fingerprint-matching server of a content-modification system.
