# US 10,484,758 B2 · Computing system with content-characteristic-based trigger feature

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,484,758 B2
- Document ID: US10484758B2
- Status: Granted
- Kind: B2
- Application number: 15/399,415
- Filed: 2017-01-05
- Published: 2017-07-06
- Granted: 2019-11-19
- Earliest claimed: 2016-01-05
- Assignees: Gracenote, Inc.
- Applicants: Gracenote, Inc.
- Inventors: Wilson Harron; Konstantinos Antonios Dimitriou
- Web page: https://patentgrep.com/patent/US10484758B2

## CPC

- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 20/48: {Matching video sequences}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/242: Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)}
- H04N 21/4383: {Accessing a communication channel}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4756: {for rating content, e.g. scoring a recommended movie}
- H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N 21/845: Structuring of content, e.g. decomposing content into time segments
- G06N 20/00: Machine learning
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

In one aspect, an example method includes (i) receiving, by a computing system, media content; (ii) generating, by the computing system, a fingerprint of a portion of the received media content; (iii) determining, by the computing system, that the received media content has a predefined characteristic; (iv) responsive to determining that the received media content has the predefined characteristic, transmitting, by the computing system, the generated fingerprint to a content identification server to identify the portion of the received media content; and (v) performing an action based on the identified portion of media content.

## Claims

### Claim 1

A method comprising:
receiving, by a computing system, media content, wherein the media content comprises a first portion and a second portion, wherein the computing system receives the first portion before receiving the second portion;
generating, by the computing system, a fingerprint of the second portion of the received media content;
determining, by the computing system, that the first portion of the received media content includes a threshold extent of non-substantive media content;
responsive to determining that the first portion of the received media content includes the threshold extent of non-substantive media content, transmitting, by the computing system, the generated fingerprint to a content identification server to identify the second portion of the received media content; and
performing an action that relates to the identified second portion of media content.

### Claim 2 (depends on 1)

The method of claim 1, wherein the computing system is a media presentation device, wherein the media presentation device is connected to a receiver, wherein receiving the media content comprises receiving the media content from the receiver.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining that the first portion of the received media content includes the threshold extent of non-substantive media content comprises determining that the first portion and the second portion lack a threshold extent of similarity with each other.

### Claim 4 (depends on 3)

The method of claim 3, wherein (i) the first portion is a program segment and the second portion is a commercial, (ii) the first portion is a first commercial and the second portion is a second commercial that is different from the first commercial, (iii) the first portion is a commercial and the second portion is a program segment, or (iv) the first portion is a first program segment and the second portion is a second program segment that is different from the first program segment.

### Claim 5 (depends on 3)

The method of claim 3, wherein the fingerprint is a second fingerprint, the method further comprising:
generating, by the computing system, a first fingerprint of the first portion, wherein determining that the first portion and the second portion lack a threshold extent of similarity with each other comprises determining that the generated first fingerprint and the generated second fingerprint lack a threshold extent of similarity with each other.

### Claim 6 (depends on 3)

The method of claim 3, wherein determining that the first portion and the second portion lack a threshold extent of similarity with each other comprises using a trained classifier to determine that the first portion and the second portion lack a threshold extent of similarity with each other.

### Claim 7 (depends on 1)

The method of claim 1, wherein the media content is video content and wherein determining that the first portion of the received media content includes the threshold extent of non-substantive media content comprises determining that the first portion includes a threshold extent of substantially black video content.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining that the first portion of the received media content includes the threshold extent of non-substantive media content comprises using a trained classifier to determine that the first portion includes the threshold extent of non-substantive media content.

### Claim 9 (depends on 1)

The method of claim 1, wherein generating the fingerprint of the second portion of the received media content occurs responsive to determining that the first portion of the received media content includes the threshold extent of non-substantive media content.

### Claim 10 (depends on 1)

The method of claim 1, wherein generating the fingerprint of the second portion of the received media content and transmitting the generated fingerprint to the content identification server to identify the second portion of the received media content both occur proximate a time of the determining that the first portion of the received media content includes the threshold extent of non-substantive media content.

### Claim 11 (depends on 1)

The method of claim 1, wherein the computing system is a media presentation device, the method further comprising:
presenting, by the media presentation device, via a user interface of the media presentation device, the second portion of media content, and wherein performing the action that relates to the identified second portion of media content comprises causing supplemental content to be presented in conjunction with the second portion of media content being presented by the media presentation device.

### Claim 12 (depends on 1)

The method of claim 1, wherein performing the action that relates to the identified second portion of media content comprises recording presentation of the identified second portion of media content for use in a media content ratings system.

### Claim 13 (depends on 1)

The method of claim 1, wherein the media content is video content.

### Claim 14

A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:
receiving, by a computing system, media content, wherein the media content comprises a first portion and a second portion, wherein the computing system receives the first portion before receiving the second portion;
generating, by the computing system, a fingerprint of the second portion of the received media content;
determining, by the computing system, that the first portion of the received media content includes a threshold extent of non-substantive media content;
responsive to determining that the first portion of the received media content includes the threshold extent of non-substantive media content, transmitting, by the computing system, the generated fingerprint to a content identification server to identify the second portion of the received media content; and
performing an action that relates to the identified second portion of media content.

### Claim 15 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the computing system is a media presentation device, wherein the media presentation device is connected to a receiver, wherein receiving the media content comprises receiving the media content from the receiver.

### Claim 16 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein determining that the first portion of the received media content includes the threshold extent of non-substantive media content determining that the first portion and the second portion lack a threshold extent of similarity with each other.

### Claim 17 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the computing system is a media presentation device, the set of acts further comprising:
presenting, by the media presentation device, via a user interface of the media presentation device, the second portion of media content, and wherein performing the action that relates to the identified second portion of media content comprises causing supplemental content to be presented in conjunction with the second portion of media content being presented by the media presentation device.

### Claim 18

A computing system comprising:
a communication interface;
a processor; and
a non-transitory computer-readable medium having stored thereon program instructions that upon execution by the processor, cause performance of a set of acts comprising:
receiving, via the communication interface, media content, wherein the media content comprises a first portion and a second portion, wherein the computing system receives the first portion before receiving the second portion;
generating a fingerprint of the second portion of the received media content;
determining that the first portion of the received media content includes a threshold extent of non-substantive media content;
responsive to determining that the first portion of the received media content includes the threshold extent of non-substantive media content, transmitting the generated fingerprint to a content identification server to identify the second portion of the received media content; and
performing an action that relates to the identified second portion of media content.
