# US 2022/0286737 A1 · Separating Media Content into Program Segments and Advertisement Segments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0286737 A1
- Document ID: US20220286737A1
- Status: Published application
- Kind: A1
- Application number: 17/496,297
- Filed: 2021-10-07
- Published: 2022-09-08
- Earliest claimed: 2021-03-05
- Assignees: Gracenote, Inc.
- Applicants: Gracenote, Inc.
- Inventors: Todd J. Hodges; Andreas Schmidt; Sharmishtha Gupta
- Web page: https://patentgrep.com/patent/US20220286737A1

## CPC

- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- H04N 21/482: End-user interface for programme selection
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)}
- H04N 21/8541: involving branching, e.g. to different story endings
- H04N 21/4884: {for displaying subtitles}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

In one aspect, an example method includes (i) extracting, by a computing system, features from media content; (ii) generating, by the computing system, repetition data for respective portions of the media content using the features, with repetition data for a given portion including a list of other portions of the media content matching the given portion; (iii) determining, by the computing system, transition data for the media content; (iv) selecting, by the computing system, a portion within the media content using the transition data; (v) classifying, by the computing system, the portion as either an advertisement segment or a program segment using repetition data for the portion; and (vi) outputting, by the computing system, data indicating a result of the classifying for the portion.

## Claims

### Claim 1

A method comprising:
extracting, by a computing system, features from media content;
generating, by the computing system, repetition data for respective portions of the media content using the features, wherein repetition data for a given portion comprises a list of other portions of the media content matching the given portion;
determining, by the computing system, transition data for the media content;
selecting, by the computing system, a portion within the media content using the transition data;
classifying, by the computing system, the portion as either an advertisement segment or a program segment using repetition data for the portion; and
outputting, by the computing system, data indicating a result of the classifying for the portion.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
extracting the features comprises extracting fingerprints, and
generating the repetition data comprises generating the repetition data using the fingerprints.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
extracting the features comprises extracting closed captioning, and
generating the repetition data comprises generating the repetition data using the closed captioning.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
extracting the features comprises extracting keyframes, and
generating the repetition data comprises:
identifying a portion between two adjacent keyframes of the keyframes; and
searching for other portions within the media content having features matching features for the portion.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
the transition data comprises predicted transitions between different content segments, and
selecting the portion comprises selecting a portion between two adjacent predicted transitions of the predicted transitions.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
classifying the portion comprises classifying the portion as a program segment,
the method further comprises determining that the portion classified as a program segment corresponds to a program specified in an electronic program guide using a timestamp of the portion, and
the data indicating the result of the classifying comprises a data file for the program that includes an indication of the portion.

### Claim 7 (depends on 1)

The method of claim 1, wherein:
classifying the portion comprises classifying the portion as an advertisement segment,
the features comprises metadata for the portion, and
the data indicating the result of the classifying comprises a data file that includes the metadata and an indication of the portion.

### Claim 8

A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:
extracting features from media content;
generating repetition data for respective portions of the media content using the features, wherein repetition data for a given portion comprises a list of other portions of the media content matching the given portion;
determining transition data for the media content;
selecting a portion within the media content using the transition data;
classifying the portion as either an advertisement segment or a program segment using repetition data for the portion; and
outputting data indicating a result of the classifying for the portion.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein:
extracting the features comprises extracting fingerprints, and
generating the repetition data comprises generating the repetition data using the fingerprints.

### Claim 10 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein:
extracting the features comprises extracting closed captioning, and
generating the repetition data comprises generating the repetition data using the closed captioning.

### Claim 11 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein:
extracting the features comprises extracting keyframes, and
generating the repetition data comprises:
identifying a portion between two adjacent keyframes of the keyframes; and
searching for other portions within the media content having features matching features for the portion.

### Claim 12 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein:
classifying the portion comprises classifying the portion as a program segment,
the set of acts further comprises determining that the portion classified as a program segment corresponds to a program specified in an electronic program guide using a timestamp of the portion, and
the data indicating the result of the classifying comprises a data file for the program that includes an indication of the portion.

### Claim 13 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein:
classifying the portion comprises classifying the portion as an advertisement segment,
the features comprises metadata for the portion, and
the data indicating the result of the classifying comprises a data file that includes the metadata and an indication of the portion.

### Claim 14

A computing system configured for performing a set of acts comprising:
extracting features from media content;
generating repetition data for respective portions of the media content using the features, wherein repetition data for a given portion comprises a list of other portions of the media content matching the given portion;
determining transition data for the media content;
selecting a portion within the media content using the transition data;
classifying the portion as either an advertisement segment or a program segment using repetition data for the portion; and
outputting data indicating a result of the classifying for the portion.

### Claim 15 (depends on 14)

The computing system of claim 14, wherein:
extracting the features comprises extracting fingerprints, and
generating the repetition data comprises generating the repetition data using the fingerprints.

### Claim 16 (depends on 14)

The computing system of claim 14, wherein:
extracting the features comprises extracting closed captioning, and
generating the repetition data comprises generating the repetition data using the closed captioning.

### Claim 17 (depends on 14)

The computing system of claim 14, wherein:
extracting the features comprises extracting keyframes, and
generating the repetition data comprises:
identifying a portion between two adjacent keyframes of the keyframes; and
searching for other portions within the media content having features matching features for the portion.

### Claim 18 (depends on 14)

The computing system of claim 14, wherein:
the transition data comprises predicted transitions between different content segments, and
selecting the portion comprises identifying a portion between two adjacent predicted transitions of the predicted transitions.

### Claim 19 (depends on 14)

The computing system of claim 14, wherein:
classifying the portion comprises classifying the portion as a program segment,
the set of acts further comprises determining that the portion classified as a program segment corresponds to a program specified in an electronic program guide using a timestamp of the portion, and
the data indicating the result of the classifying comprises a data file for the program that includes an indication of the portion.

### Claim 20 (depends on 14)

The computing system of claim 14, wherein:
classifying the portion comprises classifying the portion as an advertisement segment,
the features comprises metadata for the portion, and
the data indicating the result of the classifying comprises a data file that includes the metadata and an indication of the portion.
