# US 11,308,144 B2 · Systems and methods for partitioning search indexes for improved efficiency in identifying media segments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,308,144 B2
- Document ID: US11308144B2
- Status: Granted
- Kind: B2
- Application number: 15/211,492
- Filed: 2016-07-15
- Published: 2017-01-19
- Granted: 2022-04-19
- Earliest claimed: 2015-07-16
- Assignees: Inscape Data, Inc.
- Applicants: Inscape Data, Inc.
- Inventors: Zeev Neumeier; Michael Collette
- Web page: https://patentgrep.com/patent/US11308144B2

## CPC

- G06F 16/41: Indexing; Data structures therefor; Storage structures
- G06F 16/61: Indexing; Data structures therefor; Storage structures
- G06F 16/71: Indexing; Data structures therefor; Storage structures
- G06F 16/783: using metadata automatically derived from the content
- G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)}
- H04N 21/8352: involving content or source identification data, e.g. Unique Material Identifier [UMID]
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods include identifying a media segment of audio or video content. The video segment is identified by deriving data from media content and comparing said data to a reference database in order to identify said video segment. Embodiments of the invention improve the speed and accuracy of the media identification process by advantageously partitioning the indexes in subdivisions where high value reference information is separated from the bulk information, for example.

## Claims

### Claim 1

A system comprising:
one or more processors; and
one or more non-transitory machine-readable storage media containing instructions which when executed on the one or more processors, cause the one or more processors to perform operations including:
receiving a plurality of known media content, wherein the plurality of known media content has associated known content identifiers;
partitioning the known content identifiers associated with the plurality of known media content into a first index and a second index;
separating the first index into one or more first buckets, wherein the first index is separated into the one or more first buckets using the known content identifiers that are in the first index;
separating the second index into one or more second buckets, wherein the second index is separated into the one or more second buckets using the known content identifiers that are in the second index;
receiving unknown content identifiers corresponding to unknown media content being displayed by a media system;
concurrently searching the one or more first buckets and the one or more second buckets for known content identifiers that match the unknown content identifiers;
determining that an amount of known content identifiers in a first bucket of the one or more first buckets is above a threshold;
discarding the first bucket from being searched for known content identifiers based on determining that the amount of known content identifiers in the first bucket is above the threshold;
determining that an amount of known content identifiers in a second bucket of the one or more first buckets is below the threshold;
selecting a known content identifier from the second bucket based on determining that the amount of known content identifiers in the second bucket is below the threshold, wherein the selected known content identifier is associated with known media content of the plurality of known media content; and
identifying the unknown media content as the known media content associated with the selected known content identifier.

### Claim 2 (depends on 1)

The system of claim 1, wherein the known content identifiers associated with the plurality of known media content are partitioned into the first index and the second index using parameters of the known media content.

### Claim 3 (depends on 1)

The system of claim 1, wherein the operations further include:
retrieving contextually targeted data associated with the known media content associated with the selected known content identifier, wherein the contextually targeted data is related to the known media content associated with the selected known content identifier; and
transmitting the contextually targeted data to the media system for display.

### Claim 4 (depends on 1)

The system of claim 1, wherein the unknown content identifiers include pixel data associated with the unknown media content.

### Claim 5 (depends on 1)

The system of claim 1, wherein the unknown content identifiers include audio data associated with the unknown media content.

### Claim 6 (depends on 5)

The system of claim 5, wherein searching the one or more first buckets and the one or more second buckets for the known content identifiers that match the unknown content identifiers includes applying speech recognition techniques to the known media content associated with the known content identifiers in the one or more first buckets and the known media content associated with the known content identifiers in the one or more second buckets.

### Claim 7 (depends on 1)

The system of claim 1, wherein the operations further include:
determining an offset time within the known media content associated with the selected known content identifier using the unknown content identifiers, wherein the offset time corresponds to a time within the unknown media content that is being displayed by the media system.

### Claim 8 (depends on 1)

The system of claim 1, wherein separating the first index into one or more first buckets includes hashing the known content identifiers in the first index, and wherein separating the second index into one or more second buckets includes hashing the known content identifiers in the second index.

### Claim 9 (depends on 8)

The system of claim 8, wherein the operations further include:
normalizing the hashed known content identifiers in the first index; and
normalizing the hashed known content identifiers in the second index.

### Claim 10 (depends on 1)

The system of claim 1, wherein the amount of known content identifiers in the first bucket being above the threshold indicates a high number of false positives.

### Claim 11

A method comprising:
receiving a plurality of known media content, wherein the plurality of known media content has associated known content identifiers;
partitioning the known content identifiers associated with the plurality of known media content into a first index and a second index;
separating the first index into one or more first buckets, wherein the first index is separated into the one or more first buckets using the known content identifiers that are in the first index;
separating the second index into one or more second buckets, wherein the second index is separated into the one or more second buckets using the known content identifiers that are in the second index;
receiving unknown content identifiers corresponding to unknown media content being displayed by a media system;
concurrently searching the one or more first buckets and the one or more second buckets for known content identifiers that match the unknown content identifiers;
determining that an amount of known content identifiers in a first bucket of the one or more first buckets is above a threshold;
discarding the first bucket from being searched based on determining that the amount of known content identifiers in the first bucket is above the threshold;
determining that an amount of known content identifiers in a second bucket of the one or more first buckets is below the threshold;
selecting a known content identifier from the second bucket based on determining that the amount of known content identifiers in the second bucket is below the threshold, wherein the selected known content identifier is associated with known media content of the plurality of known media content; and
identifying the unknown media content as the known media content associated with the selected known content identifier.

### Claim 12 (depends on 11)

The method of claim 11, wherein the known content identifiers associated with the plurality of known media content are partitioned into the first index and the second index using parameters of the known media content.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
retrieving contextually targeted data associated with the known media content associated with the selected known content identifier, wherein the contextually targeted data is related to the known media content associated with the selected known content identifier; and
transmitting the contextually targeted data to the media system for display.

### Claim 14 (depends on 11)

The method of claim 11, wherein the unknown content identifiers include pixel data associated with the unknown media content.

### Claim 15 (depends on 11)

The method of claim 11, wherein the unknown content identifiers include audio data associated with the unknown media content.

### Claim 16 (depends on 15)

The method of claim 15, wherein searching the one or more first buckets and the one or more second buckets for the known content identifiers that match the unknown content identifiers includes applying speech recognition techniques to the known media content associated with the known content identifiers in the one or more first buckets and the known media content associated with the known content identifiers in the one or more second buckets.

### Claim 17 (depends on 11)

The method of claim 11, further comprising:
determining an offset time within the known media content associated with the selected known content identifier using the unknown content identifiers, wherein the offset time corresponds to a time within the unknown media content that is being displayed by the media system.

### Claim 18 (depends on 11)

The method of claim 11, wherein separating the first index into one or more first buckets includes hashing the known content identifiers in the first index, and wherein separating the second index into one or more second buckets includes hashing the known content identifiers in the second index.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
normalizing the hashed known content identifiers in the first index; and
normalizing the hashed known content identifiers in the second index.

### Claim 20 (depends on 11)

The method of claim 11, wherein the amount of known content identifiers in the first bucket being above the threshold indicates a high number of false positives.
