# US 2017/0371871 A1 · Search-based navigation of media content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0371871 A1
- Document ID: US20170371871A1
- Status: Published application
- Kind: A1
- Application number: 15/688,415
- Filed: 2017-08-28
- Published: 2017-12-28
- Earliest claimed: 2012-04-27
- Assignees: MobiTV, Inc.
- Applicants: MobiTV, Inc.
- Inventors: Curtis Calhoun
- Web page: https://patentgrep.com/patent/US20170371871A1

## CPC

- G06F 16/483: using metadata automatically derived from the content
- G06F 16/43: Querying
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Mechanisms are provided to allow for improved media content navigation. Metadata such as closed captioning, social media content, and tags associated with various media segments are analyzed to allow identification of particular entities depicted in the various media segments. Image recognition and audio recognition algorithms can also be performed to further identify entities or validate results from the analysis of metadata.

## Claims

### Claim 1

A method comprising:
receiving from a user a search term for media content;
identifying a plurality of entities corresponding to the search term, wherein the plurality of entities can include characters, objects, places, action sequences, and romantic scenes;
identifying a plurality of media segments corresponding to the plurality of entities after receiving the search term from the user, the plurality of media segments including a video result comprising a video track, an audio track, and a metadata track;
scanning the plurality of media segments after identifying the plurality of media segments, wherein scanning the plurality of media segments includes analyzing metadata included in the metadata track, wherein analyzing metadata includes analyzing closed captions, chat data, and social media;
tagging, by the system after scanning, the plurality of media segments with a plurality of identifiers, the plurality of identifiers including indications of time positions with media content corresponding to the search term and markers indicating degrees of relevance of correspondence between the plurality of media segments and the search term;
validating the tagged media segments to verify that the tagged media segments indeed include the plurality of entities corresponding to the search term;
filtering the tagged media segments such that only a subset of the identified plurality of media segments that pass the metadata analysis thresholds are presented to the viewer; and
displaying only the subset of the identified plurality of media segments that passed the thresholds as results to the user, the results being displayed as of one or more time-based thumbnails and content corresponding to the thumbnails, the one or more time-based thumbnails including the plurality of identifiers for the identified plurality of media segments, wherein selection of a first identifier triggers playback of a first media segment associated with the search term.

### Claim 2 (depends on 1)

The method of claim 1, wherein the media content comprises a video stream.

### Claim 3 (depends on 1)

The method of claim 1, wherein the media content comprises a video clip.

### Claim 4 (depends on 1)

The method of claim 1, wherein the plurality of identifiers are markers associated with start time position information for each of the plurality of media segments.

### Claim 5 (depends on 4)

The method of claim 4, wherein the plurality of identifiers are specified on a seekbar.

### Claim 6 (depends on 1)

The method of claim 1, wherein relevance is determined via a relevance score.

### Claim 7 (depends on 1)

The method of claim 1, wherein the plurality of media segments are a plurality of portions of a video program or movie.

### Claim 8

A system comprising:
an interface operable to receive from a user a search term for media;
a processor operable to identify a plurality of entities corresponding to the search term, wherein the plurality of entities can include characters, objects, places, action sequences, and romantic scenes;
wherein the processor is also operable to:
identify a plurality of media segments corresponding to the plurality of entities after receiving the search term from the user, the plurality of media segments including a video result comprising a video track, an audio track, and a metadata track;
scan the plurality of media segments after identifying the plurality of media segments, wherein scanning the plurality of media segments includes analyzing metadata included in the metadata track, wherein analyzing metadata includes analyzing closed captions, chat data, and social media;
tag, after scanning, the plurality of media segments with a plurality of identifiers, the plurality of identifiers including indications of time positions with media content corresponding to the search term and markers indicating degrees of relevance of correspondence between the plurality of media segments and the search term;
validate the tagged media segments to verify that the tagged media segments indeed include the plurality of entities corresponding to the search term; and
filter the tagged media segments such that only a subset of the identified plurality of media segments that pass the metadata analysis thresholds are presented to the viewer; and
a display operable to show only the subset of the identified plurality of media segments that passed the thresholds as results to the user, the results being displayed as of one or more time-based thumbnails and content corresponding to the thumbnails, the one or more time-based thumbnails including the plurality of identifiers for the identified plurality of media segments, wherein selection of a first identifier triggers playback of a first media segment associated with the search term.

### Claim 9 (depends on 8)

The system of claim 8, wherein the media content comprises a video stream.

### Claim 10 (depends on 8)

The system of claim 8, wherein the media content comprises a video clip.

### Claim 11 (depends on 8)

The system of claim 8, wherein the plurality of identifiers are markers associated with start time position information for each of the plurality of media segments.

### Claim 12 (depends on 11)

The system of claim 11, wherein the plurality of identifiers are specified on a seekbar.

### Claim 13 (depends on 8)

The system of claim 8, wherein relevance is determined via a relevance score.

### Claim 14 (depends on 8)

The system of claim 8, wherein the plurality of media segments are a plurality of portions of a video program or movie.

### Claim 15

A non-transitory computer readable medium comprising instructions for:
receiving from a user a search term for media content;
identifying a plurality of entities corresponding to the search term, wherein the plurality of entities can include characters, objects, places, action sequences, and romantic scenes;
identifying a plurality of media segments corresponding to the plurality of entities after receiving the search term from the user, the plurality of media segments including a video result comprising a video track, an audio track, and a metadata track;
scanning the plurality of media segments after identifying the plurality of media segments, wherein scanning the plurality of media segments includes analyzing metadata included in the metadata track, wherein analyzing metadata includes analyzing closed captions, chat data, and social media;
tagging, by the system after scanning, the plurality of media segments with a plurality of identifiers, the plurality of identifiers including indications of time positions with media content corresponding to the search term and markers indicating degrees of relevance of correspondence between the plurality of media segments and the search term;
validating the tagged media segments to verify that the tagged media segments indeed include the plurality of entities corresponding to the search term;
filtering the tagged media segments such that only a subset of the identified plurality of media segments that pass the metadata analysis thresholds are presented to the viewer; and
displaying only the subset of the identified plurality of media segments that passed the thresholds as results to the user, the results being displayed as of one or more time-based thumbnails and content corresponding to the thumbnails, the one or more time-based thumbnails including the plurality of identifiers for the identified plurality of media segments, wherein selection of a first identifier triggers playback of a first media segment associated with the search term.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the media content comprises a video stream.

### Claim 17 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the media content comprises a video clip.

### Claim 18 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the plurality of identifiers are markers associated with start time position information for each of the plurality of media segments.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the plurality of identifiers are specified on a seekbar.

### Claim 20 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein relevance is determined via a relevance score.
