# US 2025/0168473 A1 · Programmatic media preview generation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168473 A1
- Document ID: US20250168473A1
- Status: Published application
- Kind: A1
- Application number: 19/033,398
- Filed: 2025-01-21
- Published: 2025-05-22
- Earliest claimed: 2023-04-17
- Assignees: Tubi, Inc.
- Applicants: Tubi, Inc.
- Inventors: Aidean Sharghi Karganroodi; Venkatesh Ganapati Hegde; Michael Edward Depies; Evan Lennon Aubrey; Alexis Franklin; Zhiye Li; Jaya Kawale; Amir Mazaheri
- Web page: https://patentgrep.com/patent/US20250168473A1

## CPC

- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)}
- G11B 27/19: by using information detectable on the record carrier
- H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/251: {Learning process for intelligent management, e.g. learning user preferences for recommending movies (details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/466: Learning process for intelligent management, e.g. learning user preferences for recommending movies {(services using the results of monitoring in broadcast systems H04H60/61)}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N 21/8547: involving timestamps for synchronizing content
- H04N 21/26241: {involving the time of distribution, e.g. the best time of the day for inserting an advertisement or airing a children programme}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

A system and method for programmatic media preview generation, including: a preview generation system executing on a computer processor and configured to receive a request to generate a preview video of a source video file; select a source video for analysis; obtain a set of text metadata comprising groupings of subtitles of the source video; invoke a machine learning model using the set of text metadata to infer a set of candidate previews for the source video file; and provide a final set of candidate previews in response to the request; and a ranking module comprising functionality to rank the set of candidate previews to generate the final set of candidate previews.

## Claims

### Claim 1

A system for media preview generation, comprising:
a computer processor;
a preview generation system executing on the computer processor, comprising functionality to:
receive a request to generate a preview video of a source video file;
select a source video for analysis;
obtain a set of text metadata comprising groupings of subtitles of the source video, wherein each grouping comprises at least one timestamp indicating an occurrence of the subtitles during the source video file;
invoke a machine learning model using the set of text metadata to infer a set of candidate previews for the source video file, wherein each of the set of candidate previews is a structured data representation of a segment of the source video, and wherein each structured data representation comprises a synopsis of the corresponding segment; and
provide a final set of candidate previews in response to the request; and
a ranking module comprising functionality to:
rank the set of candidate previews to generate the final set of candidate previews.

### Claim 2 (depends on 1)

The system of claim 1, further comprising:
a computer vision module comprising functionality to:
identify a set of shots of the source video, wherein each shot comprises a contiguous series of frames of the source video which are grouped by similarity;
generate shot timestamps corresponding to start and end times of each shot of the set of shots; and
an audio analysis module comprising functionality to:
obtain the subtitles of the source video; and
generate the set of text metadata comprising groupings of subtitles of the source video using the shot timestamps, wherein the at least one timestamp of each grouping corresponds to at least one of the shot timestamps.

### Claim 3 (depends on 2)

The system of claim 2, further comprising:
a content moderation module comprising functionality to:
perform a moderation analysis on at least one frame of each of the set of shots to generate a content moderation score;
determine that the content moderation score of at least one shot of the set of shots exceeds a predefined threshold indicating a likelihood of prohibited content; and
exclude a candidate preview of the set of candidate previews comprising the at least one shot based on determining that the content moderation score exceeds the predefined threshold.

### Claim 4 (depends on 3)

The system of claim 3, wherein invoking the machine learning model to infer the set of candidate previews and performing the moderation analysis are executed in parallel.

### Claim 5 (depends on 1)

The system of claim 1, further comprising:
an entity detection module comprising functionality to:
invoke an entity recognition model on at least one frame of each of the set of candidate previews to annotate at least a subset of the set of candidate previews with person metadata indicating appearance of a named actor, wherein ranking the set of candidate previews is based at least on the person metadata.

### Claim 6 (depends on 1)

The system of claim 1, wherein the ranking module further comprises functionality to:
determine that at least one candidate preview of the set of candidate previews fails to meet an outlier threshold score; and
exclude the at least one candidate preview from the final set of candidate previews based.

### Claim 7 (depends on 1)

The system of claim 1, wherein the preview generation system further comprises functionality to:
provide the final set of candidate previews to a client application for display to a human curator;
receive a selection of a candidate preview of the final set of previews for deployment; and
trigger a deployment of the candidate preview in response to the selection, wherein deployment of the candidate preview results in serving the candidate preview to users of a media streaming service.

### Claim 8 (depends on 7)

The system of claim 7, wherein the preview generation system further comprises functionality to:
receive an instruction to modify the candidate preview from the human curator, wherein the instruction comprises at least one selected from a group consisting of: editing a boundary of the candidate preview by advancing or receding the boundary by at least one shot; and
modify the candidate preview according to the instruction.

### Claim 9 (depends on 7)

The system of claim 7, wherein the preview generation system further comprises functionality to:
receive a negative annotation from the human curator for a second candidate preview of the final set of candidate previews;
exclude the second candidate preview from eligibility for deployment by the media streaming service in response to the negative annotation; and
provide the negative annotation to a model evaluation module of the preview generation system; and
the model evaluation module comprising functionality to:
obtain a plurality of feedback data comprising the negative annotation; and
generate a performance evaluation metric for a machine learning model of the ranking module using the plurality of feedback data.

### Claim 10

A method for media preview generation, comprising:
receiving a request to generate a preview video of a source video file;
selecting a source video for analysis;
obtaining a set of text metadata comprising groupings of subtitles of the source video, wherein each grouping comprises at least one timestamp indicating an occurrence of the subtitles during the source video file;
invoking, by a computer processor, a machine learning model using the set of text metadata to infer a set of candidate previews for the source video file, wherein each of the set of candidate previews is a structured data representation of a segment of the source video, and wherein each structured data representation comprises a synopsis of the corresponding segment;
ranking the set of candidate previews to generate a final set of candidate previews; and
providing the final set of candidate previews in response to the request.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
identifying a set of shots of the source video, wherein each shot comprises a contiguous series of frames of the source video which are grouped by similarity;
generating shot timestamps corresponding to start and end times of each shot of the set of shots;
obtaining the subtitles of the source video; and
generating the set of text metadata comprising groupings of subtitles of the source video using the shot timestamps, wherein the at least one timestamp of each grouping corresponds to at least one of the shot timestamps.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
performing a moderation analysis on at least one frame of each of the set of shots to generate a content moderation score;
determining that the content moderation score of at least one shot of the set of shots exceeds a predefined threshold indicating a likelihood of prohibited content; and
excluding a candidate preview of the set of candidate previews comprising the at least one shot based on determining that the content moderation score exceeds the predefined threshold;

### Claim 13 (depends on 12)

The method of claim 12, wherein invoking the machine learning model to infer the set of candidate previews and performing the moderation analysis are executed in parallel.

### Claim 14 (depends on 10)

The method of claim 10, further comprising:
invoking an entity recognition model on at least one frame of each of the set of candidate previews to annotate at least a subset of the set of candidate previews with person metadata indicating appearance of a named actor, wherein ranking the set of candidate previews is based at least on the person metadata.

### Claim 15 (depends on 10)

The method of claim 10, further comprising:
determining that at least one candidate preview of the set of candidate previews fails to meet an outlier threshold score; and
excluding the at least one candidate preview from the final set of candidate previews based.

### Claim 16 (depends on 10)

The method of claim 10, further comprising:
providing the final set of candidate previews to a client application for display to a human curator;
receiving a selection of a candidate preview of the final set of previews for deployment; and
triggering a deployment of the candidate preview in response to the selection, wherein deployment of the candidate preview results in serving the candidate preview to users of a media streaming service.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
receiving an instruction to modify the candidate preview from the human curator, wherein the instruction comprises at least one selected from a group consisting of: editing a boundary of the candidate preview by advancing or receding the boundary by at least one shot; and
modifying the candidate preview according to the instruction.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
receiving a negative annotation from the human curator for a second candidate preview of the final set of candidate previews;
excluding the second candidate preview from eligibility for deployment by the media streaming service in response to the negative annotation; and
providing the negative annotation to a model evaluation module of the preview generation system;
obtaining a plurality of feedback data comprising the negative annotation; and
generating a performance evaluation metric for a machine learning model of the ranking module using the plurality of feedback data.

### Claim 19

A non-transitory computer-readable storage medium comprising a plurality of instructions for media preview generation, the plurality of instructions configured to execute on at least one computer processor to enable the at least one computer processor to:
receive a request to generate a preview video of a source video file;
select a source video for analysis;
obtain a set of text metadata comprising groupings of subtitles of the source video, wherein each grouping comprises at least one timestamp indicating an occurrence of the subtitles during the source video file;
invoke a machine learning model using the set of text metadata to infer a set of candidate previews for the source video file, wherein each of the set of candidate previews is a structured data representation of a segment of the source video, and wherein each structured data representation comprises a synopsis of the corresponding segment;
rank the set of candidate previews to generate a final set of candidate previews; and
provide the final set of candidate previews in response to the request.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the plurality of instructions are further configured to enable the at least one computer processor to:
identify a set of shots of the source video, wherein each shot comprises a contiguous series of frames of the source video which are grouped by similarity;
generate shot timestamps corresponding to start and end times of each shot of the set of shots;
obtain the subtitles of the source video; and
generate the set of text metadata comprising groupings of subtitles of the source video using the shot timestamps, wherein the at least one timestamp of each grouping corresponds to at least one of the shot timestamps.
