US 10,474,717 B2 · Live video streaming services with machine-learning based highlight replays

Abstract

According to an implementation, a computing device for automatically creating video highlights for video broadcast streams shared in a social media platform includes at least one processor, and a non-transitory computer-readable medium having executable instructions that when executed by the at least one processor are configured to execute a video broadcasting service having a video highlight creator. The video highlight creator is configured to obtain a video broadcast stream that was previously broadcasted to a plurality of viewing devices of the social media platform, create video highlights based on an analysis of the video broadcast stream, and provide the video highlights for selection within a user interface of an interactive streaming application configured to communicate with the video broadcasting service over a network.

Claims18

Dependent claims

A computing device for automatically creating video highlights for video broadcast streams shared in a social media platform, the computing device comprising:

at least one processor;
and
a non-transitory computer-readable medium having executable instructions that when executed by the at least one processor are configured to execute a video broadcasting service having a video highlight creator, the video highlight creator configured to:
obtain a video broadcast stream that was previously broadcasted to a plurality of viewing devices of the social media platform;
create video highlights based on a video analysis of the video broadcast stream, including;
classify, using a machine-learning classifier, a plurality of video segments of the video broadcast stream into classifications, each classification having a tag indicating whether the classification is highlight-eligible or not highlight-eligible;
select at least one of the plurality of video segments based on the tags and class proportion data, the class proportion data indicating frequencies in which the classifications appear in a set of video broadcast streams;
and
provide the video highlights for selection within a user interface of an interactive video streaming application configured to communicate with the video broadcasting service over a network.

6 more elements

A social media system for sharing video broadcast streams in a social network, the social media system comprising:

an interactive video streaming application executable by at least one processor, and configured to display a timeline of social content on a user interface of the interactive video streaming application, the timeline including a list of video broadcast streams, the list of video broadcast streams including a first video broadcast stream and a second video broadcast stream;
and
at least one server configured to:
classify, using a machine-learning classifier, video segments of the first and second video broadcast streams into classifications, each classification having a tag indicating whether the classification is highlight-eligible or not highlight-eligible;
and
select a subset of the video segments for the video highlights based on the tags and class proportion data, the class proportion data indicating frequencies in which the classifications appear in a set of video broadcast streams;
the interactive video streaming application configured to:
provide an icon on the user interface for selection of video highlights, the video highlights including a video clip having at least one first video segment of the first video broadcast stream and at least one second video segment of the second video broadcast stream;
and
initiate playback of the video highlights, upon receiving an indication that the icon has been selected, such that the user can view highlights of the first video broadcast stream and the second video broadcast stream.

7 more elements

A method for automatically creating video highlights for video broadcast streams shared in a social media platform, the method comprising:

obtaining, by at least one processor, a video broadcast stream that was broadcasted to a plurality of viewing devices in the social media platform;
creating, by the at least one processor, video highlights based on an analysis of the video broadcast stream, including:
classifying, using a machine-learning classifier, a plurality of video segments of the video broadcast stream into classifications based on a video analysis of each video segment, each classification having a tag indicating whether the classification is highlight-eligible or not highlight-eligible;
assigning a confidence score to each classified video segment, the confidence score indicating a likeliness of a respective video segment having a particular classification;
calculating a ranking score for each classified video segment based on the confidence scores;
and
selecting one or more of the plurality of video segments to be included within the video highlights based on the ranking scores, the tags, and class proportion data, the class proportion data indicating frequencies in which the classifications appear in a set of video broadcast streams;
and
providing, by the at least one processor, the video highlights for selection within a user interface of an interactive streaming application.

6 more elements

Dependencies are inferred from the claim text.

Live video streaming services with machine-learning based highlight replays

Life of this patent

Live video streaming services with machine-learning based highlight replays

Life of this patent

Abstract

Claims18