Smart frame selection via activity-based ranking and optimization

A system, comprising:

• one or more processors to execute operations comprising:
• receive a plurality of frames and metadata from a capture device capturing a video stream;
• generate, using a ranking model, a plurality of rankings for the plurality of frames based on a plurality of video parameters of the plurality of frames and the metadata of the video stream, wherein the plurality of rankings correspond to a summarization of the video stream;
• determine at least one of the plurality of frames to provide to at least one first buffer based on the plurality of rankings, wherein the at least one first buffer stores a first subset of frames of the plurality of frames;
• and
• provide, from the at least one first buffer, the first subset of frames as input to a first machine-learning model.

A method, comprising:

• receiving, using one or more processors, a plurality of frames and metadata from a capture device capturing a video stream;
• generating, using the one or more processors performing a ranking model, a plurality of rankings for the plurality of frames based on a plurality of video parameters of the plurality of frames and the metadata of the video stream, wherein the plurality of rankings correspond to a summarization of the video stream;
• determining, using the one or more processors, at least one of the plurality of frames to provide to at least one first buffer based on the plurality of rankings, wherein the at least one first buffer stores a first subset of frames of the plurality of frames;
• and
• providing, using the one or more processors from the at least one first buffer, the first subset of frames as input to a first machine-learning model.