Smart video seek and playback experiences

A computer-implemented method comprising:

• receiving a request to perform a video control operation during playback of a video at a client device;
• selecting, from a plurality of video markers associated with the video, one or more video markers for the requested video control operation based on a type of video control operation of the requested video control operation, a playback position of the video, a representation of a video frame corresponding to the playback position of the video, and one or more respective representations of one or more video frames associated with the one or more video markers, wherein the representation of the video frame comprises one or more features or a fingerprint of the video frame, and wherein the one or more respective representations of the one or more video frames comprise one or more respective features or one or more respective fingerprints of the one or more video frames;
• selecting the one or more video frames for the requested video control operation based on the one or more video markers;
• and
• generating a signal configured to trigger the requested video control operation at the client device based on the one or more video frames associated with the one or more video markers.

A non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• receiving a request to perform a video control operation during playback of a video at a client device;
• selecting, from a plurality of video markers associated with the video, one or more video markers for the requested video control operation based on a type of video control operation of the requested video control operation, a playback position of the video, a representation of a video frame corresponding to the playback position of the video, and one or more respective representations of one or more video frames associated with the one or more video markers, wherein the representation of the video frame comprises one or more features or a fingerprint of the video frame, and wherein the one or more respective representations of the one or more video frames comprise one or more respective features or one or more respective fingerprints of the one or more video frames;
• selecting the one or more video frames for the requested video control operation based on the one or more video markers;
• and
• generating a signal configured to trigger the requested video control operation at the client device based on the one or more video frames associated with the one or more video markers.