Video object segmentation using estimated motion information and image features

A computer-implemented method comprising:

• receiving a video frame, of a plurality of video frames, the plurality of video frames corresponding to a video;
• parsing the video frame into a plurality of sections;
• generating a first similarity score that indicates a measure of feature similarity between a first section and a second section, of the plurality of sections;
• generating a second similarity score that indicates a measure of estimated motion information similarity between the first section and the second section;
• and
• based at least in part on the first similarity score and the second similarity score, performing video object segmentation of the video frame.

A computerized system, the system comprising:

• an embedding means for receiving a video frame, of a plurality of video frames, the plurality of video frames corresponding to a video;
• a video frame patch means for parsing the video frame into a plurality of sections;
• an estimated motion means for receiving or determining motion information for a plurality of pixels of the video frame;
• wherein the embedding means is further for deriving one or more embeddings that are one or more encoded representations of the video frame and the estimated motion information;
• a similarity score means for generating one or more similarity scores that indicates at least one of a measure of feature similarity between a first section and a second section, of the plurality of sections, and a measure of motion information similarity between the first section and the second section;
• and
• a VOS means for performing video object segmentation of the video frame based at least in part on the generating of the one or more similarity scores.