Cyclic guidance for mask-based video matting

A non-transitory computer-readable medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:

• receiving a video sequence and an input masked video frame for a first video frame of the video sequence;
• generating alpha matte frames for the video sequence using the video sequence and the input masked video frame, wherein a first network generates masked video frames based on stored features of previous frames of the video sequence and a second network generates the alpha matte frames based on the masked video frames and the stored features of the previous frames of the video sequence;
• and
• outputting an alpha matte video sequence representation of the video sequence which includes the generated alpha matte frames.

A system comprising:

• a memory component;
• and
• a processing device coupled to the memory component, the processing device to perform operations comprising:
• receiving a video sequence and an input masked video frame for a first video frame of the video sequence;
• generating alpha matte frames for the video sequence using the video sequence and the input masked video frame, wherein a first network generates masked video frames based on stored features of previous frames of the video sequence and a second network generates the alpha matte frames based on the masked video frames and the stored features of the previous frames of the video sequence;
• and
• outputting an alpha matte video sequence representation of the video sequence which includes the generated alpha matte frames.