High quality UI elements with frame extrapolation

A method of frame processing, comprising:

• obtaining a plurality of consecutive previously rendered frames of a video sequence;
• identifying a static user interface region shared among a non-sequential subset of the obtained plurality of consecutive previously rendered frames;
• generating a plurality of comparison masks corresponding with the identified static user interface region based on the non-sequential subset of the obtained plurality of consecutive previous rendered frames;
• generating a mask based on at least two of the generated plurality of comparison masks corresponding with the identified static user interface region shared among the non-sequential subset of the obtained plurality of consecutive previously rendered frames;
• generating an extrapolated frame of the video sequence based on one or more of the plurality of previously rendered frames;
• and
• generating an adjusted extrapolated frame based on the generated extrapolated frame and the generated mask to reduce artifacts or conceal distorted content in an area corresponding to the identified static user interface region.

A non-transitory computer-readable medium storing computer executable code, the code when executed by at least one processor, causes the at least one processor to:

• obtain a plurality of consecutive previously rendered frames of a video sequence;
• identify a static user interface region shared among a non-sequential subset of the obtained plurality of consecutive previously rendered frames;
• generate a plurality of comparison masks corresponding with the identified static user interface region based on the non-sequential subset of the obtained plurality of consecutive previous rendered frames;
• generate a mask based on at least two of the generated plurality of comparison masks corresponding with the identified static user interface region shared among the non-sequential subset of the obtained plurality of consecutive previously rendered frames;
• generate an extrapolated frame of the video sequence based on one or more of the plurality of previously rendered frames;
• and
• generate an adjusted extrapolated frame based on the generated extrapolated frame and the generated mask to reduce artifacts or conceal distorted content in an area corresponding to the identified static user interface region.