Frame rate extrapolation

A device comprising:

• a display;
• a non-transitory memory;
• and
• one or more processors to:
• obtain a single image of a scene;
• display, on the display, the single image of the scene at a first time;
• generate an extrapolated image by transforming, using the one or more processors, the single image of the scene, wherein the extrapolated image includes:
• a first area including a gaze point of a user and including a first plurality of pixels having respective first pixel values determined based on a single depth and movement of the device, wherein the first area of the extrapolated image is based on a planar homographic transform of the single image of the scene,
• a second area surrounding the first area and including a second plurality of pixels having respective second pixel values determined based on a plurality of depths and the movement of the device, wherein the second area of the extrapolated image is based on a per-pixel homographic transform of the single image of the scene, and
• a transition area between the first area and the second area and including a third plurality of pixels having respective third pixel values determined based on a blending of a first pixel in the first area and a second pixel in the second area, wherein the blending of the transition area is based on a blending of the planar homographic transform and the per-pixel homographic transform;
• and
• display, on the display, the extrapolated image at a second time after the first time.

A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with a display, cause the device to:

• obtain a single image of a scene;
• display, on the display, the single image of the scene at a first time;
• generate an extrapolated image by transforming, using the one or more processors, the single image of the scene, wherein the extrapolated image includes:
• a first area including a gaze point of a user and including a first plurality of pixels having respective first pixel values determined based on a single depth and movement of the device, wherein the first area of the extrapolated image is based on a planar homographic transform of the single image of the scene,
• a second area surrounding the first area and including a second plurality of pixels having respective second pixel values determined based on a plurality of depths and the movement of the device, wherein the second area of the extrapolated image is based on a per-pixel homographic transform of the single image of the scene, and
• a transition area between the first area and the second area and including a third plurality of pixels having respective third pixel values determined based on a blending of a first pixel in the first area and a second pixel in the second area, wherein the blending of the transition area is based on a blending of the planar homographic transform and the per-pixel homographic transform;
• and
• display, on the display, the extrapolated image at a second time after the first time.