Systems and methods for generating stabilized images of a real environment in artificial reality

A non-transitory computer-readable medium including executable instructions that, when executed by a computing device that is in communication with mixed-reality device worn by a user, cause the computing device to:

• detect an object of interest in a real environment;
• determine one or more anchor locations in a mixed-reality environment presented via the mixed-reality device that correspond to a position of the object of interest in the real environment;
• determine (i) a pose of a camera when an image is captured and (ii) a viewpoint of the user of the mixed-reality device;
• determine a region in the image that, as viewed from the pose of the camera, corresponds to at least one of the one or more anchor locations;
• cause display of a first output image based on (1) viewpoint and (2) the region in the image corresponding to at least one of the one or more anchor locations.

A system comprising:

• a mixed-reality device worn by a user;
• one or more processors;
• and
• one or more computer-readable non-transitory storage media coupled to the one or more of processors and including executable instructions that, when executed by the one or more of processors, to cause the system to:
• detect an object of interest in a real environment;
• determine one or more anchor locations in a mixed-reality environment presented via the mixed-reality device that correspond to a position of the object of interest in the real environment;
• determine (i) a pose of a camera when an image is captured and (ii) a viewpoint of the user of the mixed-reality device;
• determine a region in the image that, as viewed from the pose of the camera, corresponds to at least one of the one or more anchor locations;
• cause display of a first output image based on (1) viewpoint and (2) the region in the image corresponding to at least one of the one or more anchor locations.