Augmented reality guided depth estimation

A computing device comprising:

• a graphical processing unit;
• a processor;
• and
• a memory storing instructions that, when executed by the processor, configure the computing device to perform operations comprising:
• determining a first pose of a mixed reality (MR) device;
• generating, based on the first pose, a first frame;
• rendering, in the first frame, a virtual object that appears coupled to a physical object at a predefined position relative to the physical object;
• determining, after the first pose, a second pose of the MR device;
• generating, based on the second pose, a second frame;
• identifying an augmentation area in the second frame based on a location of the physical object relative to the MR device at the second pose, and the predefined position relative to the physical object;
• determining depth information limited to the augmentation area in the second frame;
• and
• rendering, in the second frame, the virtual object based on the depth information, the virtual object appearing coupled to the physical object at the predefined position.

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:

• determining a first pose of a mixed reality (MR) device;
• generating, based on the first pose, a first frame;
• rendering, in the first frame, a virtual object that appears coupled to a physical object at a predefined position relative to the physical object;
• determining, after the first pose, a second pose of the MR device;
• generating, based on the second pose, a second frame;
• identifying an augmentation area in the second frame based on a location of the physical object relative to the MR device at the second pose, and the predefined position relative to the physical object;
• determining depth information limited to the augmentation area in the second frame;
• and
• rendering, in the second frame, the virtual object based on the depth information, the virtual object appearing coupled to the physical object at the predefined position.