Adaptive image processing for augmented reality device

An augmented reality (AR) device, comprising:

• at least one camera;
• at least one processor;
• and
• memory storing instructions that, when executed by the at least one processor, cause the AR device to perform operations comprising:
• accessing a first input image captured using the at least one camera, the first input image depicting a tracked object;
• determining, based on one or more AR device parameters, a crop-and-scale order of an image processing operation for the first input image, the crop-and-scale order being dynamically adjustable;
• performing the image processing operation according to the crop-and-scale order determined for the first input image to obtain a first output image, the first output image depicting the tracked object;
• accessing a second input image captured using the at least one camera, the second input image depicting the tracked object;
• automatically adjusting, for the second input image, the crop-and-scale order of the image processing operation such that the crop-and-scale order for the second input image differs from the crop-and-scale order for the first input image;
• performing the image processing operation according to the adjusted crop-and-scale order for the second input image to obtain a second output image, the second output image depicting the tracked object;
• and
• processing, via at least one machine learning model, the first output image and the second output image to track the tracked object.

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:

• accessing a first input image captured using at least one camera of an augmented reality (AR) device, the first input image depicting a tracked object;
• determining, based on one or more AR device parameters, a crop-and-scale order of an image processing operation for the first input image, the crop-and-scale order being dynamically adjustable;
• performing the image processing operation according to the crop-and-scale order determined for the first input image to obtain a first output image, the first output image depicting the tracked object;
• accessing a second input image captured using the at least one camera of the AR device, the second input image depicting the tracked object;
• automatically adjusting, for the second input image, the crop-and-scale order of the image processing operation such that the crop-and-scale order for the second input image differs from the crop-and-scale order for the first input image;
• performing the image processing operation according to the adjusted crop-and-scale order for the second input image to obtain a second output image, the second output image depicting the tracked object;
• and
• processing, via at least one machine learning model, the first output image and the second output image to track the tracked object.