Stationary extended reality device

A system comprising:

• at least one processor;
• and at least one memory component having instructions stored thereon that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
• receiving, from a camera of a stationary device comprising an extended reality (XR) shoe mirror, an image depicting a real-world object, the camera being directed in a stationary manner towards a specified field of view of a real-world environment;
• setting a focal length and one or more camera parameters to a specified value based on a first distance between the camera and a physical area comprising the specified field of view and one or more external conditions of the XR shoe mirror, the XR shoe mirror including a display screen that is placed at a second distance above the specified field of view, the XR shoe mirror including the physical area attached to the display screen that defines the specified field of view, and the XR shoe mirror including the camera pointed towards the physical area;
• analyzing the image using a machine learning model to generate predicted tracking information for the real-world object, the machine learning model trained based on a plurality of images depicting real-world objects in the specified field of view of the real-world environment and corresponding ground-truth tracking information for the real-world objects;
• selecting an XR experience from a plurality of XR experiences;
• and
• overlaying one or more XR elements associated with the XR experience on the image based on the predicted tracking information to generate a modified image.

A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

• receiving, from a camera of a stationary device comprising an extended reality (XR) shoe mirror, an image depicting a real-world object, the camera being directed in a stationary manner towards a specified field of view of a real-world environment;
• setting a focal length and one or more camera parameters to a specified value based on a first distance between the camera and a physical area comprising the specified field of view and one or more external conditions of the XR shoe mirror, the XR shoe mirror including a display screen that is placed at a second distance above the specified field of view, the XR shoe mirror including the physical area attached to the display screen that defines the specified field of view, and the XR shoe mirror including the camera pointed towards the physical area;
• analyzing the image using a machine learning model to generate predicted tracking information for the real-world object, the machine learning model trained based on a plurality of images depicting real-world objects in the specified field of view of the real-world environment and corresponding ground-truth tracking information for the real-world objects;
• selecting an XR experience from a plurality of XR experiences;
• and
• overlaying one or more XR elements associated with the XR experience on the image based on the predicted tracking information to generate a modified image.