Super-resolution apparatus and method for virtual and mixed reality

An apparatus comprising:

• a camera to capture a raw image including depth data;
• region detection circuitry to identify one or more regions of interest based on a detected spatial proximity of one or more virtual objects and one or more real objects, wherein the spatial proximity detection includes measuring a first distance between a virtual object and a user and a second distance between a real object and the user, and determining the difference between the first and second distances;
• depth super-resolution circuitry to generate a super-resolution map of the one or more regions of interest using machine-learning techniques or results thereof;
• interaction detection circuitry to detect interactions between the virtual objects and the real objects using the super-resolution map;
• and
• wherein one or more graphics processing or general-purpose processing operations are to be performed based on the detected interactions.

A non-transitory machine-readable medium having program code stored therein which, when executed by a machine, causes the machine to perform the operations of:

• capturing a raw image including depth data;
• identifying one or more regions of interest based on a detected spatial proximity of one or more virtual objects and one or more real objects, wherein the spatial proximity detection includes measuring a first distance between a virtual object and a user and a second distance between a real object and the user, and determining the difference between the first and second distances;
• generating a super-resolution map of the one or more regions of interest using machine-learning techniques or results thereof;
• detecting interactions between the virtual objects and the real objects using the super-resolution map;
• and
• performing one or more graphics processing or general-purpose processing operations based on the detected interactions.