Blending Virtual Environments with Situated Physical Reality

A computer-implemented method for blending physical reality with virtual reality, the method comprising:

• receiving, by a computing device, environmental sensor data from a set of environmental sensors in a physical environment;
• generating, by the computing device, a colorized geometric representation of an object in the physical environment based on the received environmental sensor data;
• rendering, by the computing device, a blended virtual environment based on the generated colorized geometric representation of the object and a virtual environment stored in memory;
• and
• providing, by the computing device, the rendered blended virtual environment for display to a head-mounted display (HMD) coupled to the computing device.

A computer storage medium storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations comprising:

• receiving environmental sensor data from a set of environmental sensors in a physical environment;
• generating a colorized geometric representation of an object in the physical environment based on the received environmental sensor data and a color scheme of a virtual environment stored in memory;
• rendering a blended virtual environment based on the generated colorized geometric representation of the object and the stored virtual environment;
• and
• providing the rendered blended virtual environment for display to a head-mounted display (HMD) coupled to the computing device.

A computerized system comprising:

• at least one processor;
• and
• at least one computer storage medium storing computer-useable instructions that, when used by the at least one processor, cause the at least one processor to perform operations comprising:
• receiving environmental sensor data from a set of environmental sensors in a physical environment;
• generating a colorized geometric representation of an object in the physical environment based on the received environmental sensor data and a color distribution of a virtual environment stored in memory;
• rendering a blended virtual environment based on the generated colorized geometric representation of the object and the stored virtual environment;
• and
• providing the rendered blended virtual environment for display to a head-mounted display (HMD) coupled to the computing device.