Virtual environment generating system

A virtual environment generating system including a head-mounted display device operatively connected to a computing device, the head-mounted display device including a transparent display through which a user may view a physical environment that includes a real-world object, the virtual environment generating system comprising:

• a virtual environment generating program executed by a processor of the computing device, the virtual environment generating program configured to:
• receive eye-tracking information from an eye-tracking system in the head-mounted display device;
• determine from the eye-tracking information that the user is looking at a virtual object representation;
• receive lighting information from an optical sensor system in the head-mounted display device;
• receive depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device;
• generate a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including the virtual object representation and a real-world object representation;
• visually augment the virtual object representation in the virtual environment based on the eye-tracking information that the user is looking at the virtual object representation;
• render the virtual object representation on the transparent display of the head-mounted display device;
• determine from the eye-tracking information that the user is looking at the real-world object;
• based on determining that the user is looking at the real-world object, blur the virtual object representation as seen by the user through the transparent display;
• analyze a contrast pattern behind the virtual object representation in the physical environment;
• and
• adjust one or more of a color and a brightness of the virtual object representation to enhance contrast of the virtual object representation with respect to the contrast pattern.

A nonvolatile computer-readable storage medium comprising instructions stored thereon and executable by a computing device to visually augment an appearance of a physical environment including a real-world object as seen by a user through a transparent display in a head-mounted display device, the instructions being executable to:

• receive eye-tracking information from an eye-tracking system in the head-mounted display device;
• receive lighting information from an optical sensor system in the head-mounted display device;
• receive depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device;
• generate a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including a virtual object representation and a real-world object representation;
• determine from the eye-tracking information that the user is looking at the real-world object;
• based on the eye-tracking information that the user is looking at the real-world object, blur an appearance of the virtual object representation as seen by the user through the transparent display;
• analyze a contrast pattern behind the virtual object representation in the physical environment;
• adjust one or more of a color and a brightness of the virtual object representation to enhance contrast of the virtual object representation with respect to the contrast pattern;
• and
• render the virtual object representation on the transparent display of the head-mounted display device.