Display of an occluded object in a hybrid-reality system

An article of manufacture comprising a tangible medium, that is not a transitory propagating signal, encoding computer-readable instructions that, when applied to a computer system coupled to a display of a hybrid reality system (DHR), instruct the computer system to perform a method comprising:

• determining, at a first time, a first position of the DHR relative to a first real-world object;
• receiving data associated with an occluded object at the hybrid-reality system from a separate device over a computer network, the occluded object at least partially occluded by the first real-world object at the first position of the DHR and including a hidden portion that is hidden from the first position of the DHR by the first real-world object, wherein the occluded object is a second real-world object or a part of the first real-world object;
• establishing a viewport anchored to a first location on the first real-world object;
• rendering a first image showing a first virtual view of at least some of the hidden portion of the occluded object from a first perspective of the first position of the DHR through the viewport based on the first position of the DHR, the first location of the viewport on first real-world object, and the received data associated with the occluded object;
• presenting the first image on the DHR overlaid on a first view of the first real-world object in the viewport at the first location on the first real-world object, the first view of the first real-world object showing the first real-world object from the first position of the DHR;
• determining, at a second time after the first time, a second position of the DHR relative to the first real-world object;
• rendering a second image showing a second virtual view of at least some of the hidden portion of the occluded object from a second perspective of the second position of the DHR through the viewport based on the second position of the DHR, the first location of the viewport on the first real-world object, and the received data associated with the occluded object;
• and
• presenting the second image on the DHR overlaid on a second view of the first real-world object in the viewport at the first location on the first real-world object, the second view of the first real-world object showing the first real-world object from the second position of the DHR.

A hybrid reality system comprising:

• a display;
• a sensor;
• a structure, coupled to the display and the sensor, and adapted to position the display in a field-of-view (FOV) of the user;
• a computer network interface;
• and
• a processor, coupled to the display, the sensor, and the computer network interface, the processor programmed to:
• determine, using the sensor at a first time, a first position of the display relative to a first real-world object;
• receive data associated with an occluded object at the hybrid-reality system from a separate device through the computer network interface, the occluded object at least partially occluded by the first real-world object at the first position of the display and including a hidden portion that is hidden from the first position of the display by the first real-world object, wherein the occluded object is a second real-world object or a part of the first real-world object;
• establish a viewport anchored to a first location on the first real-world object;
• render a first image showing a first virtual view of at least some of the hidden portion of the occluded object from a first perspective of the first position of the display through the viewport based on the first position of the display, the first location of the viewport on first real-world object, and the received data associated with the occluded object;
• present the first image on the display overlaid on a first view of the first real-world object in the viewport at the first location on the first real-world object, the first view of the first real-world object showing the first real-world object from the first position of the display;
• determine, using the sensor at a second time after the first time, a second position of the display relative to the first real-world object;
• render a second image showing a second virtual view of at least some of the hidden portion of the occluded object from a second perspective of the second position of the display through the viewport based on the second position of the display, the first location of the viewport on the first real-world object, and the received data associated with the occluded object;
• and
• present the second image on the display overlaid on a second view of the first real-world object in the viewport at the first location on the first real-world object, the second view of the first real-world object showing the first real-world object from the second position of the display.