Nested stereoscopic projections

A system comprising one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

• identifying, in a first three-dimensional coordinate system of a first three-dimensional virtual environment, a location and orientation of a first virtual object that is a virtual stereoscopic display object, wherein the virtual stereoscopic display object includes a virtual surface;
• identifying an eyepoint pair in the first virtual environment, comprising identifying, for each eyepoint of the eyepoint pair, a first location and first orientation of the eyepoint in the first coordinate system of the first virtual environment,
• wherein the respective first locations and first orientations of the eyepoint pair define a perspective from which a user can view the first virtual environment using a physical stereoscopic display;
• identifying, in a second three-dimensional coordinate system of a second three-dimensional virtual environment, a location and orientation of a second virtual object that is in the second virtual environment;
• identifying a relationship between (i) the first coordinate system of the first virtual environment and (ii) the second coordinate system of the second virtual environment, wherein the relationship is defined according to the location and orientation of the virtual stereoscopic display object in the first coordinate system of the first virtual environment;
• for each eyepoint of the eyepoint pair, determining, using the identified relationship, a second location and second orientation of the eyepoint in the second coordinate system of the second virtual environment,
• wherein the respective second locations and second orientations of the eyepoint pair define a perspective from which the user can view the second virtual environment using the virtual stereoscopic display object;
• for each eyepoint of the eyepoint pair, rendering an inferior image of the second virtual object based on i) the location and orientation of the second virtual object in the second coordinate system of the second virtual environment and ii) the second location and second orientation of the eyepoint in the second coordinate system of the second virtual environment;
• for each eyepoint of the eyepoint pair, rendering a superior image of the first virtual environment, comprising rendering, in the superior image for the eyepoint, the corresponding inferior image onto the virtual surface of the virtual stereoscopic display object;
• and
• displaying, on the physical stereoscopic display, the superior images of the first virtual environment.