Video see-through augmented reality

One or more non-transitory computer readable storage media embodying instructions and coupled to one or more processors that are operable to execute the instructions to:

• capture, by a calibration camera that is not part of a video see-through AR system, a calibration pattern displayed on a display of a video see-through AR system comprising (1) a see-through camera that is distinct from the calibration camera (2) the display, configured to display content captured by the see-through camera and (3) a display lens configured to transmit light from the display, wherein:
• the calibration camera is located at an eye position for viewing content on the video see-through AR system;
• and
• the displayed calibration pattern corresponds to an image of a calibration pattern capture by a see-through camera of the video see-through AR system;
• determine, based on the captured calibration pattern, one or more system parameters of the video see-through AR system that represent combined distortion of the video see-through AR system caused by (1) capturing an image for display by the see-through camera and (2) transmitting the displayed image through the display lens;
• determine, based on an image of the calibration pattern captured by the see-through camera, one or more see-through camera parameters that represent distortion caused only by the see-through camera determine, based on the one or more system parameters and on the one or more see-through camera parameters that represent the distortion caused only by the see-through camera, one or more display-lens parameters that represent distortion caused only by transmitting the displayed image through the display lens;
• and
• store the one or more system parameters and the one more display-lens parameters as a calibration for the video see-through AR system.

A system comprising:

• one or more non-transitory computer readable storage media embodying instructions;
• and
• one or more processors coupled to the non-transitory computer readable storage media, the one or more processors being operable to execute the instructions to:
• capture, by a calibration camera that is not part of a video see-through AR system, a calibration pattern displayed on a display of a video see-through AR system comprising (1) a see-through camera that is distinct from the calibration camera (2) the display, configured to display content captured by the see-through camera and (3) a display lens configured to transmit light from the display, wherein:
• the calibration camera is located at an eye position for viewing content on the video see-through AR system;
• and
• the displayed calibration pattern corresponds to an image of a calibration pattern capture by a see-through camera of the video see-through AR system;
• determine, based on the captured calibration pattern, one or more system parameters of the video see-through AR system that represent combined distortion of the video see-through AR system caused by (1) capturing an image for display by the see-through camera and (2) transmitting the displayed image through the display lens;
• determine, based on an image of the calibration pattern captured by the see-through camera, one or more see-through camera parameters that represent distortion caused only by the see-through camera determine, based on the one or more system parameters and on the one or more see-through camera parameters that represent the distortion caused only by the see-through camera, one or more display-lens parameters that represent distortion caused only by transmitting the displayed image through the display lens;
• and
• store the one or more system parameters and the one more display-lens parameters as a calibration for the video see-through AR system.