Auto-alignment of multi-sensor overlay using bi-directional detector/display

An optical device comprising:

• an underlying device configured output light, to an optical output to output an image of objects in an environment to a user, in a first spectrum as a result of absorbing input light;
• a stacked device configured to be coupled in an overlapping fashion to an optical output of the underlying device, the stacked device being transparent, according to a first transmission efficiency, to light in the first spectrum, the stacked device comprising:
• a plurality of electro-optical circuits including:
• a plurality of light emitters configured to output light;
• a plurality of detectors configured to detect light in the first spectrum from the underlying device that can be used to detect the objects in the image;
• and
• wherein the light emitters are configured to output light dependent on light detected by the detectors and additional information about characteristics of the objects in the environment, wherein at least a portion of the additional information is provided in a pulsed sample format such that the light emitters output light for a series of images using the same additional information.

A method of manufacturing an optical device, the method comprising:

• connecting a stacked device to an underlying device, the underlying device configured to output light, to an optical output to output an image of objects in an environment to a user, in a first spectrum as a result of absorbing input light, wherein the stacked device configured to be coupled in an overlapping fashion to an optical output of the underlying device, the stacked device being transparent, according to a first transmission efficiency, to light in the first spectrum, the stacked device comprising:
• a plurality of electro-optical circuits including:
• a plurality of light emitters configured to output light;
• a plurality of detectors configured to detect light in the first spectrum from the underlying device that can be used to detect the objects in the image;
• connecting control electronics to the light emitter in a fashion configured to cause the light emitters to output light dependent on light detected by the detectors and additional information about characteristics of the objects in the environment;
• and
• coupling a pulsed sensor to the control electronics, such that the additional information comprises a pulsed sample format such that the light emitters output light for a series of images using the same additional information.

A method of manufacturing an optical device, the method comprising:

• connecting a stacked device to an underlying device, the underlying device configured to output light, to an optical output to output an image of objects in an environment to a user, in a first spectrum as a result of absorbing input light, wherein the stacked device configured to be coupled in an overlapping fashion to an optical output of the underlying device, the stacked device being transparent, according to a first transmission efficiency, to light in the first spectrum, the stacked device comprising:
• a plurality of electro-optical circuits including:
• a plurality of light emitters configured to output light;
• a plurality of detectors configured to detect light in the first spectrum from the underlying device that can be used to detect the objects in the image;
• connecting control electronics to the light emitter in a fashion configured to cause the light emitters to output light dependent on light detected by the detectors and additional information about characteristics of the objects in the environment;
• and
• coupling a thermal camera sensor to the control electronics, such that the additional information comprises thermal information, and wherein the control electronics are configured to cause the light emitters are to output representations of the thermal information overlaid on one or more objects in the image where the thermal information is constrained to be within boundaries of the one or more objects.

A method of displaying information in an optical device the method comprising:

• at an underlying device, absorbing input light;
• at the underlying device, outputting light, to an optical output to output an image of objects in an environment to a user, in a first spectrum as a result of absorbing the input light;
• at a stacked device, coupled in an overlapping fashion to an optical output of the underlying device, transmitting at least a portion of the light in the first spectrum through the stacked device to output the image to the user;
• at the stacked device, outputting light using a plurality of light emitters;
• at the stacked device, detecting light in the first spectrum from the underlying device to detect the objects in the image;
• receiving additional information about characteristics of the objects in the environment, wherein the additional information is provided in a pulsed sample format such that the light emitters output light for a series of images using the same additional information;
• and
• wherein outputting light using the plurality of light emitters is dependent on light detected by the detectors and the additional information about characteristics of the objects in the environment.

A method of displaying information in optical device the method comprising:

• at an underlying device, absorbing input light;
• at the underlying device, outputting light, to an optical output to output an image of objects in an environment to a user, in a first spectrum as a result of absorbing the input light;
• at a stacked device, coupled in an overlapping fashion to an optical output of the underlying device, transmitting at least a portion of the light in the first spectrum through the stacked device to output the image to the user;
• at the stacked device, outputting light using a plurality of light emitters;
• at the stacked device, detecting light in the first spectrum from the underlying device to detect the objects in the image;
• receiving additional information about characteristics of the objects in the environment, wherein the additional information comprises thermal information, the method further comprising the light emitters outputting representations of the thermal information overlaid on one or more objects in the image where the thermal information is constrained to be within boundaries of the one or more objects;
• and
• wherein outputting light using the plurality of light emitters is dependent on light detected by the detectors and the additional information about characteristics of the objects in the environment.