Back to results
US 12,455,140 B2Granted
System and method for video image registration and/or providing supplemental data in a heads up display
AssigneeScience Applications International Corporation
InventorsJohn Richard Scales, Michael Harris Rodgers, Mark D. Hose
Life of this patent
Estimating the term…
Abstract
Video sources and inertial sensors are attached to a weapon and to goggles. A computer receives video images from the weapon- and goggles-mounted sources and inertial data from the sensors. The computer calculates a location for an image from the weapon-mounted source within an image from the goggles-mounted source using the inertial sensor data. The sensor-based location is checked (and possibly adjusted) based on a comparison of the images. A database contains information about real-world objects in a field of view of the goggles-mounted source, and is used to generate icons or other graphics concerning such objects.
Claims21
A method comprising:
- selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;
- determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:
- a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and
- a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;
- determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source;
- and
- generating a modified version of the third image comprising the portion of the fourth image in the determined position.
4 more elements
A method comprising:
- selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;
- determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment;
- determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source;
- generating a modified version of the third image comprising the portion of the fourth image in the determined position;
- receiving, while a first field of view (FOV) of a Heads-Up Display (HUD) associated with the first video source does not overlap with a second FOV associated with the second video source, video data from the first video source comprising a fifth image and video data from the second video source comprising a sixth image;
- and
- generating a modified version of the fifth image comprising a portion of the sixth image.
4 more elements
A method comprising:
- selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;
- determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:
- a rotation, for a region of the second image that comprises the portion of the second
- image, determined using the first sensor data and the second sensor data, and a rotation, for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;
- determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source;
- and
- generating a modified version of the third image comprising the portion of the fourth image in the determined position.
4 more elements
A system comprising:
- a processor;
- and
- a memory having instructions stored thereon, that, when executed by the processor, cause the processor to perform operations, the operations comprising:
- selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;
- determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:
- a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and
- a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;
- determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source;
- and
- generating a modified version of the third image comprising the portion of the fourth image in the determined position.
7 more elements
A system comprising:
- a processor;
- and
- a memory having instructions stored thereon, that, when executed by the processor, cause the processor to perform operations, the operations comprising:
- selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;
- determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:
- a rotation, for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and
- a rotation, for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;
- determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source;
- and
- generating a modified version of the third image comprising the portion of the fourth image in the determined position.
7 more elements
A non-transitory machine-readable medium having machine executable instructions for performing a method comprising:
- selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;
- determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:
- a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and
- a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;
- determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source;
- and
- generating a modified version of the third image comprising the portion of the fourth image in the determined position.
4 more elements
A non-transitory machine-readable medium having machine executable instructions for performing a method comprising:
- selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;
- determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:
- a rotation, for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and
- a rotation, for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;
- determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source;
- and
- generating a modified version of the third image comprising the portion of the fourth image in the determined position.
4 more elements
Dependencies are inferred from the claim text.