# US 2017/0171542 A1 · Collaborative sighting > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0171542 A1 - Document ID: US20170171542A1 - Status: Published application - Kind: A1 - Application number: 15/444,554 - Filed: 2017-02-28 - Published: 2017-06-15 - Earliest claimed: 2012-04-30 - Assignees: 2D3 Limited - Applicants: 2D3 Limited - Inventors: Eric Sommerlade; Emmet Spier; Julian Morris - Web page: https://patentgrep.com/patent/US20170171542A1 ## CPC - F41G 3/02: using an independent line of sight - F41G 1/345: {for illuminating the sights} - F41G 1/38: Telescopic sights specially adapted for smallarms or ordnance (telescopic sights in general G02B); Supports or mountings therefor {(Means for mounting sighting or aiming devices on firearms F41G11/001)} - G01C 11/12: the pictures being supported in the same relative position as when they were taken - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 7/73: using feature-based methods - G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration - G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) - H04N 17/002: {for television cameras} - H04N 23/63: by using electronic viewfinders - G06T 2207/10004: Still image; Photographic image - G06T 2207/10012: Stereo images - G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform - G06T 2207/30212: Military - G06T 2207/30244: Camera pose - F41G: WEAPON SIGHTS; AIMING (optical aspects thereof G02B) - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method includes generating calibration data by geometrically calibrating first image data from a first camera unit relative to second image data from a second camera unit based on first descriptor data and second descriptor data. The first descriptor data is based on the first image data. The second descriptor data is based on the second image data. The method includes identifying, based on the calibration data, a target location relative to the first image data. The method further includes generating an output image that includes the first image data and an indication of where the target location is relative to a scene depicted in the first image data. ## Claims ### Claim 1 A method comprising: generating, at a processor, calibration data by geometrically calibrating first image data from a first camera unit relative to second image data from a second camera unit based on first descriptor data and second descriptor data, wherein the first descriptor data is based on the first image data, and wherein the second descriptor data is based on the second image data; identifying, based on the calibration data, a target location relative to the first image data; and generating an output image, wherein the output image includes the first image data and an indication of where the target location is relative to a scene depicted in the first image data. ### Claim 2 (depends on 1) The method of claim 1, wherein the calibration data is generated in real time. ### Claim 3 (depends on 1) The method of claim 1, further comprising receiving the second image data from the second camera unit via a communication network. ### Claim 4 (depends on 1) The method of claim 1, further comprising: receiving first position data, wherein the first position data identifies a first position of the first camera unit while the first image data was captured; and receiving second position data, wherein the second position data identifies a second position of the second camera unit while the second image data was captured, and wherein the calibration data is generated based on the first position data and the second position data. ### Claim 5 (depends on 1) The method of claim 1, wherein the target location corresponds to a center of a second scene depicted in the second image data. ### Claim 6 (depends on 1) The method of claim 1, further comprising transmitting the output image to a display in real time. ### Claim 7 (depends on 1) The method of claim 1, further comprising: detecting a plurality of features within the first image data; generating, by the processor, descriptors for each feature of the plurality of features, wherein the first descriptor data includes the descriptors; and receiving the second descriptor data, wherein the second descriptor data is generated by a second processor coupled to the second camera unit, and wherein the second descriptor data is received from the second processor via a communications network. ### Claim 8 (depends on 7) The method of claim 7, wherein the descriptors include histograms of image gradients in different directions across respective positions of the plurality of features. ### Claim 9 (depends on 1) The method of claim 1, wherein the indicator is overlaid on a picture of the target location in response to the target location being represented in the first image data, and wherein the indicator points in a direction of the target location in response to the target location being located outside of the scene depicted in the first image data. ### Claim 10 (depends on 1) The method of claim 1, further comprising: determining that the first camera unit is focused on a second target area; in response to determining that the first camera unit focused on the second target area: generating, at the processor, third descriptor data based on third image data from the first camera unit; and transmitting the third descriptor data to a second processor coupled to the second camera unit. ### Claim 11 (depends on 10) The method of claim 10, wherein the first camera unit is determined to be focused on the second target area in response to receiving user input designating the second target area, and further comprising, in response to determining that the first camera unit focused on the second target area, transmitting target data indicating the second target area to the second camera unit. ### Claim 12 (depends on 10) The method of claim 10, wherein the first camera unit is determined to be focused on the second target area in response to the first camera unit focusing on the second target area for a particular period of time. ### Claim 13 A apparatus comprising: a first camera unit configured to generate first image data; a processor coupled to the first camera unit; a memory storing instruction that when executed by the processor cause the processor to perform operations including: generating calibration data by geometrically calibrating first image data from the first camera unit relative to second image data from a second camera unit based on first descriptor data and second descriptor data, wherein the first descriptor data is based on the first image data, and wherein the second descriptor data is based on the second image data; identifying, based on the calibration data, a target location relative to the first image data; and generating an output image, wherein the output image includes the first image data and an indication of where the target location is relative to a scene depicted in the first image data. ### Claim 14 (depends on 13) The apparatus of claim 13, wherein the first camera unit is coupled to a vehicle. ### Claim 15 (depends on 13) The apparatus of claim 13, further comprising a display unit, wherein the display unit is configured to display the output image. ### Claim 16 (depends on 15) The apparatus of claim 15, further comprising a housing, wherein the first camera unit is coupled to a first side of the housing, and wherein the display unit is coupled to a second side of the housing opposite of the first side. ### Claim 17 (depends on 16) The apparatus of claim 16, wherein the housing is coupled to a weapon, and wherein the first camera unit and display unit are configured to act as a sight for the weapon. ### Claim 18 (depends on 13) The apparatus of claim 13, further comprising an Attitude and Reference System sensor, a Global Positioning System sensor, or a combination thereof. ### Claim 19 A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising: generating calibration data by geometrically calibrating first image data from a first camera unit relative to second image data from a second camera unit based on first descriptor data and second descriptor data, wherein the first descriptor data is based on the first image data, and wherein the second descriptor data is based on the second image data; identifying, based on the calibration data, a target location relative to the first image data based on the calibration data; and generating an output image, wherein the output image includes the first image data and an indication of where the target location is relative to a scene depicted in the first image data. ### Claim 20 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the operations further comprise receiving, from a second processor coupled to the second camera unit, target data indicating the target location.