# US 12,632,973 B2 · System and method for targeting from 3D digital surface models and digital point positioning database controlled stereo imagery > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,632,973 B2 - Document ID: US12632973B2 - Status: Granted - Kind: B2 - Application number: 18/363,433 - Filed: 2023-08-01 - Published: 2025-02-06 - Granted: 2026-05-19 - Earliest claimed: 2023-08-01 - Assignees: BAE Systems Information and Electronic Systems Integration Inc. - Applicants: BAE Systems Information and Electronic Systems Integration Inc. - Inventors: Kurt J. DeVenecia; Brett A. Withee - Web page: https://patentgrep.com/patent/US12632973B2 ## CPC - G06T 7/344: {involving models} - G06T 7/60: Analysis of geometric attributes - G06T 7/75: {involving models} - G06V 20/653: {by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces} - G06T 2207/10012: Stereo images - G06T 2207/10032: Satellite or aerial image; Remote sensing - G06T 2207/30184: Infrastructure - G06T 2207/30212: Military - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A computer program product and corresponding method for targeting one or more points in a three dimensional (3D) model is provided. The computer program product including least one non-transitory computer readable storage medium in operative communication with a computer processing unit (CPU), the storage medium having instructions stored thereon that, when executed by the CPU, implement a process to register the 3D model with a stereoscopic image pair. The steps performed include inputting a first image and a second image that define a stereoscopic image pair into an object targeting program, wherein an object is shown in the first image and the second image, inputting a three dimensional (3D) model of the object into the object targeting program, registering the 3D model to the stereoscopic image pair, and targeting a point associated with or near the object based on the 3D model having been registered to the stereoscopic image pair. ## Claims ### Claim 1 A computer program product for targeting one or more points in a three dimensional (3D) model, the computer program product including at least one non-transitory computer readable storage medium in operative communication with a computer processing unit (CPU), the storage medium having instructions stored thereon that, when executed by the CPU, implement a process to register the 3D model with a stereoscopic image pair, the process comprising: receiving a first stereoscopic image and a second stereoscopic image that define the stereoscopic image pair, wherein an object is shown in the first stereoscopic image and the second stereoscopic image; receiving a 3D model of the object; registering the 3D model to the stereoscopic image pair; measuring a portion of the object in the 3D model; generating geospatial information for the object and providing the geospatial information to another system; measuring, simultaneously, (i) a portion of the object in the first stereoscopic image of the stereoscopic image pair, (ii) the portion of the object in the second stereoscopic image of the stereoscopic image pair, and (iii) the portion of the object in the 3D model; establishing a ground truth based on a first dimension of the portion of the object having been measured simultaneously in the first stereoscopic image, the second stereoscopic image, and the 3D model; and determining whether a second dimension of the portion of the object measured in the 3D model matches the ground truth of the first dimension of the portion of the object in the first and second stereoscopic images of the stereoscopic image pair. ### Claim 2 (depends on 1) The computer program product of claim 1, the process further comprising: wherein if it is determined that the second dimension does not match the first dimension of the object, then correcting, with a correction function, the second dimension to match the first dimension, and after correcting then registering the 3D model to the stereoscopic image pair; or wherein if is determined that the second dimension matches the first dimension, then registering the 3D model to the stereoscopic image pair. ### Claim 3 (depends on 1) The computer program product of claim 1, the process further comprising: selecting a point in the 3D model that is remote from a portion of the object after having registered the 3D model to the stereoscopic image pair; obtaining geospatial information of the point in the 3D model; and validating the geospatial information in the 3D model based on the stereoscopic image pair. ### Claim 4 (depends on 3) The computer program product of claim 3, the process further comprising: obtaining an error margin for the geospatial information of the object in the 3D model. ### Claim 5 (depends on 3) The computer program product of claim 3, the process further comprising: obtaining geospatial information of the point in the first stereoscopic image and the second stereoscopic image of the stereoscopic image pair, wherein the geospatial information comprises latitude, longitude and height of the point. ### Claim 6 (depends on 5) The computer program product of claim 5, wherein obtaining geospatial information of the point in the first stereoscopic image and the second stereoscopic image of the stereoscopic image pair occurs simultaneous to obtaining geospatial information of the point in the 3D model. ### Claim 7 (depends on 5) The computer program product of claim 5, the process further comprising: displaying the geospatial information of the point in the first stereoscopic image of the stereoscopic image pair; displaying the geospatial information of the point in the second stereoscopic image of the stereoscopic image pair; and displaying the geospatial information of the point in the 3D model. ### Claim 8 (depends on 1) The computer program product of claim 1, the process further comprising: generating and displaying an error margin that is associated with the geospatial information of a point in the 3D model that is remote from a portion of the object after having registered the 3D model to the stereoscopic image pair. ### Claim 9 An object targeting method comprising: inputting a first stereoscopic image and a second stereoscopic image that define a stereoscopic image pair into an object targeting program, wherein an object is shown in the first stereoscopic image and the second stereoscopic image; inputting a three dimensional (3D) model of the object into the object targeting program; registering the 3D model to the stereoscopic image pair; generating geospatial information for a point in the 3D model, wherein the point is associated with or near the object based on the 3D model having been registered to the stereoscopic image pair; targeting the point; measuring, simultaneously, (i) a portion of the object in the first stereoscopic image of the stereoscopic image pair, (ii) the portion of the object in the second stereoscopic image of the stereoscopic image pair, and (iii) the portion of the object in the 3D model; establishing a ground truth based on a first dimension of the portion of the object in the first and second stereoscopic images of the stereoscopic image pair having been measured; and determining whether a second dimension of the portion of the object measured in the 3D model matches the ground truth of the first dimension of the portion of the object in the first and second images of the stereoscopic image pair. ### Claim 10 (depends on 9) The method of claim 9, further comprising: wherein if it is determined that the second dimension does not match the first dimension, then correcting, with a correction function, the second dimension to match the first dimension, and then after correcting the second dimension, registering the 3D model to the stereoscopic image pair; or wherein if is determined that the second dimension matches the first dimension, then registering the 3D model to the stereoscopic image pair. ### Claim 11 (depends on 9) The method of claim 9, further comprising: selecting a point in the 3D model that is to be targeted after having registered the 3D model to the stereoscopic image pair; and obtaining geospatial information of the point in the 3D model; validating the geospatial information in the 3D model based on the stereoscopic image pair; and identifying the point as the object to be targeted. ### Claim 12 (depends on 11) The method of claim 11, further comprising: obtaining an error margin for the geospatial information of the point in the 3D model. ### Claim 13 (depends on 11) The method of claim 11, further comprising: obtaining geospatial information of the point in the first stereoscopic image and the second stereoscopic image of the stereoscopic image pair. ### Claim 14 (depends on 13) The method of claim 13, wherein obtaining geospatial information of the point in the first stereoscopic image and the second stereoscopic image of the stereoscopic image pair occurs simultaneous to obtaining geospatial information of the point in the 3D model. ### Claim 15 (depends on 13) The method of claim 13, further comprising: viewing a first text box displaying the geospatial information of the point in the first stereoscopic image of the stereoscopic image pair; viewing a second text box displaying the geospatial information of the point in the second stereoscopic image of the stereoscopic image pair; and viewing a third text box displaying the geospatial information of the point in the 3D model. ### Claim 16 (depends on 15) The method of claim 15, further comprising: displaying, in at least the third text box, an error margin that is associated with the geospatial information of the point.