# US 11,308,343 B2 · Method and device for automatically identifying a point of interest in a depth measurement on a viewed object > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,308,343 B2 - Document ID: US11308343B2 - Status: Granted - Kind: B2 - Application number: 16/915,471 - Filed: 2020-06-29 - Published: 2021-01-14 - Granted: 2022-04-19 - Earliest claimed: 2013-12-17 - Assignees: Baker Hughes, A Ge Company, LLC - Applicants: Baker Hughes, a GE Company, LLC - Inventors: Clark A. Bendall - Web page: https://patentgrep.com/patent/US11308343B2 ## CPC - G01B 11/22: for measuring depth - G01B 11/03: by measuring coordinates of points - G01B 11/24: for measuring contours or curvatures - G01N 21/8851: {Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges (G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002)} - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06T 7/001: {using an image reference approach} - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - G01N 2021/8861: {Determining coordinates of flaws} - G01N 2021/8887: {based on image processing techniques} - G06T 2200/08: involving all processing steps from image acquisition to 3D model generation - G06T 2207/10028: Range image; Depth image; 3D point clouds - H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals} - G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method and device for automatically identifying a point of interest in a depth measurement on a viewed object using a video inspection device is disclosed. The video inspect device determines the three-dimensional coordinates in a region of interest on the viewed object and analyzes those surface points to determine the desired measurement application (e.g., determining the deepest point, the highest point, or the clearance between two surfaces). Based on the desired measurement application, the video inspection device automatically identifies the point of interest on the viewed object and places a cursor at that location. ## Claims ### Claim 1 A method for automatically identifying an offset measurement point on a viewed object, the method comprising: displaying an image of the viewed object in a display; determining, by a data processor, three-dimensional coordinates of a plurality of points on a surface of the viewed object; receiving, by the data processor, a plurality of reference surface points manually selected on the displayed image via an input device; determining, by the data processor, a reference surface using three-dimensional coordinates associated with the plurality of reference surface points; determining, by the data processor, a region of interest based on the plurality of reference surface points; determining, by the data processor, a target feature type using three-dimensional coordinates within the region of interest; selecting, by the data processor, an offset measurement point based on the target feature type; determining, by the data processor, a distance between the reference surface and the offset measurement point; displaying an offset cursor in the display at the offset measurement point; and providing the distance in the display. ### Claim 2 (depends on 1) The method of claim 1, wherein the target feature type is one of a recessed feature, a protruding feature, a perpendicular surface gap, or an opposite surface gap. ### Claim 3 (depends on 2) The method of claim 2, wherein the target feature type is a recessed feature, and the offset measurement point is a point within the recessed feature furthest from the reference surface. ### Claim 4 (depends on 2) The method of claim 2, wherein the target feature type is a protruding feature, and the offset measurement point is a point within the protruding feature furthest from the reference surface. ### Claim 5 (depends on 2) The method of claim 2, wherein the target feature type is a perpendicular surface gap, and the offset measurement point is a point on an edge of a perpendicular surface closest to the reference surface. ### Claim 6 (depends on 2) The method of claim 2, wherein the target feature type is an opposite surface gap, and the offset measurement point is a point on an opposite surface furthest from the reference surface. ### Claim 7 (depends on 1) The method of claim 1, wherein the offset cursor is automatically displayed after receiving a last reference surface point of the plurality of reference surface points. ### Claim 8 (depends on 7) The method of claim 7, wherein the offset cursor is re-positioned in response to manual repositioning of at least one reference surface point in the plurality of reference surface points. ### Claim 9 A system for automatically identifying an offset measurement point on a viewed object, the system comprising: a video inspection device comprising a display; an input device; a data processor; and a memory storing non-transitory computer-readable instructions, which when executed by the data processor, cause the data processor to perform operations comprising displaying an image of the viewed object in the display; determining three-dimensional coordinates of a plurality of points on a surface of the viewed object; receiving a plurality of reference surface points manually selected on the displayed image via the input device; determining a reference surface using three-dimensional coordinates associated with the plurality of reference surface points; determining a region of interest based on the plurality of reference surface points; determining a target feature type using three-dimensional coordinates within the region of interest; selecting an offset measurement point based on the target feature type; determining a distance between the reference surface and the offset measurement point; displaying an offset cursor in the display at the offset measurement point; and providing the distance in the display. ### Claim 10 (depends on 9) The system of claim 9, wherein the target feature type is one of a recessed feature, a protruding feature, a perpendicular surface gap, or an opposite surface gap. ### Claim 11 (depends on 10) The system of claim 10, wherein the target feature type is a recessed feature, and the offset measurement point is a point within the recessed feature furthest from the reference surface. ### Claim 12 (depends on 10) The system of claim 10, wherein the target feature type is a protruding feature, and the offset measurement point is a point within the protruding feature furthest from the reference surface. ### Claim 13 (depends on 10) The system of claim 10, wherein the target feature type is a perpendicular surface gap, and the offset measurement point is a point on an edge of a perpendicular surface closest to the reference surface. ### Claim 14 (depends on 10) The system of claim 10, wherein the target feature type is an opposite surface gap, and the offset measurement point is a point on an opposite surface furthest from the reference surface. ### Claim 15 (depends on 9) The system of claim 9, wherein the offset cursor is automatically displayed after receiving a last reference surface point of the plurality of reference surface points. ### Claim 16 (depends on 15) The system of claim 15, wherein the offset cursor is re-positioned in response to manual repositioning of at least one reference surface point in the plurality of reference surface points. ### Claim 17 A non-transitory computer program product storing instructions which, when executed by at least one data processor forming part of at least one computing system, results in operations comprising: displaying an image of the viewed object in a display of a video inspection device including a data processor; determining, by the data processor, three-dimensional coordinates of a plurality of points on a surface of the viewed object; receiving, by the data processor, a plurality of reference surface points manually selected on the displayed image via the input device; determining, by the data processor, a reference surface using three-dimensional coordinates associated with the plurality of reference surface points; determining, by the data processor, a region of interest based on the plurality of reference surface points; determining, by the data processor, a target feature type using three-dimensional coordinates within the region of interest; selecting, by the data processor, an offset measurement point based on the target feature type; determining, by the data processor, a distance between the reference surface and the offset measurement point; displaying, by the data processor, an offset cursor in the display at the offset measurement point; and providing, by the data processor, the distance in the display. ### Claim 18 (depends on 17) The non-transitory computer program product of claim 17, wherein the target feature type is one of a recessed feature, a protruding feature, a perpendicular surface gap, or an opposite surface gap. ### Claim 19 (depends on 17) The non-transitory computer program product of claim 17, the offset cursor is automatically displayed after receiving a last reference surface point of the plurality of reference surface points. ### Claim 20 (depends on 17) The non-transitory computer program product of claim 17, the offset cursor is re-positioned in response to manual repositioning of at least one reference surface point in the plurality of reference surface points.