# US 2021/0278524 A1 · Gpr scanning through the use of external scene knowledge

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0278524 A1
- Document ID: US20210278524A1
- Status: Published application
- Kind: A1
- Application number: 17/190,960
- Filed: 2021-03-03
- Published: 2021-09-09
- Earliest claimed: 2020-03-04
- Assignees: Hexagon Technology Center GmbH
- Applicants: Hexagon Technology Center GmbH
- Inventors: Johannes MAUNZ; Katrin MENTL; Jan GLÜCKERT
- Web page: https://patentgrep.com/patent/US20210278524A1

## CPC

- G01S 13/885: {for ground probing (prospecting or detecting using electromagnetic waves G01V3/12)}
- G01V 3/12: operating with electromagnetic waves {(operating with millimetre waves G01V8/005)}
- G01S 7/411: {Identification of targets based on measurements of radar reflectivity (G01S7/415 takes precedence)}
- G01V 3/16: specially adapted for use from aircraft (G01V3/165 - G01V3/175 take precedence)
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 5/025: Extracting rules from data
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06N 3/08: Learning methods
- G06N 5/047: Pattern matching networks; Rete networks
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01V: GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS (means for indicating the location of accidentally buried, e.g. snow-buried, persons A63B29/02)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for scanning an area using a ground penetrating radar (GPR) by moving the GPR along at least one scanning trajectory. The method includes determining at least one landmark object image feature by applying object detection techniques to images of the area to be scanned, determining a position and/or type of at least one landmark object corresponding to the at least one landmark object image feature in a scanning-area coordinate frame, determining a candidate position or candidate type of at least one candidate underground asset in the area to be scanned by using the determined position or type of the at least one landmark object determining the at least one scanning trajectory using the candidate position and/or candidate type of the at least one candidate underground asset.

## Claims

### Claim 1

A method for scanning an area using a ground penetrating radar (GPR) by moving the GPR along at least one scanning trajectory, the method comprising:
determining at least one landmark object image feature by applying object detection techniques to images of the area to be scanned;
determining a position or type of at least one landmark object corresponding to the at least one landmark object image feature in a scanning-area coordinate frame;
determining a candidate position or candidate type of at least one candidate underground asset in the area to be scanned by using the determined position or type of the at least one landmark object; and
determining the at least one scanning trajectory using the candidate position or candidate type of the at least one candidate underground asset.

### Claim 2 (depends on 1)

The method for scanning an area according to claim 1, wherein the object detection is carried out using machine learning real-time object detection techniques.

### Claim 3 (depends on 1)

The method for scanning an area according to claim 1, wherein the candidate position or candidate type of the at least one candidate underground asset are determined from at least the determined position or type of the at least one landmark object using a rule-based algorithm, wherein the rule-based algorithm encodes known craft-specific information on relationships between landmark objects and corresponding underground assets, wherein the candidate position or candidate type of the at least one candidate underground asset are provided in geometrical and classification form, the geometrical form summarizing the spatial location and extent of the at least one candidate underground asset and the classification form summarizing the type of the at least one candidate underground asset.

### Claim 4 (depends on 1)

The method for scanning an area according to claim 1, wherein the determined candidate type of the at least one candidate underground asset comprises information about at least one material of the at least one candidate underground asset.

### Claim 5 (depends on 1)

The method for scanning an area according to claim 1, wherein the at least one scanning trajectory is determined in such a way as to optimize detectability of at least a part of the at least one candidate underground asset.

### Claim 6 (depends on 5)

The method for scanning an area according to claim 5, wherein the at least one scanning trajectory is orthogonal to a main direction of at least the part of the at least one candidate underground asset and the at least one scanning trajectory is provided with a start and end point, or the at least one scanning trajectory is at an oblique angle to a main direction of at least the part of the at least one candidate underground asset and the at least one scanning trajectory is provided with a start and end point.

### Claim 7 (depends on 1)

The method for scanning an area according to claim 1, wherein a plurality of scanning trajectories is determined, wherein the scanning trajectories possess different directions and have different lengths.

### Claim 8 (depends on 1)

The method for scanning an area according to claim 1, further comprising:
determining a current position and orientation of the GPR in the scanning-area coordinate frame during movement along the at least one scanning trajectory using information provided by at least one sensor integrated into or attached to the GPR;
providing the images of the area to be scanned by using at least one image sensor;
determining the current position and orientation of the at least one image sensor using a known geometrical relationship between the at least one image sensor and the GPR;
fusing the so obtained current position and orientation of the at least one image sensor with the position and orientation of the at least one image sensor provided by a simultaneous localization and mapping (SLAM) algorithm to obtain an updated position and orientation of the at least one image sensor in the scanning-area coordinate frame; and
determining an updated position and orientation of the GPR by way of the known geometrical relationship between the GPR and the at least one image sensor using the updated position and orientation of the at least one image sensor.

### Claim 9 (depends on 1)

The method for scanning an area according to claim 1, further comprising:
projecting a next determined scanning trajectory along which the GPR is to be moved next onto the area to be scanned.

### Claim 10 (depends on 1)

The method for scanning an area according to claim 1, further comprising:
projecting a signal onto the area to be scanned to indicate the candidate position or candidate type of a candidate underground asset comprised by the at least one candidate underground asset.

### Claim 11 (depends on 1)

The method for scanning an area according to claim 1, further comprising:
providing to a user of the GPR an indication signal to indicate that a start position of a scanning trajectory comprised by the at least one scanning trajectory is reached.

### Claim 12 (depends on 1)

The method for scanning an area according to claim 1, further comprising:
providing indication to the user of the GPR about potential deviations of the moving GPR away from a current scanning trajectory along which the GPR is supposed to move.

### Claim 13 (depends on 1)

The method for scanning an area according to claim 1, further comprising:
using markers to indicate the location and spatial extent of the area to be scanned.

### Claim 14 (depends on 1)

A computer program product with program code being stored on a machine readable medium, the program code being configured to provide the candidate location or candidate type of the at least one candidate underground asset and the at least one scanning trajectory in the area to be scanned using at least the images of the area to be scanned as in the method according to claim 1.

### Claim 15 (depends on 14)

A GPR system comprising a GPR, a computing unit, a computer program product with program code according to claim 14 being stored on the computing unit, and at least one image sensor providing images to the computing unit.
