# US 2020/0393558 A1 · System and method of enhancing a performance of an electromagnetic sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0393558 A1
- Document ID: US20200393558A1
- Status: Published application
- Kind: A1
- Application number: 16/439,742
- Filed: 2019-06-13
- Published: 2020-12-17
- Earliest claimed: 2019-06-13
- Assignees: Wisense Technologies Ltd.
- Applicants: Wisense Technologies Ltd.
- Inventors: Itai ORR; Moshik Moshe Cohen
- Web page: https://patentgrep.com/patent/US20200393558A1

## CPC

- G01S 13/89: for mapping or imaging
- G06N 3/08: Learning methods
- G01S 7/417: {involving the use of neural networks}
- G01S 13/9027: {Pattern recognition for feature extraction}
- G06N 3/02: Neural networks
- G06N 3/0499: Feedforward networks
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A system and a method for training a machine learning (ML) model to enhance a performance of an electromagnetic (EM) sensor, the method including: receiving one or more first data elements pertaining to a first signal of an EM sensor having a first performance parameter value; receiving one or more second data elements pertaining to a second signal of a data generator having a second performance parameter value; and training the ML model to generate a third signal, using the one or more first data elements as a training data set and using the one or more second data elements as supervisory data, where the third signal is characterized by a third performance parameter value that is higher than the first performance parameter value.

## Claims

### Claim 1

A method for training a machine learning (ML) model to enhance a performance of an electromagnetic (EM) sensor, the method comprising:
receiving one or more first data elements pertaining to a first signal of an EM sensor having a first performance parameter value;
receiving one or more second data elements pertaining to a second signal of a data generator having a second performance parameter value; and
training the ML model to generate a third signal, using the one or more first data elements as a training data set and using the one or more second data elements as supervisory data,
wherein the third signal is characterized by a third performance parameter value that is higher than the first performance parameter value.

### Claim 2 (depends on 1)

The method of claim 1 wherein the performance parameter is selected from a list consisting of: a spatial resolution, a temporal resolution, a frequency resolution, a Doppler resolution an angular resolution and a signal-to-noise ratio (SNR).

### Claim 3 (depends on 1)

The method of claim 1, wherein the one or more second data elements are selected from a list consisting of a point cloud generated by the data generator and a depth map generated by the data generator and a range-Doppler map generated by the data generator.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
synchronizing between a first timing of the reception of the one or more first data elements and a second timing of the reception of the one or more second data elements; and
performing spatial registration between the one or more first data elements and the one or more second data elements,
wherein the ML is self-supervised by the one or more second data elements.

### Claim 5 (depends on 2)

The method of claim 2, wherein the EM sensor is a radar and wherein the data generator is selected from a list consisting of: the radar, a second radar, a light detection and ranging (LIDAR) sensor and an assembly of one or more cameras.

### Claim 6 (depends on 5)

The method of claim 5, wherein the list further consists of a simulator module, configured to produce a simulated, three-dimensional environment, and wherein the one or more second data elements pertain to the simulated, three-dimensional environment.

### Claim 7 (depends on 6)

The method of claim 6, further comprising constructing a radar image that is characterized by the third performance parameter value, based on the one or more third data elements.

### Claim 8

A method of enhancing an EM sensor signal, the method comprising:
receiving one or more data elements pertaining to a first signal of the EM sensor, the signal characterized by a first performance parameter value;
inputting the one or more data elements to a neural network (NN) model; and
generating a second signal from at least one output of the NN model,
wherein the second signal is characterized by a second performance parameter value, and wherein the second performance parameter value is higher than the first performance parameter value.

### Claim 9 (depends on 8)

The method of claim 8, wherein the performance parameter is selected from a list consisting of: a spatial resolution, a Doppler resolution, a temporal resolution, a frequency resolution, an angular resolution and an SNR.

### Claim 10 (depends on 9)

The method of claim 9, wherein the EM sensor is a radar, and wherein the second signal is a radar image, selected from a list consisting of: a point cloud, a depth map and a range-Doppler map.

### Claim 11

A system for enhancing a signal of an EM sensor, the system comprising a NN model, associated with the EM sensor and configured to receive one or more first data elements from the EM sensor, and produce therefrom one or more second data elements, wherein the one or more first data elements are characterized by a first performance parameter value and wherein the one or more second data elements are characterized by a second, higher performance parameter value.

### Claim 12 (depends on 11)

The system of claim 11 wherein the performance parameter is selected from a list consisting of: a spatial resolution, a temporal resolution, a frequency resolution, a Doppler resolution an angular resolution and an SNR.

### Claim 13 (depends on 12)

The system of claim 12 further comprising:
a non-transitory memory device, wherein modules of instruction code are stored; and
a processor associated with the memory device, and configured to execute the modules of instruction code,
whereupon execution of said modules of instruction code, the processor is configured to generate an image from the one or more second data elements, wherein the image is characterized by the second performance parameter value.

### Claim 14 (depends on 13)

The system of claim 13 wherein the EM sensor is a radar, and wherein the radar is selected from a list consisting of a point cloud and a depth map.

### Claim 15

A system for training one or more ML models to enhance a performance of an EM sensor, the system comprising: a non-transitory memory device, wherein modules of instruction code are stored, and a processor associated with the memory device, and configured to execute the modules of instruction code, whereupon execution of said modules of instruction code, the processor is further configured to perform at least one of:
receive one or more first data elements pertaining to a first signal of the EM sensor having a first performance parameter value;
receive one or more second data elements pertaining to a second signal of a data generator, having a second performance parameter value; and
train at least one ML model to generate a third signal, using the one or more first data elements as a training data set and using the one or more second data elements as supervisory annotated data,
wherein the third signal is characterized by a third performance parameter value that is higher than the first performance parameter value.

### Claim 16 (depends on 15)

The system of claim 15 further comprising at least one digital signal processing module, having one or more processing modules and wherein training at least one ML model to generate the third signal comprises using one or more output data elements of one or more processing modules as a training data set.

### Claim 17 (depends on 16)

The system of claim 16, wherein the one or more ML models are arranged in a cascade, and wherein training at least one ML model to generate the third signal comprises using an output of a preceding ML model as supervisory annotated data.

### Claim 18 (depends on 15)

The system of claim 15 wherein the performance parameter is selected from a list consisting of: a spatial resolution, a temporal resolution, a frequency resolution, a Doppler resolution an angular resolution and an SNR.

### Claim 19 (depends on 15)

The system of claim 15, wherein the processor is further configured to:
synchronize between a first timing of the reception of the one or more first data elements and a second timing of the reception of the one or more second data elements;
perform spatial registration between the one or more first data elements and the one or more second data elements; and
using the one or more second data elements to self-supervise training of the ML model.

### Claim 20

A method for training an ML model to enhance a performance of an EM sensor, the method comprising:
receiving one or more first data elements pertaining to a first signal of an EM sensor having a first performance parameter value;
generating one or more second data elements from the one or more first data elements having a second performance parameter value that is lower than the first performance parameter value; and
training the ML model to generate a third signal, using the one or more second data elements as a training data set and using the one or more first data elements serve as supervisory data,
wherein the third signal is characterized by a third performance parameter value that is higher than the second performance parameter value.
