# US 2020/0400810 A1 · Method and device with improved radar resolution

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0400810 A1
- Document ID: US20200400810A1
- Status: Published application
- Kind: A1
- Application number: 16/658,229
- Filed: 2019-10-21
- Published: 2020-12-24
- Earliest claimed: 2019-06-19
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Hyunwoong CHO; Byung Kwan KIM; Jong-Sok KIM; Sungdo CHOI
- Web page: https://patentgrep.com/patent/US20200400810A1

## CPC

- G01S 13/583: {using transmission of continuous unmodulated waves, amplitude-, frequency-, or phase-modulated waves and based upon the Doppler effect resulting from movement of targets}
- G01S 13/9047: {Doppler beam sharpening mode}
- G01S 7/352: {Receivers}
- G01S 7/417: {involving the use of neural networks}
- G01S 13/89: for mapping or imaging
- G01S 13/931: of land vehicles
- G06T 3/4053: based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
- G01S 7/356: {involving particularities of FFT processing}
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method of increasing a resolution of radar data is provided. The method of training a radar resolution increase model comprises generating a high-resolution training ground truth and a low-resolution training input from original raw radar data based on information corresponding to at least one of dimensions defining the original raw radar data, and training the resolution increase model based on the high-resolution training ground truth and the low-resolution training input. A radar data processing device generates high-resolution output data from low-resolution input data based on a trained resolution increase model.

## Claims

### Claim 1

A processor-implemented method of training a radar resolution increase model, the method comprising:
receiving original raw radar data;
generating a high-resolution training ground truth and a low-resolution training input from the original raw radar data based on information corresponding to at least one of dimensions defining the original raw radar data; and
training the radar resolution increase model based on the low-resolution training input and the high-resolution training ground truth.

### Claim 2 (depends on 1)

The method of claim 1, wherein the dimensions defining the original raw radar data comprise one of a Doppler velocity, a horizontal angle, an elevation angle, and a range, or a combination of two or more of the Doppler velocity, the horizontal angle, the elevation angle, and the range.

### Claim 3 (depends on 1)

The method of claim 1, wherein the generating of the high-resolution training ground truth and the low-resolution training input comprises:
selecting low-resolution radar data from the original raw radar data; and
generating the low-resolution training input by preprocessing the selected low-resolution radar data.

### Claim 4 (depends on 3)

The method of claim 3, wherein the selecting of the low-resolution radar data comprises:
selecting, as the low-resolution radar data, radar data corresponding to a first part of antenna channels from the original raw radar data in an angular dimension.

### Claim 5 (depends on 3)

The method of claim 3, wherein the selecting of the low-resolution radar data comprises:
selecting, as the low-resolution radar data, radar data corresponding to a portion of chirp signals implemented for single scanning from the original raw radar data in a Doppler velocity dimension.

### Claim 6 (depends on 3)

The method of claim 3, wherein the selecting of the low-resolution radar data comprises:
selecting, as the low-resolution radar data, radar data corresponding to a first part of bandwidths allocated to the original raw radar data in a range dimension.

### Claim 7 (depends on 3)

The method of claim 3, wherein the generating of the low-resolution training input by preprocessing the selected low-resolution radar data comprises:
performing a range fast Fourier transform (FFT) process and a digital beamforming (DBF) process on the selected low-resolution radar data.

### Claim 8 (depends on 7)

The method of claim 7, wherein the generating of the low-resolution training input by preprocessing the selected low-resolution radar data comprises:
generating at least one of a range-Doppler map and a range-angle map from the low-resolution radar data.

### Claim 9 (depends on 1)

The method of claim 1, wherein the generating of the high-resolution training ground truth and the low-resolution training input comprises:
selecting high-resolution radar data from the original raw radar data; and
generating the high-resolution training ground truth by preprocessing the selected high-resolution radar data.

### Claim 10 (depends on 1)

The method of claim 1, wherein the radar resolution increase model comprises a neural network, the neural network comprising a convolution layer,
wherein the training of the radar resolution increase model comprises:
further training the radar resolution increase model based on direction-of-arrival (DoA) information estimated based on subspace type-based estimation.

### Claim 11 (depends on 1)

The method of claim 1, wherein the resolution increase model comprises a generator model and a discriminator model,
wherein the training of the radar resolution increase model comprises:
generating a temporary high-resolution output from the low-resolution training input based on the generator model;
training the generator model and the discriminator model based on a result output by the discriminator model from the temporary high-resolution output, the high-resolution training ground truth, and DoA information estimated based on subspace type-based estimation; and
in response to the training being completed, removing the discriminator model from the radar resolution increase model.

### Claim 12

A processor-implemented radar data processing method comprising:
generating, by a radar sensor, raw radar data based on transmission of a radar signal by the sensor and reception of a radar signal by the sensor; and
generating high-resolution output data from input data generated by preprocessing the generated raw radar data based on a trained radar resolution increase model.

### Claim 13 (depends on 12)

The method of claim 12, wherein the generating of the high-resolution output data comprises:
generating the input data by performing a range fast Fourier transform (FFT) process and a digital beamforming (DBF) process on the raw radar data.

### Claim 14 (depends on 12)

The method of claim 12, wherein the generating of the high-resolution output data comprises:
generating, as the input data, one of a range-Doppler map and a range-angle map; and
outputting, as the high-resolution output data, a map of a same type as a type of the input data from a map generated as the input data based on the resolution increase model.

### Claim 15 (depends on 12)

The method of claim 12, wherein the radar sensor is implemented in a mobile terminal,
wherein the generating of the raw radar data comprises:
generating, by the radar sensor, the raw radar data by transmitting a radar signal to at least a portion of an object and receiving a radar signal reflected from the portion of the object, and
the method further comprising:
recognizing at least one of a gesture associated with the object or an identity of the object based on the high-resolution output data, and indicating a result of the recognizing.

### Claim 16 (depends on 12)

The method of claim 12, wherein the radar sensor is implemented as a plurality of radar sensors in a vehicle,
the method further comprising:
transferring low-resolution raw radar data from the plurality of radar sensors to a central processor;
generating, by the central processor, the high-resolution output data from the low-resolution raw radar data based on the radar resolution increase model; and
generating driving-related information based on the generated high-resolution output data.

### Claim 17 (depends on 1)

A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform the method of claim 1.

### Claim 18

A training device comprising:
a memory configured to store a resolution increase model; and
a processor configured to receive original raw radar data, and generate a high-resolution training ground truth and a low-resolution training input from the original raw radar data based on information corresponding to at least one of dimensions defining the original raw radar data, and train the resolution increase model such that the high-resolution training ground truth is output from the low-resolution training input.

### Claim 19

A processor-implemented training method comprising:
transmitting, by a sensor, a radar signal to an object;
receiving a reflection of the transmitted radar signal from the object;
generating raw radar data from the received reflection of the transmitted radar signal;
perform a high-resolution preprocessing operation on the raw radar data to generate a high-resolution training ground truth data;
performing a low-resolution preprocessing operation on low-resolution radar data selected from the raw radar data to generate a low-resolution training input; and
training a generator model and a discriminator model based on the low-resolution training input, the high-resolution training ground truth, and direction-of-arrival (DoA) information estimated based on subspace type-based estimation.

### Claim 20 (depends on 19)

The method of claim 19, wherein the high-resolution preprocessing operation comprising one or more of a range fast Fourier transform (FFT) process, a digital beamforming (DBF) process, and a non-coherent integration process.
