# US 2021/0333400 A1 · Method and apparatus for generating image using lidar

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0333400 A1
- Document ID: US20210333400A1
- Status: Published application
- Kind: A1
- Application number: 16/324,956
- Filed: 2019-01-02
- Published: 2021-10-28
- Earliest claimed: 2018-08-27
- Assignees: Research Cooperation Foundation of Yeungnam University
- Applicants: Research Cooperation Foundation of Yeungnam University
- Inventors: Hyun Koo KIM; Ho Youl JUNG; Kook Yeol YOO; Ju Hyun PARK
- Web page: https://patentgrep.com/patent/US20210333400A1

## CPC

- G01S 17/89: for mapping or imaging
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 17/931: of land vehicles
- G06T 7/00: Image analysis
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20084: Artificial neural networks [ANN]
- H04N 13/15: for colour aspects of image signals
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

According to an aspect of embodiments, a method of generating an image by using LiDAR includes performing a reconstruction of a two-dimensional reflection intensity image, the performing of the reconstruction including projecting three-dimensional reflection intensity data that are measured by using the LiDAR as the two-dimensional reflection intensity image, and the method includes generating a color image by applying a projected two-dimensional reflection intensity image to a Fully Convolutional Network (FCN).

## Claims

### Claim 1

A method of generating an image by using LiDAR, the method comprising:
performing a reconstruction of a two-dimensional reflection intensity image, comprising:
projecting three-dimensional reflection intensity data that are measured by using the LiDAR onto the two-dimensional reflection intensity image; and
generating a color image by applying a projected two-dimensional reflection intensity image to a deep learning network.

### Claim 2 (depends on 1)

The method of claim 1, wherein the deep learning network is a Fully Convolutional Network (FCN).

### Claim 3 (depends on 1)

The method of claim 1, wherein the deep learning network includes an encoding process and a decoding process, the encoding process and the decoding process being performed asymmetrically with respect to each other.

### Claim 4 (depends on 1)

The method of claim 1, wherein the deep learning network comprises a network trained by using a shadowless image as an original image.

### Claim 5 (depends on 1)

The method of claim 1, wherein the generating of the color image by applying the projected two-dimensional reflection intensity image to the deep learning network comprises:
applying the projected two-dimensional reflection intensity image and a measured distance to the deep learning network to generate a color image.

### Claim 6 (depends on 1)

The method of claim 1, wherein the projected two-dimensional reflection intensity image is represented by a value between 0 and 1, or between −1 and 1, and
wherein the color image is represented by a value between 0 and 255.

### Claim 7

An apparatus for generating an image by using LiDAR, the apparatus comprising:
a LiDAR projection image generation unit configured to reconstruct a two-dimensional reflection intensity image by projecting three-dimensional reflection intensity data that are measured by using the LiDAR onto the two-dimensional reflection intensity image; and
an image generation unit using a deep learning network configured to generate a color image by applying a projected two-dimensional reflection intensity image to a deep learning network.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the deep learning network is a Fully Convolutional Network (FCN).

### Claim 9 (depends on 7)

The apparatus of claim 7, wherein the deep learning network includes an encoding unit and a decoding unit, the encoding unit and the decoding unit being configured asymmetrically with respect to each other.

### Claim 10 (depends on 7)

The apparatus of claim 7, wherein the deep learning network comprises a network trained by using a shadowless image as an original image.

### Claim 11 (depends on 7)

The apparatus of claim 7, wherein the image generation unit using the deep learning network is configured to generate a color image by applying the projected two-dimensional reflection intensity image and a measured distance to the deep learning network.

### Claim 12 (depends on 8)

The apparatus of claim 8, wherein the projected two-dimensional reflection intensity image is represented by a value between 0 and 1, or between −1 and 1, and
wherein the color image is represented by a value between 0 and 255.
