# US 2025/0148762 A1 · Apparatus for building a deep learning model for image learning, and a method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148762 A1
- Document ID: US20250148762A1
- Status: Published application
- Kind: A1
- Application number: 18/774,313
- Filed: 2024-07-16
- Published: 2025-05-08
- Earliest claimed: 2023-11-06
- Assignees: Hyundai Motor Company; Kia Corporation
- Applicants: Hyundai Motor Company; Kia Corporation
- Inventors: Jun Yong Choi; Jae Hoon Cho; Jae Hyeon Park; Hyun Kook Park
- Web page: https://patentgrep.com/patent/US20250148762A1

## CPC

- G06V 10/771: Feature selection, e.g. selecting representative features from a multi-dimensional feature space
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/82: using neural networks
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An apparatus for building a deep learning model for image learning includes a first deep learning model configured to obtain a first spatial feature map and a first heatmap including center information of an object belonging to an image by learning the image. The apparatus also includes a second deep learning model configured to perform imitation learning on the first deep learning model. The second deep learning model may obtain a second spatial feature map by learning the image and perform learning such that the second spatial feature map imitates the first spatial feature map. The second deep learning model may also obtain a second heatmap including a center of the object and perform learning such that the second heatmap imitates the first heatmap.

## Claims

### Claim 1

An apparatus, comprising:
a memory configured to store program instructions; and
a processor configured to execute the program instructions to implement a first deep learning model and a second deep learning model;
wherein the first deep learning model configured to
obtain a first spatial feature map by learning an image, and
obtain a first heatmap including center information of an object belonging to the image by learning the image; and
wherein the second deep learning model configured to
obtain a second spatial feature map by learning the image,
perform learning such that the second spatial feature map imitates the first spatial feature map,
obtain a second heatmap including a center of the object, and
perform learning such that the second heatmap imitates the first heatmap.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the second deep learning model is configured to:
output the second spatial feature map through a backbone.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein:
the first deep learning model is configured to
obtain a first representative feature value of feature values arranged in a straight direction in the first spatial feature map, and
obtain a first feature vector of a single row by sorting the first representative feature value; and
the second deep learning model is configured to
obtain a second representative feature value of feature values arranged in a straight direction in the second spatial feature map,
obtain a second feature vector of a single row by sorting the second representative feature value, and
perform imitation learning to reduce a difference between the second feature vector and the first feature vector.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein:
the first deep learning model is configured to
obtain a first height feature value based on the feature values having x-axis coordinate values same as each other,
obtain a first height feature vector based on the first height feature value,
obtain a first width feature value based on the feature values having y-axis coordinate values same as each other, and
obtain a first width feature vector based on the first width feature value; and
the second deep learning model is configured to
obtain a second height feature value based on the feature values having the x-axis coordinate values same as each other,
obtain a second height feature vector based on the second height feature value,
obtain a second width feature value based on the feature values having the y-axis coordinate values same as each other, and
obtain a second width feature vector based on the second width feature value.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the second deep learning model is configured to:
perform learning to reduce a difference between the second height feature vector and the first height feature vector; and
perform learning to reduce a difference between the second width feature vector and the first width feature vector.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein:
the first deep learning model is configured to
obtain a first height distribution by normalizing the first height feature vector, and
obtain a first width distribution by normalizing the first width feature vector; and
the second deep learning model is configured to
obtain a second height distribution by normalizing the second height feature vector,
obtain a second width distribution by normalizing the second width feature vector, and
perform learning such that the second height distribution imitates the first height distribution and the second width distribution imitates the first width distribution.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the second deep learning model is configured to:
output the second heatmap through a head.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein:
the first deep learning model is configured to
obtain a first representative center value of center values arranged in a straight direction in the first heatmap, and
obtain a first center vector of a single row by sorting the first representative center value; and
the second deep learning model is configured to
obtain a second representative center value of center values arranged in a straight direction in the second heatmap,
obtain a second center vector of a single row by sorting the second representative center value, and
perform imitation learning to reduce a difference between the second center vector and the first center vector.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein:
the first deep learning model is configured to
obtain a first height center value based on the center values having x-axis coordinate values same as each other,
obtain a first height center vector based on the first height center value,
obtain a first width center value based on the center values having y-axis coordinate values same as each other, and
obtain a first width center vector based on the first width center value; and
the second deep learning model is configured to
obtain a second height center value based on the center values having the x-axis coordinate values same as each other,
obtain a second height center vector based on the second height center value,
obtain a second width center value based on the center values having the y-axis coordinate values same as each other, and
obtain a second width center vector based on the second width center value.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the second deep learning model is configured to:
perform learning to reduce a difference between the second height center vector and the first height center vector; and
perform learning to reduce a difference between the second width center vector and the first width center vector.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein:
the first deep learning model is configured to
obtain a first height distribution by normalizing the first height center vector, and
obtain a first width distribution by normalizing the first width center vector; and
the second deep learning model is configured to
obtain a second height distribution by normalizing the second height center vector,
obtain a second width distribution by normalizing the second width center vector, and
perform learning such that the second height distribution imitates the first height distribution and the second width distribution imitates the first width distribution.

### Claim 12

A method comprising:
obtaining a first spatial feature map and a first heatmap including center information of an object belonging to an image by learning the image based on a first deep learning model;
obtaining a second spatial feature map by learning the image based on a second deep learning model;
performing learning of the second deep learning model such that the second spatial feature map imitates the first spatial feature map;
obtaining a second heatmap including a center of the object based on the second deep learning model; and
performing learning of the second deep learning model such that the second heatmap imitates the first heatmap.

### Claim 13 (depends on 12)

The method of claim 12, wherein performing learning of the second deep learning model such that the second spatial feature map imitates the first spatial feature map includes:
obtaining a first representative feature value of feature values arranged in a straight direction in the first spatial feature map;
obtaining a first feature vector of a single row by sorting the first representative feature value;
obtaining a second representative feature value of feature values arranged in a straight direction in the second spatial feature map;
obtaining a second feature vector of a single row by sorting the second representative feature value; and
learning the second deep learning model to reduce a difference between the second feature vector and the first feature vector.

### Claim 14 (depends on 13)

The method of claim 13, wherein:
obtaining the first feature vector includes
obtaining a first height feature value based on the feature values having x-axis coordinate values same as each other,
obtaining a first height feature vector based on the first height feature value,
obtaining a first width feature value based on the feature values having y-axis coordinate values same as each other, and
obtaining a first width feature vector based on the first width feature value; and
obtaining of the second feature vector includes
obtaining a second height feature value based on the feature values having the x-axis coordinate values same as each other,
obtaining a second height feature vector based on the second height feature value,
obtaining a second width feature value based on the feature values having the y-axis coordinate values same as each other, and
obtaining a second width feature vector based on the second width feature value.

### Claim 15 (depends on 14)

The method of claim 14, wherein performing learning of the second deep learning model such that the second spatial feature map imitates the first spatial feature map includes:
performing learning to reduce a difference between the second height feature vector and the first height feature vector; and
performing learning to reduce a difference between the second width feature vector and the first width feature vector.

### Claim 16 (depends on 15)

The method of claim 15, wherein performing learning of the second deep learning model such that the second spatial feature map imitates the first spatial feature map further includes:
obtaining a first height distribution by normalizing the first height feature vector;
obtaining a first width distribution by normalizing the first width feature vector;
obtaining a second height distribution by normalizing the second height feature vector;
obtaining a second width distribution by normalizing the second width feature vector; and
performing learning of the second deep learning model such that the second height distribution imitates the first height distribution and the second width distribution imitates the first width distribution.

### Claim 17 (depends on 12)

The method of claim 12, wherein performing learning of the second deep learning model such that the second heatmap imitates the first heatmap includes:
obtaining, by the first deep learning model, a first representative center value of center values arranged in a straight direction in the first heatmap;
obtaining, by the first deep learning model, a first center vector of a single row by sorting the first representative center value;
obtaining, by the second deep learning model, a second representative center value of center values arranged in a straight direction in the second heatmap;
obtaining, by the second deep learning model, a second center vector of a single row by sorting the second representative center value; and
performing, by the second deep learning model, imitation learning to reduce a difference between the second center vector and the first center vector.

### Claim 18 (depends on 17)

The method of claim 17, wherein performing learning of the second deep learning model such that the second heatmap imitates the first heatmap includes:
obtaining, by the first deep learning model, a first height center value based on the center values having x-axis coordinate values same as each other;
obtaining, by the first deep learning model, a first height center vector based on the first height center value;
obtaining, by the first deep learning model, a first width center value based on the center values having y-axis coordinate values same as each other, and obtaining a first width center vector based on the first width center value;
obtaining, by the second deep learning model, a second height center value based on the center values having the x-axis coordinate values same as each other;
obtaining, by the second deep learning model, a second height center vector based on the second height center value;
obtaining, by the second deep learning model, a second width center value based on the center values having the y-axis coordinate values same as each other; and
obtaining, by the second deep learning model, a second width center vector based on the second width center value.

### Claim 19 (depends on 18)

The method of claim 18, wherein performing learning of the second deep learning model such that the second heatmap imitates the first heatmap includes:
learning the second deep learning model to reduce a difference between the second height center vector and the first height center vector; and
learning the second deep learning model to reduce a difference between the second width center vector and the first width center vector.

### Claim 20 (depends on 19)

The method of claim 19, wherein performing learning of the second deep learning model such that the second heatmap imitates the first heatmap includes:
obtaining, by the first deep learning model, a first height distribution by normalizing the first height center vector;
obtaining, by the first deep learning model, a first width distribution by normalizing the first width center vector;
obtaining, by the second deep learning model, a second height distribution by normalizing the second height center vector;
obtaining, by the second deep learning model, a second width distribution by normalizing the second width center vector; and
performing, by the second deep learning model, learning such that the second height distribution imitates the first height distribution and the second width distribution imitates the first width distribution.
