# US 2025/0157206 A1 · Method and apparatus with map construction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157206 A1
- Document ID: US20250157206A1
- Status: Published application
- Kind: A1
- Application number: 18/946,809
- Filed: 2024-11-13
- Published: 2025-05-15
- Earliest claimed: 2023-11-15
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Yi ZHOU; Hui ZHANG; Byung In YOO; Seungin PARK; Sangil JUNG; Xiaoshuai HAO
- Web page: https://patentgrep.com/patent/US20250157206A1

## CPC

- G06V 10/806: {of extracted features}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/7715: {Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods}
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/82: using neural networks
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A high-definition (HD) map-related map construction method, electronic device, and storage medium are provided. The method includes: extracting a bird's-eye view (BEV) feature map based on the data; determining map information through a hybrid decoder based on the BEV feature map and a hybrid query; and constructing an HD map corresponding to the data based on the map information, wherein the map includes a plurality of map elements each including an area formed by a plurality of coordinate points in the map, the map information comprises coordinate information and class information of the plurality of map elements, and the hybrid query includes a plurality of hybrid features each corresponding to one map element and including a point feature and an element feature. Optionally, the method may be executed using an artificial intelligence (AI) model.

## Claims

### Claim 1

A method with map construction, comprising:
extracting a bird's-eye view (BEV) feature map based on input data;
determining map information through a hybrid decoder based on the BEV feature map and a hybrid query; and
constructing a high-definition (HD) map corresponding to the input data based on the map information,
wherein the HD map comprises a plurality of map elements,
wherein the map information comprises coordinate information and class information of the plurality of map elements,
wherein each of the plurality of map elements comprises an area formed by a plurality of coordinate points in the HD map,
wherein the hybrid query comprises a plurality of hybrid features,
wherein each of the plurality of hybrid features comprises a point feature and an element feature corresponding to a map element,
wherein the point feature represents information associated with each coordinate point of the map element, and
wherein the element feature represents information associated with the map element.

### Claim 2 (depends on 1)

The method of claim 1, wherein the determining of the map information through the hybrid decoder based on the BEV feature map and the hybrid query comprises:
decomposing the hybrid query into a first point query and a first element query, wherein the first point query comprises a first point feature corresponding to each coordinate point of each map element, and the first element query comprises a first element feature corresponding to each map element;
determining a second point query and a second element query, based on the BEV feature map, the first point query, the first element query, and current map information;
updating the hybrid query by fusing the second point query and the second element query; and
iteratively updating the current map information based on the BEV feature map and the updated hybrid query to generate final map information,
wherein the constructing of the HD map corresponding to the input data based on the map information comprises:
constructing the HD map corresponding to the input data based on the final map information.

### Claim 3 (depends on 2)

The method of claim 2, wherein the determining of the second point query and the second element query, based on the BEV feature map, the first point query, the first element query, and the current map information comprises:
for each of a plurality of anchor points, determining a second point feature based on the BEV feature map, the first point feature, and coordinate information of a corresponding anchor point, wherein the corresponding anchor point comprises a coordinate point corresponding to the first point feature;
obtaining the second point query by fusing determined second point features;
for each of the map elements, determining a second element feature of a corresponding map element, based on the BEV feature map, a first point feature of the corresponding map element, and coordinate information of each of a plurality of anchor points of the corresponding map element; and
obtaining the second element query by fusing determined second element features.

### Claim 4 (depends on 3)

The method of claim 3, wherein the determining of the second point feature based on the BEV feature map, the first point feature, and the coordinate information of the corresponding anchor point, for each of the plurality of anchor points, comprises:
for each of the plurality of anchor points, determining a plurality of sampling points associated with the corresponding anchor point on the HD map, based on the coordinate information of the anchor point and the first point feature;
obtaining a third point feature through fusion based on the BEV feature map and coordinate information and a weight of each of the plurality of sampling points; and
determining the second point feature based on the first point feature and the third point feature.

### Claim 5 (depends on 4)

The method of claim 4, wherein the determining of the plurality of sampling points associated with the corresponding anchor point on the HD map, based on the coordinate information of the anchor point and the first point feature, for each of the plurality of anchor points, comprises:
determining a fourth point feature based on the coordinate information of the corresponding anchor point and the first point feature;
determining a sampling offset and the weight of each of the plurality of sampling points based on the fourth point feature, wherein the sampling offset represents a degree of positional offset of a sampling point corresponding to the anchor point; and
determining coordinate information of each of the plurality of sampling points, based on the coordinate information of the anchor point and the sampling offset of each of the plurality of sampling points.

### Claim 6 (depends on 5)

The method of claim 5, wherein the determining of the fourth point feature based on the coordinate information of the corresponding anchor point and the first point feature comprises:
obtaining a position embedding by encoding the coordinate information of the corresponding anchor point; and
determining the fourth point feature, based on the first point feature and the position embedding.

### Claim 7 (depends on 4)

The method of claim 4, wherein the obtaining of the third point feature through the fusion based on the BEV feature map and the coordinate information and the weight of each of the plurality of sampling points comprises:
determining a sampling feature corresponding to each of the plurality of sampling points, based on the BEV feature map and the coordinate information of each of the plurality of sampling points; and
obtaining the third point feature by fusing determined sampling features respectively corresponding to the plurality of sampling points, based on the weight of each of the plurality of sampling points.

### Claim 8 (depends on 3)

The method of claim 3, wherein the determining of the second element feature of the corresponding map element based on the BEV feature map, the first element feature of the corresponding map element, and the coordinate information of each of the plurality of anchor points of the corresponding map element, for each of the map elements, comprises:
for each of the map elements, obtaining a position embedding of each of the plurality of anchor points by encoding the coordinate information of each of the plurality of anchor points;
obtaining a position embedding of the corresponding map element by fusing obtained respective position embeddings of the plurality of anchor points; and
determining the second element feature of the corresponding map element, using a masked-attention module of the hybrid decoder, based on the BEV feature map, the first element feature, and the position embedding of the corresponding map element,
wherein a mask of the masked-attention module is obtained based on mask information of each pixel,
wherein the mask information represents a probability that each pixel belongs to the corresponding map element.

### Claim 9 (depends on 2)

The method of claim 2, wherein the iteratively updating of the hybrid query by fusing the second point query and the second element query comprises:
obtaining a fifth point query and a fifth element query by processing the second point query and the second element query, respectively, using a self-attention module of the hybrid decoder;
obtaining a sixth element query by transforming the fifth point query into the same dimension as the fifth element query and fusing the fifth element query and the transformed fifth point query;
obtaining a sixth point query by transforming the fifth element query into the same dimension as the fifth point query and fusing the fifth point query and the transformed fifth element query; and
obtaining the updated hybrid query by fusing the sixth point query and the sixth element query.

### Claim 10 (depends on 1)

The method of claim 1, wherein a loss function used by the hybrid decoder during a training process comprises a point-element consistency loss,
wherein the point-element consistency loss is used to represent a level of risk of inconsistency between a point query and an element query of the updated hybrid query.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
determining a value of the point-element inconsistency loss,
wherein the determining of the value of the point-element inconsistency loss comprises:
obtaining point-level information and element-level information by transforming the point query and the element query of the updated hybrid query, respectively;
obtaining pseudo-element-level information by fusing coordinate point information, in the point-level information, belonging to a same map element; and
determining the value of the point-element consistency loss based on the pseudo-element-level information and the element-level information such that it represents a level of risk of inconsistency between the pseudo-element level information and the element level information.

### Claim 12 (depends on 10)

The method of claim 10, wherein the loss function used by the hybrid decoder during the training process further comprises at least one of a semantic segmentation loss, a classification loss, a point regression loss, a point orientation loss, or a mask loss.

### Claim 13

An electronic device, comprising:
at least one processor; and
at least one memory storing computer-executable instructions,
wherein, when the instructions are executed by the at least one processor, the at least one processor is configured to:
extract a bird's-eye view (BEV) feature map based on the input data;
determine map information through a hybrid decoder based on the BEV feature map and a hybrid query; and
construct a high-definition (HD) map corresponding to the input data based on the map information,
wherein the HD map comprises a plurality of map elements,
wherein the map information comprises coordinate information and class information of the plurality of map elements,
wherein each of the plurality of map elements comprises an area formed by a plurality of coordinate points in the HD map,
wherein the hybrid query comprises a plurality of hybrid features,
wherein each of the plurality of hybrid features comprises a point feature and an element feature corresponding to a map element,
wherein the point feature represents information associated with each coordinate point of the map element, and
the element feature represents information associated with the map element.

### Claim 14 (depends on 1)

A computer-readable storage medium storing instructions, wherein the instructions, when executed by at least one processor, cause the at least one processor to implement the method of claim 1.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
using at least one sensor to collect sensor data as the input data.

### Claim 16 (depends on 13)

The electronic device of claim 13, wherein, in the determining of the map information through the hybrid decoder based on the BEV feature map and the hybrid query, the at least one processor is further configured to:
decompose the hybrid query into a first point query and a first element query, wherein the first point query comprises a first point feature corresponding to each coordinate point of each map element, and the first element query comprises a first element feature corresponding to each map element;
determine a second point query and a second element query, based on the BEV feature map, the first point query, the first element query, and current map information;
updating the hybrid query by fusing the second point query and the second element query; and
iteratively update the current map information based on the BEV feature map and the updated hybrid query to generate final map information,
wherein in the constructing of the HD map corresponding to the input data based on the map information, the at least one processor is further configured to:
construct the HD map corresponding to the input data based on the final map information.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein in the determining of the second point query and the second element query, based on the BEV feature map, the first point query, the first element query, and the current map information, the at least one processor is further configured to:
for each of a plurality of anchor points, determine a second point feature based on the BEV feature map, the first point feature, and coordinate information of a corresponding anchor point, wherein the corresponding anchor point comprises a coordinate point corresponding to the first point feature;
obtain the second point query by fusing determined second point features;
for each of the map elements, determine a second element feature of a corresponding map element, based on the BEV feature map, a first point feature of the corresponding map element, and coordinate information of each of a plurality of anchor points of the corresponding map element; and
obtain the second element query by fusing determined second element features.

### Claim 18 (depends on 17)

The electronic device of claim 17, wherein in the determining of the second point feature based on the BEV feature map, the first point feature, and the coordinate information of the corresponding anchor point, for each of the plurality of anchor points, the at least one processor is further configured to:
for each of the plurality of anchor points, determine a plurality of sampling points associated with the corresponding anchor point on the HD map, based on the coordinate information of the anchor point and the first point feature;
obtain a third point feature through fusion based on the BEV feature map and coordinate information and a weight of each of the plurality of sampling points; and
determine the second point feature based on the first point feature and the third point feature.

### Claim 19 (depends on 18)

The electronic device of claim 18, wherein in the determining of the plurality of sampling points associated with the corresponding anchor point on the HD map, based on the coordinate information of the anchor point and the first point feature, for each of the plurality of anchor points, the at least one processor is further configured to:
determine a fourth point feature based on the coordinate information of the corresponding anchor point and the first point feature;
determine a sampling offset and the weight of each of the plurality of sampling points based on the fourth point feature, wherein the sampling offset represents a degree of positional offset of a sampling point corresponding to the anchor point; and
determine coordinate information of each of the plurality of sampling points, based on the coordinate information of the anchor point and the sampling offset of each of the plurality of sampling points.

### Claim 20 (depends on 13)

The electronic device of claim 13, wherein a loss function used by the hybrid decoder during a training process comprises a point-element consistency loss,
wherein the point-element consistency loss is used to represent a level of risk of inconsistency between a point query and an element query of the updated hybrid query.
