# US 2022/0044436 A1 · Pose data processing method and system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044436 A1
- Document ID: US20220044436A1
- Status: Published application
- Kind: A1
- Application number: 17/451,838
- Filed: 2021-10-22
- Published: 2022-02-10
- Earliest claimed: 2019-04-25
- Assignees: Beijing Didi Infinity Technology and Development Co., Ltd.
- Applicants: Beijing Didi Infinity Technology and Development Co., Ltd.
- Inventors: Sheng Yang; Teng Ma
- Web page: https://patentgrep.com/patent/US20220044436A1

## CPC

- G06F 16/29: Geographical information databases
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G01C 21/16: by integrating acceleration or speed, i.e. inertial navigation
- G01C 21/32: Structuring or formatting of map data
- G01S 19/42: Determining position
- G01S 19/45: by combining measurements of signals from the satellite radio beacon positioning system with a supplementary measurement
- G01S 19/47: the supplementary measurement being an inertial measurement, e.g. tightly coupled inertial
- G06F 16/9024: {Graphs; Linked lists (G06F16/9027 takes precedence)}
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 2200/04: involving 3D image data
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES

## Abstract

The present application is directed to a method and a system for processing pose data. The method and the system may be applied to a map generation device, the map generation device being coupled to a global positioning system and a pose sensing system, the global positioning system being configured for outputting positioning data, the pose sensing system being configured for outputting motion pose data, and the positioning data and the motion pose data being combined to generate pose estimation data. The method for processing pose data includes: determining, in response to generated positioning data, positioning accuracy information corresponding to the positioning data; determining a degree of confidence of the pose estimation data according to the positioning accuracy information; and generating optimized pose data by processing the pose estimation data according to the degree of the confidence of the pose estimation data.

## Claims

### Claim 1

A method for processing pose data; the method being applied to a map generation device, the map generation device being coupled to a global positioning system and a pose sensing system, the global positioning system being configured for outputting positioning data; the pose sensing system being configured for outputting motion pose data, and the positioning data and the motion pose data being combined to generate pose estimation data, wherein the method for processing pose data comprises:
determining; in response to the generated positioning data, positioning accuracy information corresponding to the positioning data;
determining a degree of confidence of the pose estimation data according to the positioning accuracy information; and
generating optimized pose data by processing the pose estimation data according to the degree of the confidence of the pose estimation data.

### Claim 2 (depends on 1)

The method of claim 1; wherein the determining a degree of the confidence of the pose estimation data according to the positioning accuracy information comprises:
generating front-end mileage estimation data and a covariance matrix corresponding to the pose estimation data by inputting the positioning accuracy information, the positioning data, and the motion pose data into an Unscented Kalman Filter (UKF);
determining one or more groups of point clouds by performing a time-space coherence division on the front-end mileage estimation data, and constructing a corresponding pose graph according to each of the one or more groups of point clouds; and
determining the degree of the confidence of the pose estimation data based on the covariance matrix and the pose graph.

### Claim 3 (depends on 2)

The method of claim 2, wherein the determining one or more groups of point clouds by performing a time-space coherence division on the front-end mileage estimation data, and constructing a corresponding pose graph according to each of the one or more groups of point clouds comprise;
determining edges of a first type in the pose graph by dividing the front-end mileage estimation data according to a preset time interval;
determining edges of a second type in the pose graph by dividing the front-end mileage estimation data according to a preset space interval; and
resolving a motion trajectory from the motion pose data, generating, through splicing, each of the one or more groups of point clouds according to a continuity of the motion trajectory, and determining a first frame of point cloud in each group of point clouds as a vertex of the pose graph.

### Claim 4 (depends on 3)

The method of claim 3, wherein the determining the degree of the confidence of the pose estimation data based on the covariance matrix and the pose graph comprises:
determining an inverse matrix of the covariance matrix output by the Unscented Kalman Filter, and recording the inverse matrix as an information matrix of the edges of the first type; and
determining another inverse matrix of the covariance matrix generated during registration by performing a registration on any two groups of point clouds in the one or more groups of point clouds, and recording the another inverse matrix as an information matrix of the edges of the second type.

### Claim 5 (depends on 4)

The method of claim 4, wherein the determining an inverse matrix of the covariance matrix output by the Unscented Kalman Filter, and recording the inverse matrix as an information matrix of the edges of the first type comprise:
determining the information matrix of the edges of the first type according to at least one of at least one preset hardware parameter of the map generation device or a signal intensity of the positioning data.

### Claim 6 (depends on 4)

The method of claim 4, wherein the generating optimized pose data by processing the pose estimation data according to the degree of the confidence of the pose estimation data comprises:
correcting a three-dimensional position of each group of point clouds in the pose graph according to the information matrix of the edges of the first type and the information matrix of the edges of the second type.

### Claim 7 (depends on 5)

The method of claim 5, wherein the determining the information matrix of the edges of the first type according to at least one of at least one preset hardware parameter of the map generation device or a signal intensity of the positioning data comprises:
determining a parameter dimension of the pose estimation data according to at least one of the preset hardware parameter of the map generation device or the signal intensity of the positioning data; and
setting a preset weight corresponding to the parameter dimension as a value of a diagonal matrix, and determining the information matrix of the edges of the first type according to the diagonal matrix.

### Claim 8 (depends on 7)

The method of claim 7, wherein
the parameter dimension comprises at least one of an absolute position in the north, an absolute position in the east, an absolute position towards ground, a roll angle, a pitch angle, or a yaw angle.

### Claim 9 (depends on 1)

The method of claim 1, wherein
the pose sensing system comprises at least one of a vision sensor, a laser sensor, or an inertial sensor.

### Claim 10

A system for processing pose data, the system being applied to a map generation device, the map generation device being coupled to a global positioning system and a pose sensing system, the global positioning system being configured for outputting positioning data, the pose sensing system being configured for outputting motion pose data, and the positioning data and the motion pose data being combined to generate pose estimation data, wherein the system for processing pose data comprises:
at least one memory for storing a computer instruction; and
at least one processor in communication with the memory, wherein when the at least one processor executes the computer instruction, the at least one processor enables the system to execute:
determining, in response to generated positioning data, positioning accuracy information corresponding to the positioning data;
determining a degree of confidence of the pose estimation data according to the positioning accuracy information; and
generating optimized pose data by processing the pose estimation data according to the degree of the confidence of the pose estimation data.

### Claim 11 (depends on 10)

The system of claim 10, wherein in order to determine the degree of the confidence of the pose estimation data, the at least one processor enables the system to further execute:
generating front-end mileage estimation data and a covariance matrix corresponding to the pose estimation data by inputting the positioning accuracy information, the positioning data and the motion pose data into an Unscented Kalman Filter (UKF);
determining one or more groups of point clouds by performing a time-space coherence division on the front-end mileage estimation data, and constructing a corresponding pose graph according to each of the one or more groups of point clouds; and
determining the degree of the confidence of the pose estimation data based on the covariance matrix and the pose graph.

### Claim 12 (depends on 11)

The system of claim 11, wherein in order to construct the corresponding pose graph according to each group of point clouds, the at least one processor enables the system to further execute:
determining edges of a first type in the pose graph by dividing the front-end mileage estimation data according to a preset time interval;
determining edges of a second type in the pose graph by dividing the front-end mileage estimation data according to a preset space interval; and
resolving a motion trajectory from the motion pose data, generating, through splicing, each of the one or more groups of point clouds according to a continuity of the motion trajectory, and determining a first frame of point cloud in each group of point clouds as a vertex of the pose graph.

### Claim 13 (depends on 12)

The system of claim 12, wherein in order to determine the degree of the confidence of the pose estimation data based on the covariance matrix and the pose graph, the at least one processor enables the system to further execute:
determining an inverse matrix of the covariance matrix output by the Unscented Kalman Filter, and recording the inverse matrix as an information matrix of the edges of the first type; and
determining another inverse matrix of the covariance matrix generated during registration by performing a registration on any two groups of point clouds in the one or more groups of point clouds, and recording the another inverse matrix as an information matrix of the edges of the second type.

### Claim 14 (depends on 13)

The system of claim 13, wherein in order to determine the inverse matrix of the covariance matrix output by the Unscented Kalman Filter, and record the inverse matrix as the information matrix of the edges of the first type, the at least one processor enables the system to further execute:
determining the information matrix of the edges of the first type according to at least one of at least one preset hardware parameter of the map generation device or a signal intensity of the positioning data.

### Claim 15 (depends on 13)

The system of claim 13, wherein in order to generate optimized pose data by processing the pose estimation data according to the degree of the confidence of the pose estimation data, the at least one processor enables the system to further execute:
correcting a three-dimensional position of each group of point clouds in the pose graph according to the information matrix of the edges of the first type and the information matrix of the edges of the second type.

### Claim 16 (depends on 14)

The system f claim 14, wherein in order to determine the information matrix of the edges of the first type according to at least one of the at least one preset hardware parameter of the map generation device or the signal intensity of the positioning data, the at least one processor enables the system to further execute:
determining a parameter dimension of the pose estimation data according to at least one of the preset hardware parameter of the map generation device or the signal intensity of the positioning data; and
setting a preset weight corresponding to the parameter dimension as a value of a diagonal matrix, and determining the information matrix of the edges of the first type according to the diagonal matrix.

### Claim 17 (depends on 16)

The system of claim 16, wherein
the parameter dimension comprises at least one of an absolute position in the north, absolute position in the east, an absolute position towards ground, a roll angle, a pitch angle and a yaw angle.

### Claim 18 (depends on 10)

The system of claim 10, wherein
the pose sensing system comprises at least one of a vision sensor, a laser sensor, or an inertial sensor.

### Claim at position 19

19-20. (canceled)

### Claim 21

A non-transitory computer readable storage medium, comprising a set of instructions for processing pose data, wherein when executed by at least one processor, the set of instructions directs the at least one processor to:
determine, in response to generated positioning data, positioning accuracy information corresponding to positioning data;
determine a degree of the confidence of pose estimation data according to the positioning accuracy information; and
generating optimized pose data by processing the pose estimation data according to the degree of the confidence of the pose estimation data.

### Claim 22 (depends on 21)

The non-transitory computer readable storage medium of claim 21, wherein determining the degree of the confidence of the pose estimation data according to the positioning accuracy information comprises:
generating front-end mileage estimation data and a covariance matrix corresponding to the pose estimation data by inputting the positioning accuracy information, the positioning data and motion pose data into an Unscented Kalman Filter (UKF);
determining one or more groups of point clouds by performing a time-space coherence division on the front-end mileage estimation data, and constructing a corresponding pose graph according to each of the one or more groups of point clouds; and
determining the degree of the confidence of the pose estimation data based on the covariance matrix and the pose graph.
