# US 2020/0005068 A1 · System and method for improving the representation of line features

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0005068 A1
- Document ID: US20200005068A1
- Status: Published application
- Kind: A1
- Application number: 16/023,645
- Filed: 2018-06-29
- Published: 2020-01-02
- Earliest claimed: 2018-06-29
- Assignees: Toyota Research Institute, Inc.
- Applicants: Toyota Research Institute, Inc.
- Inventors: Paul J. Ozog
- Web page: https://patentgrep.com/patent/US20200005068A1

## CPC

- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- G06T 7/74: {involving reference images or patches}
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06F 18/251: {of input or preprocessed data}
- G06T 2207/30256: Lane; Road marking
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

System, methods, and other embodiments described herein relate to improving an electronic representation of lines. In one embodiment, a method includes, in response to acquiring sensor data from at least one sensor representing a surrounding environment of a robotic device, extracting a feature representation of an observed line feature in the sensor data by providing a probability distribution that is defined based, at least in part, on feature parameters that overparameterize the observed line feature. The method includes converting the feature representation of the observed line feature into reduced parameters to avoid the feature parameters overparameterizing the observed line feature. The reduced parameters include an observation uncertainty for the line feature that is based, at least part, on the probability distribution. The method includes providing a detection distribution according to a correlation between the reduced parameters and a mapped line feature.

## Claims

### Claim 1

A translation system for improving electronic representation of lines, comprising:
one or more processors;
a memory communicably coupled to the one or more processors and storing:
a sensor module including instructions that when executed by the one or more processors cause the one or more processors to, in response to acquiring sensor data from at least one sensor representing a surrounding environment of a robotic device, extract a feature representation of an observed line feature in the sensor data by providing a probability distribution that is defined based, at least in part, on feature parameters that overparameterize the observed line feature; and
a transform module including instructions that when executed by the one or more processors cause the one or more processors to convert the feature representation of the observed line feature into reduced parameters to avoid the feature parameters overparameterizing the observed line feature, wherein the reduced parameters include an observation uncertainty for the observed line feature that is based, at least part, on the probability distribution, and
wherein the transform module includes instructions to provide a detection distribution according to a correlation between the reduced parameters and a mapped line feature.

### Claim 2 (depends on 1)

The translation system of claim 1, wherein the transform module includes instructions to convert the feature representation including instructions to apply an unscented transform to estimate a non-linear transform between the feature parameters and the reduced parameters and provide the feature representation according to the reduced parameters including a vector with four values representing the observed line feature and a covariance matrix that is four-by-four in size and full-rank representing the observation uncertainty.

### Claim 3 (depends on 2)

The translation system of claim 2, wherein the transform module includes instructions to apply the unscented transform including instructions to:
i) compute an error between samples of the probability distribution by comparing inverse representation and standard representations of the observed line feature from the probability distribution, wherein computing the error includes determining differences between angular and positional values, wherein the samples are represented using the reduced parameters, and
ii) compute an average for the observed line feature over the samples, and
wherein applying the unscented transform produces the vector and the full-rank covariance matrix as an electronic output.

### Claim 4 (depends on 2)

The translation system of claim 2, wherein the transform module includes instructions to provide the covariance matrix as an electronic output that quantifies innovation between the observed line feature and the mapped line feature; and
wherein the transform module includes instructions to provide the detection distribution including instructions to estimate a location of the robotic device based, at least in part, on the covariance matrix.

### Claim 5 (depends on 1)

The translation system of claim 1, wherein the sensor module includes instructions to identify the mapped line feature from a feature map, the mapped line feature being represented according to the reduced parameters, wherein the transform module includes instructions to provide the detection distribution to indicate at least an estimation uncertainty for a correlation between the mapped line feature and the observed line feature that is a function of the observation uncertainty.

### Claim 6 (depends on 1)

The translation system of claim 1, wherein the sensor module includes instructions to acquire the observation including noise along with the observed line feature that at least partially distorts the observed line feature within the sensor data, and
wherein the reduced parameters include position and orientation parameters defining an azimuth and an elevation for the observed line feature.

### Claim 7 (depends on 1)

The translation system of claim 1, wherein the sensor data includes at least one of: a three-dimensional representation of the surrounding environment as a point cloud, and a camera image, and
wherein the feature parameters include at least six values defining endpoints of the observed line feature in Euclidean three-space.

### Claim 8 (depends on 1)

The translation system of claim 1, wherein the probability distribution is quantified in a six-by-six covariance matrix, and
wherein the reduced parameters include at least a full-rank covariance matrix that quantifies innovation of the observed line feature.

### Claim 9

A non-transitory computer-readable medium for improving an electronic representation of lines and including instructions that when executed by one or more processors cause the one or more processors to:
in response to acquiring sensor data from at least one sensor representing a surrounding environment of a robotic device, extract a feature representation of an observed line feature in the sensor data by providing a probability distribution that is defined based, at least in part, on feature parameters that overparameterize the observed line feature;
convert the feature representation of the observed line feature into reduced parameters to avoid the feature parameters overparameterizing the observed line feature, wherein the reduced parameters include an observation uncertainty for the line feature that is based, at least part, on the probability distribution; and
provide a detection distribution according to a correlation between the reduced parameters and a mapped line feature.

### Claim 10 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the instructions to convert the feature representation include instructions to apply an unscented transform to estimate a non-linear transform between the feature parameters and the reduced parameters and provide the feature representation according to the reduced parameters including a vector with four values representing the observed line feature and a full-rank covariance matrix that is four-by-four in size representing the observation uncertainty.

### Claim 11 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the instructions to apply the unscented transform include instructions to:
i) compute an error between samples of the probability distribution by comparing inverse representation and standard representations of the observed line feature from the probability distribution, wherein computing the error includes determining differences between angular and positional values, wherein the samples are represented using the reduced parameters, and
ii) compute an average for the observed line feature over the samples, and
wherein applying the unscented transform produces the vector and the full-rank covariance matrix as an electronic output.

### Claim 12 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the instructions to convert the observed line feature include instructions to provide the covariance matrix as an electronic output that quantifies innovation between the observed line feature and the mapped line feature; and
wherein the instructions to provide the detection distribution include instructions to estimate a location of the robotic device based, at least in part, on the covariance matrix.

### Claim 13 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the instructions include instructions to acquire the observation including noise along with the observed line feature that at least partially distorts the observed line feature within the sensor data, and
wherein the reduced parameters include position and orientation parameters defining an azimuth and an elevation for the observed line feature.

### Claim 14

A method of improving an electronic representation of lines, comprising:
in response to acquiring sensor data from at least one sensor representing a surrounding environment of a robotic device, extracting a feature representation of an observed line feature in the sensor data by providing a probability distribution that is defined based, at least in part, on feature parameters that overparameterize the observed line feature;
converting the feature representation of the observed line feature into reduced parameters to avoid the feature parameters overparameterizing the observed line feature, wherein the reduced parameters include an observation uncertainty for the line feature that is based, at least part, on the probability distribution; and
providing a detection distribution according to a correlation between the reduced parameters and a mapped line feature.

### Claim 15 (depends on 14)

The method of claim 14, wherein converting the feature representation includes applying an unscented transform to estimate a non-linear transform between the feature parameters and the reduced parameters, and providing the feature representation according to the reduced parameters including a vector with four values representing the observed line feature and a full-rank covariance matrix that is four-by-four in size representing the observation uncertainty, and wherein the probability distribution indicates a marginal uncertainty of the observed line feature.

### Claim 16 (depends on 15)

The method of claim 15, wherein applying the unscented transform includes:
i) computing an error between samples of the probability distribution by comparing inverse representation and standard representations of the observed line feature from the probability distribution, wherein computing the error includes determining differences between angular and positional values, wherein the samples are represented using the reduced parameters, and
ii) computing an average for the observed line feature over the samples, wherein applying the unscented transform produces the vector and the full-rank covariance matrix as an electronic output.

### Claim 17 (depends on 15)

The method of claim 15, wherein providing the feature representation using the reduced parameters includes providing the covariance matrix as an electronic output that quantifies innovation of the observation uncertainty; and
wherein providing the detection distribution includes estimating a location of the robotic device based, at least in part, on the covariance matrix.

### Claim 18 (depends on 14)

The method of claim 14, further comprising:
identifying the mapped line feature from a feature map, the mapped line feature being represented according to the reduced parameters, wherein providing the detection distribution indicates at least an estimation uncertainty for a correlation between the mapped line feature and the observed line feature that is a function of the observation uncertainty.

### Claim 19 (depends on 14)

The method of claim 14, wherein acquiring the observation includes acquiring noise along with the observed line feature that at least partially distorts the observed line feature within the sensor data, and wherein the reduced parameters include position and orientation parameters defining an azimuth and an elevation for the observed line feature.

### Claim 20 (depends on 14)

The method of claim 14, wherein the sensor data includes at least one of: a three-dimensional representation of the surrounding environment as a point cloud, and a camera image,
wherein the feature parameters include at least six values defining endpoints of the observed line feature in three-dimensional space, wherein the probability distribution is quantified in a covariance matrix that is six-by-six in size, and
wherein the reduced parameters include at least a full-rank covariance matrix that quantifies innovation of the observed line feature.
