Conflict resolver for a lidar data segmentation system of an autonomous vehicle
AssigneeGM Global Technology Operations LLC
InventorsAndrea Allais, Micah Christopher Chambers
Life of this patent
Estimating the term…
Abstract
An autonomous vehicle generates segmentation scenes based upon lidar data generated by a lidar sensor system of the autonomous vehicle. The lidar data includes points indicative of positions of objects in a driving environment of the autonomous vehicle. The segmentation scenes comprise regions that are indicative of the objects in the driving environment. The autonomous vehicle generates scores for each segmentation scene based upon characteristics of each segmentation scenes and selects a segmentation scene based upon the scores. The autonomous vehicle then operates based upon the segmentation scene.
Claims20
An autonomous vehicle comprising:
- an engine;
- a braking system;
- a steering system;
- a light detection and ranging (lidar) sensor;
- and
- a computing system that is in communication with the engine, the braking system, the steering system, and the lidar sensor, wherein the computing system comprises:
- a processor;
- and
- memory that stores instructions that, when executed by the processor, cause the processor to perform acts comprising:
- receiving lidar data, the lidar data based upon output of the lidar sensor, the lidar data comprising points representative of positions of objects in a driving environment of the autonomous vehicle;
- responsive to receiving the lidar data, generating a plurality of segmentation scenes using a different respective segmentation algorithm to generate each of the segmentation scenes in the plurality of segmentation scenes, each segmentation algorithm in the plurality of segmentation algorithms utilizing the lidar data, wherein each segmentation scene in the plurality of segmentation scenes is representative of a same portion of the driving environment, and wherein each segmentation scene comprises a plurality of regions, wherein each region in the plurality of regions for each segmentation scene in the plurality of segmentation scenes is indicative of an object in the objects;
- generating a score for each segmentation scene in the plurality of segmentation scenes based upon a scoring function, wherein the scoring function outputs the scores based upon geometric features of the plurality of regions for each segmentation scene in the plurality of segmentation scenes, wherein a first score for a first segmentation scene that comprises a first plurality of regions is generated based upon assigning a sub-score to each region in the first plurality of regions based upon geometric features of the first plurality of regions, wherein each of the first plurality of regions is representative of a different object;
- selecting a segmentation scene in the plurality of segmentation scenes based upon the scores;
- and
- controlling at least one of the engine, the braking system, or the steering system during operation of the autonomous vehicle in the driving environment based upon the selected segmentation scene.
A method of controlling operation of an autonomous vehicle, the method executed by a computing device included on the autonomous vehicle, the method comprising:
- receiving light detection and ranging (lidar) data from a lidar sensor mounted on the autonomous vehicle, the lidar data comprising a plurality of points representative of positions of objects in a driving environment of the autonomous vehicle;
- responsive to receiving the lidar data, generating a plurality of segmentation scenes using a different respective segmentation algorithm to generate each of the segmentation scenes in the plurality of segmentation scenes, each of the segmentation algorithms in the plurality of segmentation algorithms utilizing the lidar data, wherein each segmentation scene in the plurality of segmentation scenes is representative of a same portion of the driving environment, and wherein each segmentation scene in the plurality of segmentation scenes comprises a plurality of regions, wherein each region in the plurality of regions for each segmentation scene in the plurality of segmentation scenes is indicative of an object in the objects, each region in a same segmentation scene being representative of a different object;
- generating a score for each segmentation scene in the plurality of segmentation scenes based upon a scoring function, wherein the scoring function outputs a first score for a first segmentation scene that comprises a first plurality of regions based upon assigning a sub-score to each region in the first plurality of regions based upon geometric features of the first plurality of regions;
- selecting a segmentation scene in the plurality of segmentation scenes based upon the scores;
- and
- controlling operation of the autonomous vehicle in the driving environment based upon the selected segmentation scene.
An autonomous vehicle comprising:
- a non-transitory computer-readable storage medium comprising instructions that, when executed by a processor of the autonomous vehicle, cause the processor to perform acts comprising:
- receiving a light detection and ranging (lidar) point cloud from a lidar sensor system mounted on the autonomous vehicle, the lidar point cloud comprising a plurality of points representative of positions of objects in a driving environment of the autonomous vehicle;
- responsive to receiving the lidar point cloud, generating a plurality of segmentation scenes using a different respective segmentation algorithm to generate each of the segmentation scenes in the plurality of segmentation scenes, each of the segmentation algorithms configured to generate a segmentation scene based upon the lidar point cloud, wherein each segmentation scene in the plurality of segmentation scenes comprises a plurality of regions, wherein each region in the plurality of regions for each segmentation scene in the plurality of segmentation scenes is indicative of an object in the objects, each region in a same segmentation scene being representative of a different object;
- generating a score for each segmentation scene in the plurality of segmentation scenes based upon a scoring function, wherein the scoring function outputs a first score for a first segmentation scene that comprises a first plurality of regions based upon assigning a sub-score to each region in the first plurality of regions based upon geometric characteristics of the first plurality of regions;
- selecting a segmentation scene in the plurality of segmentation scenes based upon the scores;
- and
- controlling at least one of an engine of the autonomous vehicle, a braking system of the autonomous vehicle, or a steering system of the autonomous vehicle during operation of the autonomous vehicle in the driving environment based upon the selected segmentation scene.
Dependencies are inferred from the claim text.