Long range LIDAR-based speed estimation
AssigneeVolvo Car Corporation
InventorsSihao Ding, Sohini Roy Chowdhury, Minming Zhao, Ying Li
Life of this patent
Estimating the term…
Loading patent…
AssigneeVolvo Car Corporation
InventorsSihao Ding, Sohini Roy Chowdhury, Minming Zhao, Ying Li
Estimating the term…
A LIDAR-based method of determining an absolute speed of an object at a relatively longer distance from an ego vehicle, including: estimating a self speed of the ego vehicle using a first frame t-1 and a second frame t obtained from a LIDAR sensor by estimating an intervening rotation θ about a z axis and translation in orthogonal x and y directions using a deep learning algorithm over a relatively closer distance range; dividing each of the first frame t-1 and the second frame t into multiple adjacent input ranges and estimating a relative speed of the object at the relatively longer distance by subsequently processing each frame using a network, with each input range processed using a corresponding convolutional neural network; and combining the estimation of the estimating the self speed with the estimation of the estimating the relative speed to obtain an estimation of the absolute speed.
A LIDAR-based method of determining an absolute speed of an object at a relatively longer distance from an ego vehicle defined as being farther from the ego vehicle than a defined relatively shorter distance range from the ego vehicle, the method comprising:
A LIDAR-based method of determining an absolute speed of an object at a relatively longer distance from an ego vehicle defined as being farther from the ego vehicle than a defined relatively shorter distance range from the ego vehicle, the method comprising:
A non-transitory computer-readable medium stored in a memory and executed by a processor to determine an absolute speed of an object at a relatively longer distance from an ego vehicle defined as being farther from the ego vehicle than a defined relatively shorter distance range from the ego vehicle via the steps comprising:
A non-transitory computer-readable medium stored in a memory and executed by a processor to determine an absolute speed of an object at a relatively longer distance from an ego vehicle defined as being farther from the ego vehicle than a defined relatively shorter distance range from the ego vehicle via the steps comprising:
Dependencies are inferred from the claim text.
From the US filing history. Foreign family members aren’t listed.
Systems of measurement based on relative movement of target: velocity or trajectory determination systems; Sense-of-movement determination systems
Of systems according to group G01S17/00: evaluating distance, position or velocity data
For anti-collision purposes: of land vehicles
The criterion being a learning criterion: using neural networks only
About 14 years 4 months of term left · ends 5 Mar 2041 (estimated)
The present disclosure relates generally to the automotive, advanced driver assistance systems (ADAS), and autonomous driving (AD) fields. More particularly, the present disclosure relates to long range LIDAR-based speed estimation systems and methods.
The absolute speed of an object in the vicinity of a vehicle is typically based on the determined self speed of the ego vehicle and the relative speed of the object, which may be another vehicle, for example. The self speed is typically determined from an external sensor, such as an inertial measurement unit (IMU), a global positioning system (GPS), or the vehicle odometer, which are known to persons of ordinary skill in the art. However, such sensors are greatly dependent upon other sensors and vehicle operating conditions and can be inaccurate. The relative speed is typically determined from camera images using annotation, object segmentation, and tracking, taking into account past trajectories. However, such object annotation and tracking is difficult when the object is at a long distance from the vehicle, as the object may be hard to detect and the camera can easily lose track of it. The result is error in the absolute speed measurement of surrounding objects, which can significantly impact vehicle safety in ADAS and AD environments.
This, the present disclosure proposes the use of a LIDAR sensor to determine the absolute speed of an object in the vicinity of an ego vehicle. Advantageously, such LIDAR sensors have long range and are less affected by vehicle operating conditions.
The present disclosure is illustrated and described with reference to the various drawings, in which like reference numbers are used to denote like system components/method steps, as appropriate, and in which:
FIG. 1 is a schematic diagram illustrating one exemplary embodiment of the system and method for performing self speed estimation of the present disclosure;
FIG. 2 is a schematic diagram illustrating one exemplary embodiment of the system and method for performing relative speed estimation of the present disclosure;
The long range LIDAR-based speed estimation systems and methods of the present disclosure divide multiple LIDAR frames into ranges based on the distance of a point from the LIDAR sensor: short range (e.g. up to 50 or 70 m), middle range (e.g. from 50 or 70 m to 100 or 120 m), and long range (e.g. from 100 or 120 m to 250 m). Given these ranges, tasks are performed separately on each and the results are then combined. Advantageously, the systems and methods of the present disclosure are LIDAR agnostic and run in the 10 Hz region, for example. Two alternative methodologies are provided.
In the first alternative methodology, both self-speed estimation and relative speed estimation are performed, with the combined result used to estimate absolute speed. Range affects are considered. Self speed estimation is performed for the short range; a relatively close range, the boundary of which is decided by benchmarking the self speed estimation. Relative speed estimation is performed for all ranges using a range awareness algorithm.
In the second alternative methodology, a multi-task network shares both self speed estimation and relative speed estimation for all ranges. In terms of output, three regression heads produce two types of results: rotation and translation (for self speed estimation) and object location and speed (for relative speed estimation). The rotations, translations, and speeds produced by the multi-task network collectively provide the absolute speed of each object.