Back to results
US 11,733,703 B2Granted
Automatic braking of autonomous vehicles using machine learning based prediction of behavior of a traffic entity
AssigneePerceptive Automata, Inc.
InventorSamuel English Anthony
Life of this patent
Estimating the term…
Abstract
An autonomous vehicle uses machine learning based models to predict hidden context attributes associated with traffic entities. The system uses the hidden context to predict behavior of people near a vehicle in a way that more closely resembles how human drivers would judge the behavior. The system determines an activation threshold value for a braking system of the autonomous vehicle based on the hidden context. The system modifies a world model based on the hidden context predicted by the machine learning based model. The autonomous vehicle is safely navigated, such that the vehicle stays at least a threshold distance away from traffic entities.
Claims19
A method comprising:
- receiving, by an autonomous vehicle, sensor data from sensors mounted on the autonomous vehicle;
- identifying, one or more traffic entities based on the sensor data, the one or more traffic entities representing non-stationary objects in traffic in which the autonomous vehicle is driving;
- for each of the one or more traffic entities displayed in an input image or a video:
- providing the input image or video to a machine learning based model, wherein the machine learning based model is trained based on user responses received from human observers presented with images or videos showing traffic scenarios;
- executing the machine learning based model to predict a measure of statistical distribution of user responses expected from human observers presented with the input image or video;
- and
- determining an activation threshold for braking system of the autonomous vehicle based on the predicted measure of statistical distribution of user responses output by the machine learning based model;
- predicting that the autonomous vehicle is likely to reach within the activation threshold of a particular traffic entity within a threshold time interval;
- and
- responsive to determining that the autonomous vehicle is likely to reach within the activation threshold of the particular traffic entity within the threshold time interval, activating the braking system of the autonomous vehicle.
7 more elements
A non-transitory computer readable storage medium storing instructions that when executed by a processor, cause the processor to perform steps comprising:
- receiving, by an autonomous vehicle, sensor data from sensors mounted on the autonomous vehicle;
- identifying, one or more traffic entities based on the sensor data, the one or more traffic entities representing non-stationary objects in traffic in which the autonomous vehicle is driving;
- for each of the one or more traffic entities displayed in an input image or a video:
- providing the input image or video to a machine learning based model, wherein the machine learning based model is trained based on user responses received from human observers presented with images or videos showing traffic scenarios;
- executing the machine learning based model to predict a measure of statistical distribution of user responses expected from human observers presented with the input image or video;
- and
- determining an activation threshold for braking system of the autonomous vehicle based on the predicted measure of statistical distribution of user responses output by the machine learning based model;
- predicting that the autonomous vehicle is likely to reach within the activation threshold of a particular traffic entity within a threshold time interval;
- and
- responsive to determining that the autonomous vehicle is likely to reach within the activation threshold of the particular traffic entity within the threshold time interval, activating the braking system of the autonomous vehicle.
7 more elements
A computer system comprising:
- a processor;
- and
- a non-transitory computer readable storage medium storing instructions that when executed by the processor, cause the processor to perform steps comprising:
- receiving, by an autonomous vehicle, sensor data from sensors mounted on the autonomous vehicle;
- identifying, one or more traffic entities based on the sensor data, the one or more traffic entities representing non-stationary objects in traffic in which the autonomous vehicle is driving;
- for each of the one or more traffic entities displayed in an input image or a video:
- providing the input image or video to a machine learning based model, wherein the machine learning based model is trained based on user responses received from human observers presented with images or videos showing traffic scenarios;
- executing the machine learning based model to predict a measure of statistical distribution of user responses expected from human observers presented with the input image or video;
- and
- determining an activation threshold for braking system of the autonomous vehicle based on the predicted measure of statistical distribution of user responses output of the machine learning based model;
- predicting that the autonomous vehicle is likely to reach within the activation threshold of a particular traffic entity within a threshold time interval;
- and
- responsive to determining that the autonomous vehicle is likely to reach within the activation threshold of the particular traffic entity within the threshold time interval, activating the braking system of the autonomous vehicle.
10 more elements
Dependencies are inferred from the claim text.