Object determination in an occluded region
AssigneeZoox, Inc.
InventorsAndrew E. Beller, Clark Davenport
Life of this patent
Estimating the term…
Abstract
A vehicle computing device may implement techniques to predict behavior of objects or predicted objects in an environment. The techniques may include using a model to determine whether a potential object will emerge from an occluded region in the environment. The model may be configured to use one or more algorithms, classifiers, and/or computational resources to predict an intersection point and/or an intersection time between the potential object and the vehicle. Based on the predicted intersection point and/or the predicted intersection time, the vehicle computing device may control operation of the vehicle.
Claims20
A system comprising:
- one or more processors;
- and
- one or more non-transitory computer-readable storage media storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
- receiving sensor data from a sensor associated with a vehicle in an environment;
- determining, based at least in part on a first portion of the sensor data captured at a first time, a first discretized representation of an occluded portion of the environment associated with the first time, wherein the first discretized representation of the occluded portion comprises a first plurality of cells being regularly spaced and aligning with a road in the environment, the first plurality of cells having a plurality of first probabilities of a potential object occupying the first plurality of cells, wherein the first discretized representation of the occluded portion is associated with a first weight determined based at least in part on the first time;
- determining, based at least in part on a second portion of the sensor data captured at a second time after the first time, a second discretized representation of the occluded portion of the environment associated with the second time, wherein the second discretized representation of the occluded portion comprises a second plurality of cells having a plurality of second probabilities of the potential object occupying the second plurality of cells, wherein the second discretized representation of the occluded portion is associated with a second weight determined based at least in part on the second time;
- fusing, based on the first weight and the second weight, the first discretized representation of the occluded portion comprising the first plurality of cells having the plurality of first probabilities and the second discretized representation of the occluded portion comprising the second plurality of cells having the plurality of second probabilities to generate a fused representation of the occluded portion and excluding other portions of the environment, wherein the fused representation comprises a third plurality of cells having a plurality of third probabilities;
- receiving a candidate trajectory for the vehicle to follow;
- determining a location of the vehicle along the candidate trajectory at a future time;
- determining, based at least in part on the fused representation, that a probability of the potential object occupying the occluded portion meets or exceeds a threshold;
- determining, based at least in part on the probability of the potential object occupying the occluded portion meeting or exceeding the threshold, a distance between a closest point of the occluded portion and the location of the vehicle along the candidate trajectory at the future time;
- determining that the distance is below a threshold distance;
- and
- controlling the vehicle based at least in part on the distance being below the threshold distance.
One or more non-transitory computer-readable storage media storing instructions that, when executed, cause one or more processors to perform operations comprising:
- receiving, first occlusion data associated with a first occluded region in an environment of a vehicle, wherein the first occlusion data is associated with a first time and a first weight determined based at least in part on the first time;
- receiving, second occlusion data associated with the first occluded region in the environment, the second occlusion data associated with a second time after the first time, wherein the second occlusion data is associated with a second weight determined based at least in part on the second time, wherein the second weight is higher than the first weight;
- fusing, based at least in part on the first weight and the second weight, the first occlusion data and the second occlusion data, to generate fused data of the first occluded region and excluding other portions of the environment;
- determining, based at least in part on the fused data, a first probability of an object occupying the first occluded region;
- determining, based at least in part on the first occlusion data and the second occlusion data, a second probability that a second occluded region of the environment is associated with an additional object;
- receiving a candidate trajectory for the vehicle to follow;
- determining, based at least in part on the first probability, a distance between a closest point of the first occluded region and a point of the vehicle along the candidate trajectory;
- identifying, based at least in part on the first probability and the second probability, one of the object of the first occluded region or the additional object of the second occluded region as having a greater likelihood of intersecting with the vehicle relative to the object of the first occluded region or the additional object of the second occluded region;
- and
- controlling operation of the vehicle based at least in part on the distance, wherein controlling the operation of the vehicle is further based at least in part on the identifying.
A method comprising:
- inputting, into a model, first region data associated with an occluded region at a first time;
- inputting, into the model, second region data associated with the occluded region, wherein the second region data is associated with a second time different from the first time;
- inputting, into the model, a trajectory of a vehicle traversing an environment;
- fusing, as a fused representation of the occluded region and excluding other regions of the environment, the first region data and the second region data;
- receiving, from the model, a plurality of probabilities in a discretized grid, wherein individual ones of the plurality of probabilities represent a discrete probability that a potential object within the occluded region intersects with the vehicle at the second time, wherein the potential object is associated with an object class, and the discrete probability that the potential object within the occluded region intersects with the vehicle at the second time is based at least in part on the fused representation;
- determining a potential adversarial behavior of the potential object, wherein the potential adversarial behavior of the potential object is determined based on one or more characteristics associated with the object class, and the one or more characteristics comprises one or more of a maximum velocity associated with the object class, a maximum acceleration associated with the object class, or a maximum turning ability associated with the object class;
- and
- controlling operation of the vehicle at the second time based at least in part on the plurality of probabilities and the potential adversarial behavior of the potential object.
Dependencies are inferred from the claim text.