Automatic robotically steered sensor for targeted high performance perception and vehicle control
AssigneeAurora Operations, Inc.
InventorMark Calleija
Life of this patent
Estimating the term…
Abstract
Disclosed are methods, systems, and non-transitory computer readable media that control an autonomous vehicle via at least two sensors. One aspect includes capturing an image of a scene ahead of the vehicle with a first sensor, identifying an object in the scene at a confidence level based on the image, determining the confidence level of the identifying is below a threshold, in response to the confidence level being below the threshold, directing a second sensor having a field of view smaller than the first sensor to generate a second image including a location of the identified object, further identifying the object in the scene based on the second image, controlling the vehicle based on the further identification of the object.
Claims20
A method of controlling a vehicle, the method comprising:
- capturing a first image with a first sensor, wherein the first image includes an object;
- based on an attempt to identify the object in the first image, determining a capture location of the object for obtaining a second image of the object by a second sensor, wherein the second sensor is configured with an active illumination device that is synchronized to illuminate when the second sensor captures the second image;
- directing the second sensor to capture the second image of the object at the capture location of the object, wherein the active illumination device illuminates a field of view corresponding to the capture location of the object;
- identifying the object based on the second image;
- and
- controlling the vehicle based on identifying the object.
A vehicle comprising:
- vehicle controls for controlling the vehicle;
- a first sensor and a second sensor, wherein the second sensor is configured with an active illumination device;
- one or more processors;
- a memory storing instructions that are executable by the one or more processors to cause the one or more processors to:
- capture a first image with the first sensor, wherein the first image includes an object;
- based on an attempt to identify the object in the first image, determine a capture location of the object for obtaining a second image of the object by the second sensor, wherein the active illumination device is synchronized to illuminate when the second sensor captures the second image;
- direct the second sensor to capture the second image of the object at the capture location of the object, wherein the active illumination device illuminates a field of view corresponding to the capture location of the object;
- identify the object based on the second image;
- and
- control the vehicle based on identifying the object.
A computing system for controlling a vehicle comprising:
- one or more processors;
- one or more non-transitory computer-readable media that store instructions executable by the one or more processors to cause the one or more processor to perform operations, the operations comprising:
- capturing a first image with a first sensor, wherein the first image includes an object;
- based on an attempt to identify the object in the first image, determining a capture location of the object for obtaining a second image of the object by a second sensor, wherein the second sensor is configured with an active illumination device that is synchronized to illuminate when the second sensor captures the second image;
- directing the second sensor to capture the second image of the object at the capture location of the object, wherein the active illumination device illuminates a field of view corresponding to the capture location of the object;
- identifying the object based on the second image;
- and
- controlling the vehicle based on identifying the object.
Dependencies are inferred from the claim text.