Daytime heatmap for night vision detection
AssigneeAmazon Technologies, Inc.
InventorsMashhour Solh, Manik Gupta
Life of this patent
Estimating the term…
Abstract
A computer-implemented method includes receiving an image frame of image data associated with a camera. The method also includes receiving a human presence heatmap for the image frame, receiving a motion heatmap for the image frame, and receiving an image metric heatmap for the image frame. The method further includes receiving a combined heatmap as a combination of the human presence heatmap, the motion heatmap, and the image metric heatmap and setting auto-exposure parameters for the camera based on the combined heatmap.
Claims20
A computer-implemented method of setting infrared auto-exposure parameters for a video camera, comprising:
- receiving a first image frame of RGB image data;
- receiving a second image frame of RGB image data, the second image frame of RGB image data including a plurality of pixels;
- determining that data in a first region of the second image frame indicates human presence in the first region, wherein the first region is defined by a first group of pixels of the plurality of pixels;
- generating a human presence heatmap associated with the first region, wherein each pixel of the first group has a normalized pixel weight between 0 and 1;
- determining, using the first image frame and the second image frame, motion in a second region of the second image frame, wherein the second region is defined by a second group of pixels of the plurality of pixels;
- generating a motion heatmap associated with the second region, wherein each pixel of the second group of pixels has a normalized pixel weight between 0 and 1;
- determining a group of saturated pixels in the second image frame, wherein the group of saturated pixels is characterized by a maximum pixel intensity value;
- generating an image quality heatmap associated with the group of saturated pixels, wherein each pixel of the group of saturated pixels has a normalized pixel weight between 0 and 1;
- generating a combined heatmap by summing:
- a first coefficient between zero and one multiplied by the normalized pixel weights of each pixel of the human presence heatmap;
- a second coefficient between zero and one multiplied by the normalized pixel weight of each pixel of the motion heatmap;
- and
- a third coefficient between zero and one multiplied by the normalized pixel weight of each pixel of the image quality heatmap;
- and
- deriving values for the infrared auto-exposure parameters for the video camera using the combined heatmap.
A computer-implemented method, comprising:
- receiving an image frame of image data associated with a camera;
- receiving a human presence heatmap for the image frame;
- receiving a motion heatmap for the image frame;
- receiving an image metric heatmap for the image frame;
- receiving a combined heatmap as a combination of the human presence heatmap, the motion heatmap, and the image metric heatmap;
- and
- setting auto-exposure parameters for the camera based on the combined heatmap.
A video camera system comprising:
- an optical imaging lens;
- an image sensor;
- a plurality of infrared illumination sources;
- at least one processor;
- and
- a data storage device in communication with the at least one processor, wherein the data storage device comprises instructions stored thereon that, when executed by the at least one processor, cause the at least one processor to:
- receive a plurality of image frames of image data captured by the image sensor;
- generate a human presence heatmap for one of the plurality of image frames;
- generate a motion heatmap for the one of the plurality of image frames using a second one of the plurality of image frames preceding the one of the plurality of image frames;
- generate an image metric heatmap for the one of the plurality of image frames;
- generate a combined heatmap as a combination of the human presence heatmap, the motion heatmap, and the image metric heatmap;
- and
- define infrared auto-exposure parameters for the video camera system based on the combined heatmap.
Dependencies are inferred from the claim text.