Back to results
US 11,696,039 B2Granted
Smart IP camera with color night mode
AssigneeAmbarella International LP
InventorsZhikan Yang, Yutao Feng
Life of this patent
Estimating the term…
Abstract
An apparatus includes a camera and a processor circuit. The camera may be configured to capture color images in response to visible light and monochrome infrared images in response to infrared light. The processor circuit may be configured to extract color features from the color images and add color to corresponding monochrome features detected in the monochrome infrared images.
Claims20
An apparatus comprising:
- a camera configured to capture color images of a monitored field of view in response to visible light during daytime operation and monochrome infrared images of the monitored field of view in response to infrared light during nighttime operation;
- and
- a processor circuit configured to extract color information of one or more color features of one or more of objects and backgrounds from the color images of said monitored field of view captured during daytime operation and add color from the color features to corresponding monochrome features of one or more corresponding objects and backgrounds detected in the monochrome infrared images of said monitored field of view captured during nighttime operation, wherein said processor circuit (a) stores and executes a first artificial neural network to extract said color information about said one or more color features of said one or more objects and backgrounds from said color images of said monitored field of view captured during a daytime operating mode and stores the color information about the one or more color features of said one or more objects and backgrounds from the color images in a database during the daytime operating mode, (b) stores and executes a second artificial neural network to extract one or more extracted features of one or more of objects and backgrounds from said monochrome infrared images of said monitored field of view captured during a nighttime operating mode, (c) selects one or more color features in the database associated with one or more of the objects and backgrounds from the color images that correspond to the one or more extracted features of one or more of the objects and backgrounds from the monochrome infrared images during the nighttime operating mode, and (d) stores and executes a third artificial neural network to colorize each monochrome infrared image to a full color image by adding the color information associated with the color features selected from the database to the one or more extracted features of the one or more of the objects and backgrounds of the monochrome infrared images corresponding to the one or more of the objects and backgrounds from the color images associated with the color features.
A method for implementing a color night mode in a smart IP camera comprising:
- capturing color images of a monitored field of view in response to visible light during daytime operation using a camera;
- capturing monochrome infrared images of the monitored field of view in response to infrared light during nighttime operation using the camera;
- extracting color information of one or more color features of one or more of objects and backgrounds from the color images of said monitored field of view captured during the daytime operation using a processor circuit to store and execute a first artificial neural network to extract the color information about the one or more color features of the one or more of objects and backgrounds from said color images and store the color information about the one or more color features in a database during a daytime operating mode;
- extracting one or more monochrome features of one or more of objects and backgrounds from said monochrome infrared images of the monitored field of view captured during the nighttime operation using the processor circuit to store and execute a second artificial neural network to extract one or more extracted monochrome features of one or more of objects and backgrounds from said monochrome infrared images and select one or more color features in the database associated with one or more of the objects and backgrounds from the color images that correspond to the one or more extracted monochrome features of the objects and backgrounds from the monochrome infrared images during a nighttime operating mode;
- and
- adding color from the color features extracted during the daytime operation to corresponding monochrome features detected in the monochrome infrared images of the monitored field of view captured during the nighttime operation using the processor circuit to store and execute a third artificial neural network to colorize each monochrome infrared image back to a full color image by adding the color information associated with the color features selected from the database to the one or more extracted monochrome features of the one or more of the objects and backgrounds of the monochrome infrared images corresponding to the one or more of the objects and backgrounds from the color images associated with the color features selected from the database.
3 more elements
Dependencies are inferred from the claim text.