Imaging system, driving assistance system, and program
AssigneeSemiconductor Energy Laboratory Co., Ltd.
InventorsKengo Akimoto, Koki Inoue, Yusuke Koumura
Life of this patent
Estimating the term…
Abstract
The driving assistance system includes an imaging device capable of capturing a first monochrome image in a vehicle traveling direction, a first neural network for segmentation processing, a second neural network for depth estimation processing, a determination portion determining a center of a portion cut off from the first monochrome image on the basis of the segmentation processing and the depth estimation processing, a third neural network for colorization processing of only a second cut-off monochrome image, and a display device for enlargement of the second monochrome image subjected to the colorization processing.
Claims6
A driving assistance method comprising the steps of:
- driving a vehicle incorporating an imaging device;
- capturing a monochrome image of a front of the vehicle during driving by the imaging device;
- performing inference of regions of at least a sky, a car, and a road by performing segmentation processing on the monochrome image;
- performing inference of a distant region to be extracted from the monochrome image by performing depth estimation processing on the monochrome image;
- determining a center of the distant region to be extracted on the basis of the segmentation processing and the depth estimation processing;
- measuring driving speed of the vehicle and determining size of the distant region to be extracted according to the driving speed of the vehicle;
- extracting the distant region with a determined size from the monochrome image;
- performing super-resolution processing to an extracted distant region;
- after performing the super-resolution processing, performing colorization processing for highlighting of an object included in the extracted distant region;
- and
- performing enlargement of the extracted distant region after the colorization processing.
A computer program product comprising a non-transitory computer readable medium encoded with an information processing program for use in an information processing device, the program when executed performs the operations comprising:
- driving a vehicle incorporating an imaging device;
- capturing a monochrome image of a front of the vehicle during driving by the imaging device;
- performing inference of regions of at least a sky, a car, and a road by performing segmentation processing on the monochrome image;
- performing inference of a distant region to be extracted from the monochrome image by performing depth estimation processing on the monochrome image;
- determining a center of the distant region to be extracted on the basis of the segmentation processing and the depth estimation processing;
- measuring driving speed of the vehicle and determining size of the distant region to be extracted according to the driving speed of the vehicle;
- extracting the distant region with a determined size from the monochrome image;
- performing super-resolution processing on an extracted distant region;
- after performing the super-resolution processing, performing colorization processing for highlighting of an object included in the extracted distant region;
- and
- performing enlargement of the extracted distant region after the colorization processing.
Dependencies are inferred from the claim text.