Vehicle camera lens obstruction
AssigneeGM Global Technology Operations LLC
InventorsJiabin Shen, Jay Blackwell, Yun Qian Miao
Life of this patent
Estimating the term…
Abstract
A method for processing vehicle camera lens obstructions including obtaining an image from a vehicle camera, generating a first camera lens dirt map according to pixel texture richness and color spectrum levels extracted from the image, obtaining a sequential feed of multiple frames from the vehicle camera, generating a second camera lens dirt map according to at least one salient region extracted from the multiple frames, combining the first camera lens dirt map and the second camera lens dirt map to generate a combined camera lens dirt map, and initiating at least one of automated lens cleaning or a camera lens obstruction signal, according to the combined camera lens dirt map.
Claims20
A method for processing vehicle camera lens obstructions, the method comprising:
- obtaining an image from a vehicle camera;
- generating a first camera lens dirt map according to pixel texture richness and color spectrum levels extracted from the image;
- obtaining a sequential feed of multiple frames from the vehicle camera;
- generating a second camera lens dirt map according to at least one salient region extracted from the multiple frames;
- combining the first camera lens dirt map and the second camera lens dirt map to generate a combined camera lens dirt map;
- and
- initiating at least one of automated lens cleaning or a camera lens obstruction signal, according to the combined camera lens dirt map.
A vehicle camera lens obstruction detection system comprising:
- a vehicle camera mounted on a vehicle, the vehicle camera including a lens, and the vehicle camera configured to capture images;
- and
- a vehicle control module in communication with the vehicle camera, the vehicle control module configured to:
- receive a sequential feed of multiple frames from the vehicle camera;
- obtain at least one vehicle motion signal;
- generate a timeline of pixel statistics in the multiple frames, according to the at least one vehicle motion signal;
- extract and track at least one salient region in the multiple frames according to the timeline of pixel statistics in the multiple frames;
- detect at least one blockage area of the vehicle camera according to the at least one salient region and the timeline of pixel statistics in the multiple frames;
- generate a camera lens dirt map according to the at least one blockage area;
- and
- initiate at least one of automated lens cleaning or a camera lens obstruction signal, according to the camera lens dirt map.
A vehicle camera lens obstruction detection system comprising:
- a vehicle camera mounted on a vehicle, the vehicle camera including a lens, and the vehicle camera configured to capture images;
- and
- a vehicle control module in communication with the vehicle camera, the vehicle control module configured to:
- receive an image from the vehicle camera;
- extract texture sub-areas of the image;
- discretize an image blurriness level according to pixel texture richness of the texture sub-areas;
- extract color spectrum sub-areas of the image;
- generate a camera lens dirt map according to the pixel texture richness of the texture sub-areas and the color spectrum sub-areas of the image;
- and
- initiate at least one of automated lens cleaning or a camera lens obstruction signal, according to the camera lens dirt map.
Dependencies are inferred from the claim text.