Back to results
US 2020/0089972 A1Published application
Automobile head-up display system and obstacle prompting method thereof
AssigneeBoe Technology Group Co., Ltd.
InventorsYue YU, Zhusong YI
Life of this patent
Estimating the term…
Abstract
An automobile head up display system and an obstacle prompt method thereof are provided. The method includes: acquiring a road condition video image, identifying obstacles from the acquired image after performing an enhancement processing on the acquired image; projecting and displaying a prompt information at corresponding positions of a front windshield of the automobile according to positions of the identified obstacles in the road condition video image.
Claims20
1:
- An obstacle prompt method of an automobile head up display system, comprising:
- acquiring a road condition video image;
- identifying obstacles from the acquired image after performing an enhancement processing on the acquired image;
- and
- projecting and displaying a prompt information at corresponding positions of a front windshield of the automobile according to positions of the identified obstacles in the road condition video image.
2 more elements
2:
- The method according to claim 1, wherein the enhancement processing on the acquired road condition video image comprises:
- performing a grayscale processing on the acquired road condition video image to obtain a grayscale image, and calculating a variance of grayscales of pixels of the grayscale image;
- and
- performing the image enhancement processing on the grayscale image if the variance is less than a given threshold.
1 more element
3:
- The method according to claim 1, wherein the performing the enhancement processing on the acquired image comprises:
- after receiving an instruction of opening an obstacle prompt mode, performing the grayscale processing on the acquired road condition video image to obtain the grayscale image, then performing the enhancement processing on the grayscale image.
4:
- The method according to claim 1, wherein the projecting and displaying the prompt information at the corresponding positions of the front windshield of the automobile according to the positions of the identified obstacles in the road condition video image comprises:
- framing the obstacles with identification frames in the enhancement processed image;
- converting position and size information of the identification frames in a coordinate system of the enhancement processed image into the corresponding position and size information in a coordinate system of a display screen of the automobile head up display system;
- displaying prompt boxes as the prompt information on the display screen according to the converted position and size information;
- and
- projecting and displaying a display picture displayed by the display screen on the front windshield of the automobile by optical refraction.
3 more elements
5:
- The method according to claim 1, wherein the projecting and displaying the prompt information at the corresponding positions of the front windshield of the automobile according to the positions of the identified obstacles in the road condition video image comprises:
- framing the obstacles with the identification frames in the enhancement processed image;
- projecting the identification frames on the front windshield as prompt boxes for the prompt information.
6:
- The method according to claim 1, wherein the obstacles comprise at least one of vehicles and pedestrians.
7:
- The method according to claim 2, wherein the performing the image enhancement processing on the grayscale image comprises:
- performing the image enhancement processing using a histogram equalization method with sub-blocks partially overlapped.
8:
- The method according to any claim 1, wherein the identifying the obstacles comprise:
- using a convolutional neural network algorithm on the enhancement processed image to identify the obstacles from the enhancement processed image.
9:
- An automobile head up display system, comprising:
- a road condition information collection part configured to acquire a road condition video image;
- a road condition information processing part connected with the road condition information collection part;
- and
- an optical projection part,
- wherein the road condition information processing part is configured to perform an enhancement processing on the road condition video image acquired by the road condition information collection part and identify obstacles therefrom;
- and to project and display a prompt information at corresponding positions of a front windshield of the automobile by the optical projection part according to positions of the identified obstacles in the road condition video image.
4 more elements
10:
- The system according to claim 9, wherein the optical projection part is connected with the road condition information processing part, and is configured to project the prompt information corresponding to the enhancement processed image on the front windshield.
11:
- The system according to claim 9, further comprising:
- a light source display part connected with the road condition information processing part,
- wherein the light source display part is configured to display the enhancement processed image, and to project the prompt information corresponding to the image on the front windshield through the optical projection part.
12:
- The system according to claim 9, wherein the road condition information processing part comprises:
- an image enhancement unit configured to perform the enhancement processing on the road condition video image acquired by the road condition information collection part;
- an identification unit connected with the image enhancement unit, and configured to identify the obstacles from the enhancement processed image;
- and
- a prompt unit connected with the identification unit, and configured to project and display the prompt information at the corresponding positions of the front windshield of the automobile according to the positions of the identified obstacles in the road condition video image through the optical projection part.
2 more elements
13:
- The system according to claim 12, wherein the road condition information processing part further comprises:
- a grayscale variance calculation unit connected with the road condition information collection part and the image enhancement part, and configured to calculate a variance of grayscales of pixels for the acquired road condition video image;
- and
- after determining that the variance is less than a given threshold, transmitting an image enhancement indication information to the image enhancement unit;
- wherein the image enhancement unit is configured to perform the enhancement processing on the road condition video image acquired by the road condition information collection part according to the received image enhancement indication information.
2 more elements
14:
- The system according to claim 12, wherein the road condition information processing part further comprises:
- an instruction receiving unit connected with the image enhancement unit, and configured to transmit the image enhanced indication information to the image enhancement unit after receiving an instruction of opening the obstacle prompt mode,
- wherein the image enhancement unit is configured to perform the enhancement processing on the image acquired by the road condition information collection part according to the received image enhancement indication information.
15:
- The method according to claim 3, wherein the performing the image enhancement processing on the grayscale image comprises:
- performing the image enhancement processing using a histogram equalization method with sub-blocks partially overlapped.
16:
- The method according to claim 15, wherein the identifying the obstacles comprise:
- using a convolutional neural network algorithm on the enhancement processed image to identify the obstacles from the enhancement processed image.
17:
- The system according to claim 10, wherein the road condition information processing part comprises:
- an image enhancement unit configured to perform the enhancement processing on the road condition video image acquired by the road condition information collection part;
- an identification unit connected with the image enhancement unit, and configured to identify the obstacles from the enhancement processed image;
- and
- a prompt unit connected with the identification unit, and configured to project and display the prompt information at the corresponding positions of the front windshield of the automobile according to the positions of the identified obstacles in the road condition video image through the optical projection part.
2 more elements
18:
- The system according to claim 11, wherein the road condition information processing part comprises:
- an image enhancement unit configured to perform the enhancement processing on the road condition video image acquired by the road condition information collection part;
- an identification unit connected with the image enhancement unit, and configured to identify the obstacles from the enhancement processed image;
- and
- a prompt unit connected with the identification unit, and configured to project and display the prompt information at the corresponding positions of the front windshield of the automobile according to the positions of the identified obstacles in the road condition video image through the optical projection part.
2 more elements
19:
- The system according to claim 18, wherein the road condition information processing part further comprises:
- a grayscale variance calculation unit connected with the road condition information collection part and the image enhancement part, and configured to calculate a variance of grayscales of pixels for the acquired road condition video image;
- and
- after determining that the variance is less than a given threshold, transmitting an image enhancement indication information to the image enhancement unit;
- wherein the image enhancement unit is configured to perform the enhancement processing on the road condition video image acquired by the road condition information collection part according to the received image enhancement indication information.
2 more elements
20:
- The system according to claim 19, wherein the road condition information processing part further comprises:
- an instruction receiving unit connected with the image enhancement unit, and configured to transmit the image enhanced indication information to the image enhancement unit after receiving an instruction of opening the obstacle prompt mode,
- wherein the image enhancement unit is configured to perform the enhancement processing on the image acquired by the road condition information collection part according to the received image enhancement indication information.