Inner monitoring system of autonomous vehicle and system thereof
AssigneeLG Electronics Inc.
InventorMinsick Park
Life of this patent
Estimating the term…
Abstract
A method of monitoring an interior of an autonomous vehicle using an image sensor including a unit pixel composed of an infrared pixel and three primary color-pixels, according to an embodiment of the present invention, includes the following procedure. Setting an RGB mode boundary value that is expressed in illumination and an infrared mode boundary value having illumination lower than the RGB mode boundary value; acquiring an illumination value of the interior of the vehicle; and creating an RGB image and an infrared image from the image sensor in accordance with the illumination value and driving in a common mode that creates both of the RGB image and the infrared image when the illumination value is less than the RGB mode boundary value and is the infrared mode boundary value or more.
Claims12
A method of monitoring an interior of an autonomous vehicle using an image sensor including a unit pixel composed of an infrared pixel and three primary color-pixels, the method comprising:
- setting an RGB mode boundary value that is expressed in illumination and an infrared mode boundary value having illumination lower than the RGB mode boundary value;
- acquiring an illumination value of the interior of the vehicle;
- and
- creating an RGB image and an infrared image from the image sensor in accordance with the illumination value and driving in a common mode that creates both of the RGB image and the infrared image when the illumination value is less than the RGB mode boundary value and is the infrared mode boundary value or more,
- wherein setting the RGB mode boundary value includes:
- calculating a detection ratio that is a ratio of images from which landmarks disposed at a specific position in the vehicle are detected of several RGB images,
- acquiring an illumination value of the interior of the vehicle when the detection ratio is less than a predetermined first reference value and is a predetermined second reference value or more in a range lower than the first reference value, and
- setting the illumination value as the RGB mode boundary value.
A method of monitoring an interior of an autonomous vehicle using an image sensor including a unit pixel composed of an infrared pixel and three primary color-pixels, the method comprising:
- setting an RGB mode boundary value that is expressed in illumination and an infrared mode boundary value having illumination lower than the RGB mode boundary value;
- acquiring an illumination value of the interior of the vehicle;
- and
- creating an RGB image and an infrared image from the image sensor in accordance with the illumination value, and driving in a common mode that creates both of the RGB image and the infrared image when the illumination value is less than the RGB mode boundary value and is the infrared mode boundary value or more,
- wherein driving in the common mode includes:
- calculating a detection ratio of RGB images that is a ratio of images from which landmarks disposed at a specific position of the interior of the vehicle are detected of several RGB images for a predetermined time,
- acquiring a detection ratio of IR images that is a ratio of images from which landmarks disposed at a specific position of the interior of the vehicle are detected of several IR images for a predetermined time, and
- performing monitoring on images having a larger value of the detection ratio of RGB images or the detection ratio of IR images.
A system for monitoring an interior of a vehicle, the system comprising:
- an image sensor that is disposed in the vehicle and includes a unit pixel the unit pixel including an infrared pixel and three primary color-pixels;
- an illumination sensor configured to acquire illumination of the interior of the vehicle;
- and
- a monitoring control module configured to create an RGB image and an infrared image from the image sensor in accordance with an illumination value corresponding to the illumination of the interior of the vehicle,
- wherein the monitoring control module is configured to create both of the RGB image and the infrared image when the illumination value is less than a predetermined RGB mode boundary value and is a predetermined infrared mode boundary value, and
- wherein the monitoring control module is configured to:
- calculate a detection ratio that is a ratio of images from which landmarks disposed at a specific position in the vehicle are detected of several RGB images,
- acquire an illumination value of the interior of the vehicle when the detection ratio is less than a predetermined first reference value and is a predetermined second reference value or more in a range lower than the first reference value, and
- set the illumination value as the RGB mode boundary value.
A system for monitoring an interior of a vehicle, the system comprising:
- an image sensor that is disposed in the vehicle and includes a unit pixel, the unit pixel including an infrared pixel and three primary color-pixels;
- an illumination sensor configured to acquire illumination of the interior of the vehicle;
- and
- a monitoring control module configured to create an RGB image and an infrared image from the image sensor in accordance with an illumination value corresponding to the illumination of the interior of the vehicle, wherein the monitoring control module is configured to create both of the RGB image and the infrared image when the illumination value is less than a predetermined RGB mode boundary value and is a predetermined infrared mode boundary value, and
- wherein the monitoring control module is configured to, in a common mode:
- calculate a detection ratio of RGB images that is a ratio of images from which landmarks disposed at a specific position of the interior of the vehicle are detected of several RGB images for a predetermined time,
- acquire a detection ratio of IR images that is a ratio of images from which landmarks disposed at a specific position of the interior of the vehicle are detected of several IR images for a predetermined time, and
- perform monitoring on images having a larger value of the detection ratio of RGB images or the detection ratio of IR images.
Dependencies are inferred from the claim text.