Distracted driver detection device
OwnerAnanya K. Sridharinventor
Life of this patent
Estimating the term…
Abstract
A distracted driver detection device for use in a vehicle includes a processor, a video camera, and an accelerometer. The processor is configured to compute an eye open ratio (EOR) and a mouth open ratio (MOR). The processor is configured to provide an audio alert signal to an audio alert component and provide a visual alert signal to a visual alert component when the EOR is less than an EOR threshold for a prescribed EOR assessment time, when the MOR is greater than the MOR threshold for a prescribed MOR assessment time, or when the estimate of the acceleration is greater than an acceleration threshold. The EOR and MOR are calculated from facial landmarks that are generated by a Histogram of Oriented Gradients (HOG) algorithm implemented by the processor.
Claims18
A distracted driver detection device, comprising:
- a processor including a central processing unit (CPU), random access memory (RAM) containing volatile memory, and a secure digital (SD) card containing non-volatile memory;
- a video camera configured to provide video input to the processor;
- an accelerometer configured to provide acceleration input to the processor;
- a visual alert component, the visual alert component being configured to generate a visual alert upon receiving a visual alert signal from the processor;
- an audio alert component, the audio alert component being configured to generate an audio alert upon receiving an audio alert signal from the processor;
- and
- a wireless communication component connected to the processor, the wireless communication component being configured to provide a wireless message upon receiving a wireless alert signal from the processor;
- wherein the SD card contains instructions including Open-Source Computer Vision Library (OpenCV) and Dlib, executable by the CPU, which configure the processor to:
- identify a left eye shape structure of a driver using the video input, the left eye shape structure including at least 6 facial landmarks;
- identify a right eye shape structure of a driver using the video input, the right eye shape structure including at least 6 facial landmarks;
- compute an eye open ratio (EOR) as an average of a left EOR of the left eye shape structure and a right EOR of the right eye shape structure;
- identify a mouth shape structure of a driver using the video input, the mouth shape structure including at least 20 facial landmarks;
- compute a mouth open ratio (MOR) using the mouth shape structure;
- generate an estimate of an acceleration using the acceleration input;
- provide the audio alert signal to the audio alert component and provide the visual alert signal to the visual alert component when the EOR is less than an EOR threshold for consecutive frames in a prescribed EOR assessment time;
- provide the audio alert signal to the audio alert component and provide the visual alert signal to the visual alert component when the MOR is greater than an MOR threshold for consecutive frames in a prescribed MOR assessment time;
- provide the audio alert signal to the audio alert component and provide the visual alert signal to the visual alert component when the estimate of the acceleration is greater than an acceleration threshold;
- and
- provide the wireless alert signal to the wireless communication component when the processor has provided at least three of the audio alert signals.
Dependencies are inferred from the claim text.