An active safety driver assistance system based on real-time driver state monitoring, comprising:
- a driver state monitoring unit comprising an abnormal behavior monitoring module, configured to:
- monitor a sentiment and/or a driving behavior and/or a physical fatigue state of a driver in real time, perform sentiment identification and/or behavior analysis and/or fatigue state determination, be associated with a vehicle control unit directly or through an on-board gateway unit based on a real-time sentiment identification result and/or an abnormal behavior analysis result and/or a fatigue state determination result, and intelligently control an operating state of a vehicle;
- the driver state monitoring unit monitors a sentiment and/or a driving behavior and/or a physical fatigue state of a driver in real time, which may be transmitted to a remote management unit for the sentiment identification and/or the behavior analysis and/or the fatigue state determination through an edge computing module of the state monitoring unit hardware, an edge computing module of the on-board gateway unit, or a network communication module of the on-board gateway unit, be associated with the vehicle control unit directly or through the on-board gateway unit based on the real-time sentiment identification result and/or the abnormal behavior analysis result and/or the fatigue state determination result or a management command generated acquired from the remote management unit through the on-board gateway unit that is generated based on the real-time sentiment identification result and/or the abnormal behavior analysis result and/or the fatigue state determination result, and controls an operating state of an anti-lock module, a speed limit management module, an intelligent brake management module, or an electronic brake assist module to perform speed limit, speed control, or deceleration;
- the on-board gateway unit, associated with the driver state monitoring unit, the vehicle control unit, an alarm prompt unit, and a remote management unit and configured to complete driver state monitoring in cooperation with the driver state monitoring unit;
- the vehicle control unit, linked to a starting system, a speed control system, and a braking system of the vehicle, associated with the on-board gateway unit and the driver state monitoring unit, and configured to control a travelling state of the vehicle based on the real-time sentimental state analysis result, the driving behavior analysis result, and the fatigue state determination result of the driver sent by the driver state monitoring unit or the on-board gateway unit;
- the alarm prompt unit, connected to and in cooperation with the driver state monitoring unit and the on-board gateway unit;
- the remote management unit, configured to:
- complete the driver state monitoring through cooperation between the vehicle control unit and the driver state monitoring unit, provide a corresponding vehicle and driver management control command, and feed back the vehicle and driver management control command to the on-board gateway unit, and
- wherein the abnormal behavior monitoring module of the driver state monitoring unit comprises a head and face video acquisition device, a panoramic body video acquisition device, and an abnormal behavior analysis and identification device;
- the head and face video acquisition device is configured to acquire head and face movements of the current driver;
- the panoramic body video acquisition device is configured to acquire a body movement and a pose of the current driver;
- and
- the abnormal behavior analysis and identification device is configured to perform intelligent analysis and identification based on the head and face movements acquired by the head and face video acquisition device and the body movement and the pose acquired by the panoramic body video acquisition device, to determine whether a real-time behavior state of the current driver is abnormal.