Passenger state analysis method and apparatus, vehicle, electronic device and storage medium

An electronic device, comprising:

• a memory, configured to store executable instructions;
• and
• a processor, configured to execute the executable instructions, when the executable instructions are executed, the processor is configured to:
• obtain a video stream of a rear seat area in a vehicle;
• perform face detection and body detection on at least one image frame in the video stream;
• determine state information of a passenger in the rear seat area according to a result of the face detection and body detection;
• and
• in response to the state information of the passenger satisfying a predetermined condition, output prompt information to a driver area or a specified device in the vehicle,
• wherein the processor is further configured to:
• determine whether the passenger is in an abnormal state according to the result of the face detection and body detection;
• and determine whether the passenger makes a dangerous action according to the result of the face detection and body detection;
• and
• in response to the passenger being in the abnormal state, the passenger making the dangerous action, the passenger being in the abnormal state for a preset period of time, or the passenger being in a dangerous action state for a preset period of time, output the prompt information to the driver area or the specified device in the vehicle,
• wherein the abnormal state comprises at least one of:
• irritability, choking, coughing, or pain;
• wherein the dangerous action comprises at least one of:
• opening a door, holding a device, unfastening a seat belt, extending a part of a body out of a window, leaving a specified area, or smoking;
• wherein the passenger comprises a child;
• wherein the result of the face detection and body detection comprises at least one of whether there is a face or whether there is a body;
• wherein the rear seat area comprises a child seat;
• wherein the processor is further configured to:
• determine whether the child is located on the child seat according to the result of the face detection and body detection;
• and
• in response to a childless state on the child seat exceeding a preset period of time, output the prompt information to the driver area or the specified device in the vehicle.

A non-transitory computer-readable storage medium, configured to store computer-readable instructions, wherein when the computer-readable instructions are executed by a processor, the processor is configured to perform the following operations:

• obtaining a video stream of a rear seat area in a vehicle;
• performing face detection and body detection on at least one image frame in the video stream;
• determining state information of a passenger in the rear seat area according to a result of the face detection and body detection;
• and
• in response to the state information of the passenger satisfying a predetermined condition, outputting prompt information to a driver area or a specified device in the vehicle,
• wherein the determining state information of the passenger in the rear seat area according to the result of the face detection and body detection comprises:
• determining whether the passenger is in an abnormal state according to the result of the face detection and body detection;
• and determining whether the passenger makes a dangerous action according to the result of the face detection and body detection;
• and
• the in response to the state information of the passenger satisfying the predetermined condition, outputting the prompt information to the driver area or the specified device in the vehicle comprises:
• in response to the passenger being in the abnormal state, the passenger making the dangerous action, the passenger being in the abnormal state for a preset period of time, or the passenger being in a dangerous action state for a preset period of time, outputting the prompt information to the driver area or the specified device in the vehicle,
• wherein the abnormal state comprises at least one of:
• irritability, choking, coughing, or pain;
• wherein the dangerous action comprises at least one of:
• opening a door, holding a device, unfastening a seat belt, extending a part of a body out of a window, leaving a specified area, or smoking;
• wherein the passenger comprises a child;
• wherein the result of the face detection and body detection comprises at least one of whether there is a face or whether there is a body;
• wherein the rear seat area comprises a child seat;
• the determining state information of the passenger in the rear seat area according to the result of the face detection and body detection further comprises:
• determining whether the child is located on the child seat according to the result of the face detection and body detection;
• and
• the in response to the state information of the passenger satisfying the predetermined condition, outputting the prompt information to the driver area or the specified device in the vehicle further comprises:
• in response to a childless state on the child seat exceeding a preset period of time, outputting the prompt information to the driver area or the specified device in the vehicle.