Method and system for determining an activity of an occupant of a vehicle

A system comprising computer hardware components configured to determine an activity of an occupant of a vehicle by:

• capturing sensor data, including data from a camera sensor, of the occupant from at least one sensor of the vehicle;
• determining respective two-dimensional or three-dimensional coordinates for a plurality of pre-determined portions of the body of the occupant based on the sensor data;
• determining at least one portion of the sensor data showing a pre-determined body part of the occupant based on the sensor data and the two-dimensional or three-dimensional coordinates;
• and
• determining the activity of the occupant based on the two-dimensional or three-dimensional coordinates and the at least one portion of the sensor data by classifying the activity into one or more classes of actions using an artificial neural network trained to evaluate temporal aspects of actions.

A non-transitory computer readable medium comprising instructions that when executed, configure computer hardware components of a system to determine an activity of an occupant of a vehicle by:

• capturing sensor data, including data from a camera sensor, of the occupant from at least one sensor of the vehicle;
• determining respective two-dimensional or three-dimensional coordinates for a plurality of pre-determined portions of the body of the occupant based on the sensor data;
• determining at least one portion of the sensor data showing a pre-determined body part of the occupant based on the sensor data and the two-dimensional or three-dimensional coordinates;
• and
• determining the activity of the occupant based on the two-dimensional or three-dimensional coordinates and the at least one portion of the sensor data by classifying the activity into one or more classes of actions using an artificial neural network trained to evaluate temporal aspects of actions.