Vehicle interior object management

A computer program product embodied in a non-transitory computer readable medium for vehicle management, the computer program product comprising code which causes one or more processors to perform operations of:

• collecting two or more images of a vehicle interior using one or more imaging devices within the vehicle;
• determining a human perception metric based on the two or more images, wherein the human perception metric includes a cognitive load for an occupant of the vehicle;
• analyzing the two or more images to detect an object within the vehicle;
• classifying the object within the vehicle;
• collecting audio information from within the vehicle;
• matching a portion of the audio information to at least one of the two or more images;
• estimating a level of interaction between the object and the occupant of the vehicle, wherein the estimating the level of interaction includes calculating an interaction metric and wherein the estimating is also based on the matched portion of the audio information;
• and
• changing a control element of the vehicle based on the classifying and the level of interaction.

A computer system for vehicle management comprising:

• a memory which stores instructions;
• one or more processors attached to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to:
• collect two or more images of a vehicle interior using one or more imaging devices within the vehicle;
• determine a human perception metric based on the two or more images, wherein the human perception metric includes a cognitive load for an occupant of the vehicle;
• analyze the two or more images to detect an object within the vehicle;
• classify the object within the vehicle;
• collect audio information from within the vehicle;
• match a portion of the audio information to at least one of the two or more images;
• estimate a level of interaction between the object and the occupant of the vehicle, wherein the estimating the level of interaction includes calculating an interaction metric and wherein the estimating is also based on the matched portion of the audio information;
• and
• change a control element of the vehicle based on the classifying and the level of interaction.