Cognitive state based vehicle manipulation using near-infrared image processing

A computer program product embodied in a non-transitory computer readable medium for image-based analysis, the computer program product comprising code which causes one or more processors to perform operations of:

• obtaining a plurality of images of a vehicle occupant using one or more imaging devices within a vehicle, wherein the plurality of images includes facial data of the vehicle occupant and wherein the plurality of images includes visible light-based images and near-infrared based images;
• training, using a first computing device, a classifier, based on visible light content of the plurality of images to determine cognitive state data for the vehicle occupant;
• modifying the classifier based on near-infrared content from the plurality of images;
• deploying, on a second computing device, the classifier that was modified, for analysis of a plurality of additional images of a vehicle occupant that is obtained, wherein the plurality of additional images comprises near-infrared based images;
• analyzing, using the second computing device, the plurality of additional images to determine a cognitive state;
• and
• manipulating the vehicle, based on the cognitive state that was analyzed.

A computer system for image-based analysis comprising:

• a memory which stores instructions;
• one or more processors attached to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to:
• obtain a plurality of images of a vehicle occupant using one or more imaging devices within a vehicle, wherein the plurality of images includes facial data of the vehicle occupant and wherein the plurality of images includes visible light-based images and near-infrared based images;
• train, using a first computing device, a classifier, based on visible light content of the plurality of images to determine cognitive state data for the vehicle occupant;
• modify the classifier based on near-infrared content from the plurality of images;
• deploy, on a second computing device, the classifier that was modified, for analysis of a plurality of additional images of a vehicle occupant that is obtained, wherein the plurality of additional images comprises near-infrared based images;
• analyze, using the second computing device, the plurality of additional images to determine a cognitive state;
• and
• manipulate the vehicle, based on the cognitive state that was analyzed.