Brightness control of infotainment system in vehicles using eye-gaze estimation

An infotainment brightness control system for an infotainment system of a vehicle, the infotainment brightness control system comprising:

• a processing device configured with a pre-trained eye gaze detection module and a learning module, wherein the pre-trained eye gaze detection module comprises
• a first branch comprising
• a first neural network configured to regress corresponding images of an eye to gaze maps, and
• a second neural network configured to regress the gaze maps to a gaze direction represented by a yaw and pitch;
• and
• a second branch fed by the gaze maps and configured as a classification network configured to reduce entropy loss to enable a model to determine real gaze maps based on training with synthetic data,
• wherein the eye gaze detection module is pre-trained with synthetic or real time data including cropped images of eye regions;
• and
• a memory, wherein the processing device comprises a processor coupled with the memory, wherein the memory stores one or more instructions executable by the processor to
• determine, using the pre-trained eye gaze detection module, based on one or more images of one or more eye region of a user, a yaw and a pitch indicative of a gaze direction of the user for a real-time frame and one or more previous time frames;
• estimate, using the learning module, a subsequent eye gaze direction of the user based on the gaze directions determined for the real-time frame and the one or more previous time frames;
• and
• transmit a set of control signals to the infotainment system to adjust brightness of a display of the infotainment system at a predefined level based on an overlap between one or more regions of interest associated with an interior of the vehicle, and the estimated subsequent gaze direction.

A method for controlling brightness of an infotainment system of a vehicle, the method comprising:

• determining, by a processing device configured with a pre-trained eye gaze detection module, a yaw and a pitch indicative of a gaze direction of a user for a real-time frame and one or more previous time frames based on one or more images of one or more eye region of the user;
• estimating, using a learning module of the processing device, a subsequent eye gaze direction of the user based on corresponding gaze directions determined for the real-time frame and the one or more previous time frames;
• and
• adjusting the brightness of a display of the infotainment system at a predefined level based on an overlap between one or more region of interest associated with an interior of the vehicle, and the estimated subsequent eye gaze direction.