Gaze prediction model construction method and apparatus, gaze prediction method and apparatus, electronic device, and storage medium

An electronic device, comprising:

• a processor;
• a memory storing programs and/or instructions, wherein the programs and/or instructions, when executed by the processor, cause the processor to implement:
• inputting a first eye sample image and a second eye sample image into an auxiliary prediction model to obtain gaze difference description information, wherein the gaze difference description information is configured to represent a gaze difference between the first eye sample image and the second eye sample image;
• inputting the first eye sample image and the second eye sample image into the gaze prediction model to be constructed to obtain predicted gaze information, where the predicted gaze information comprises a first predicted gaze parameter of the first eye sample image and a second predicted gaze parameter of the second eye sample image;
• determining a loss of the gaze prediction model to be constructed based on the gaze difference description information and the predicted gaze information;
• in response to that the loss of the gaze prediction model to be constructed does not meet a convergence condition, updating model parameters of the gaze prediction model to be constructed based on the gaze difference description information and the predicted gaze information;
• and/or, in response to that the loss of the gaze prediction model to be constructed meets the convergence condition, determining the gaze prediction model to be constructed as the gaze prediction model.

A non-transitory computer-readable storage medium storing computer instructions which, when executed by a computer, cause the computer to implement:

• inputting a first eye sample image and a second eye sample image into an auxiliary prediction model to obtain gaze difference description information, wherein the gaze difference description information is configured to represent a gaze difference between the first eye sample image and the second eye sample image;
• inputting the first eye sample image and the second eye sample image into the gaze prediction model to be constructed to obtain predicted gaze information, where the predicted gaze information comprises a first predicted gaze parameter of the first eye sample image and a second predicted gaze parameter of the second eye sample image;
• determining a loss of the gaze prediction model to be constructed based on the gaze difference description information and the predicted gaze information;
• in response to that the loss of the gaze prediction model to be constructed does not meet a convergence condition, updating model parameters of the gaze prediction model to be constructed based on the gaze difference description information and the predicted gaze information;
• and/or, in response to that the loss of the gaze prediction model to be constructed meets the convergence condition, determining the gaze prediction model to be constructed as the gaze prediction model.