Computer systems and computer-implemented methods configured to track multiple eye-gaze and heartrate related parameters during users' interaction with electronic computing devices

A method, comprising:

• receiving, by at least one memory device, a sequence of images of a face of a user from an image capture device;
• generating, by at least one processor, a three-dimensional (3D) model of the face in the sequence of images according to a face recognition algorithm;
• determining, by the at least one processor, a plurality of 3D facial points associated with one or more flat facial surfaces on the 3D model of the face;
• projecting, by the at least one processor, the plurality of 3D facial points onto a screen coordinate plane to produce a plurality of two-dimensional (2D) facial points;
• wherein the screen coordinate plane comprises a set of coordinates relative to a screen in communication with the processor;
• determining, by the at least one processor, a hue of each pixel associated with each of the plurality of 2D facial points in each image of the sequence of images;
• determining, by the at least one processor, a mean hue value associated with each of the plurality of 2D facial points in each image of the sequence of images;
• wherein the mean hue value is determined with a moving window;
• determining, by the at least one processor, a spectral representation of a variation in the mean hue value for each of the plurality of 2D facial points across the sequence of images;
• determining, by the at least one processor, a frequency of a main hue based on a largest weight of the variation in the mean hue value for each of the plurality of 2D facial points across the sequence of images;
• determining, by the at least one processor, a heart rate based blood circulation to facial blood vessels according to the frequency of the main hue;
• determining, by the at least one processor, a phase of the heart rate based on the frequency of the main hue;
• determining, by the at least one processor, an average period of the heart rate;
• determining, by the at least one processor, phase differences based on a change in the phase across the sequence of images;
• determining, by the at least one processor, an absolute difference from the average period based on the phase differences to estimate heart rate variability of the user;
• and
• causing, by the at least one processor, to display with a screen an activity recommendation based at least on the heart rate variability.

A system, comprising:

• a memory device;
• a video capture device;
• and
• a processing device;
• wherein the processing device is configured to perform instructions stored in the memory device, the instructions comprising:
• receiving, by a memory device, a sequence of images of a face of a user from the video capture device;
• generating, by a processor, a three-dimensional (3D) model of the face in the sequence of images according to a face recognition algorithm;
• determining a plurality of 3D facial points associated with one or more flat facial surfaces on the 3D model of the face;
• projecting the plurality of 3D facial points onto a screen coordinate plane to produce a plurality of two-dimensional (2D) facial points;
• wherein the screen coordinate plane comprises a set of coordinates relative to a screen in communication with the processor;
• determining a hue of each pixel associated with each of the plurality of 2D facial points in each image of the sequence of images;
• determining a mean hue value associated with each of the plurality of 2D facial points in each image of the sequence of images;
• wherein the mean hue value is determined with a moving window;
• determining a spectral representation of a variation in the mean hue value for each of the plurality of 2D facial points across the sequence of images;
• determining a frequency of a main hue based on a largest weight of the variation in the mean hue value for each of the plurality of 2D facial points across the sequence of images;
• determining a heart rate based blood circulation to facial blood vessels according to the frequency of the main hue;
• determining a phase of the heart rate based on the frequency of the main hue;
• determining an average period of the heart rate;
• determining phase differences based on a change in the phase across the sequence of images;
• determining an absolute difference from the average period based on the phase differences to estimate heart rate variability of the user;
• and
• causing to display with a screen an activity recommendation based at least on the heart rate variability.