Systems and methods for enabling facial browsing of a display based on movement of facial features

A user device, comprising:

• one or more processors configured to:
• receive an image of a user from a camera associated with a display of the user device;
• process the image, with a neural network model, to identify a face of the user and key markers of the face;
• process the face and the key markers, with the neural network model, to identify features of the face;
• calculate a z-index representing a distance between the face and the display, based on the features,
• wherein the one or more processors, to calculate the z-index, are configured to:
• calculate an area of a triangle formed by a left portion of a forehead of the face, a right portion of the forehead, and a nose of the face;
• determine a width and a height of a display area of the display;
• and
• calculate the z-index by dividing the width and the height by the area of the triangle;
• calculate left and right face rotation along an x-axis of the display, based on the features;
• calculate up and down face rotation along a y-axis of the display, based on the features;
• calculate an x-position and a y-position of a cursor on the display based on the left and right face rotation, the up and down face rotation, and the z-index;
• provide the x-position and the y-position of the cursor to the display;
• and
• perform facial browsing of the display based on movements of the face of the user.

A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:

• one or more instructions that, when executed by one or more processors of a user device, cause the user device to:
• receive an image of a user from a camera associated with a display of the user device;
• process the image, with a neural network model, to identify a face of the user and key markers of the face;
• process the face and the key markers, with the neural network model, to identify features of the face;
• calculate a z-index representing a distance between the face and the display, based on the features;
• calculate left and right face rotation along an x-axis of the display, based on the features;
• calculate up and down face rotation along a y-axis of the display, based on the features;
• calculate an x-position and a y-position of a cursor on the display based on the left and right face rotation, the up and down face rotation, and the z-index;
• provide the x-position and the y-position of the cursor to the display;
• determine cursor positions on the display at different time periods;
• and
• generate a heatmap indicating a browsing pattern of the user based on the cursor positions and the different time periods.