Generating a product recommendation based on a user reaction

A mobile device, comprising:

• one or more memories;
• and
• one or more processors, communicatively coupled to the one or more memories, to:
• obtain, via a first camera of the mobile device, an image that includes image data concerning a product;
• prompt a user of the mobile device to comment on the product;
• obtain, while prompting the user to comment on the product, first audio data concerning a first utterance of the user;
• obtain, from a second camera and while prompting the user to comment on the product, first video data concerning a first facial expression of the user,
• the first camera facing a different direction than the second camera;
• process the first audio data and the first video data to cause a first reaction of the user to the product to be determined;
• cause, after obtaining the image, display of the image and an augmented reality (AR) overlay superimposed on the image by the mobile device;
• prompt the user to comment on the display of the image and the AR overlay;
• obtain, while prompting the user to comment on the display of the image and the AR overlay, second audio data concerning a second utterance of the user;
• obtain, from the second camera of the mobile while prompting the user to comment on the display of the image and the AR overlay, second video data concerning a second facial expression of the user;
• process the second audio data and the second video data to cause a second reaction of the user to the image and the AR overlay to be determined;
• cause a product recommendation model to be trained using the first reaction and the second reaction;
• and
• send a product recommendation profile generated based on the product recommendation model to a remote device.

A non-transitory computer-readable medium storing instructions, the instructions comprising:

• one or more instructions that, when executed by one or more processors of a mobile device, cause the one or more processors to:
• obtain, via a first camera of the mobile device, an image that includes image data concerning a product;
• obtain, while obtaining the image, first audio data concerning a first utterance of a user of the mobile device;
• obtain, by a second camera of the mobile device and while obtaining the image, first video data concerning a first eye gaze direction of the user;
• process the first audio data and the first video data to cause a first reaction of the user to the image to be determined;
• cause, after obtaining the image, display of the image and an overlay superimposed on the image by the mobile device;
• obtain, after causing display of the image and the overlay, second audio data concerning a second utterance of the user;
• obtain, by the second camera of the mobile device and after causing display of the image and the overlay, second video data concerning a second eye gaze direction of the user;
• process the second audio data and the second video data to cause a second reaction of the user to the image and the overlay to be determined;
• cause a product recommendation model to be retrained using the first reaction and the second reaction;
• and
• cause display of a product recommendation by the mobile device.