Gaze-responsive advertisement

A system for creating gazed-based advertising content, the system comprising:

• an image processing module comprising:
• an incoming video stream;
• an identification module to receive the incoming video stream and identify at least one advertisable item in a frame and provide a list of bitmaps for the at least one advertisable item;
• an advertisement library comprising a list of advertisable items and a corresponding URL to each advertisable item, wherein the advertisable items are in a bitmap format;
• and
• an ad mapper configured to compare the bitmaps from the identification module to the bitmaps from the advertisement library in order to provide a URL related to the at least one advertisable item,
• wherein the image processing module outputs the advertisable item coordinates from the identification module and the URL associated with an advertisement associated with the at least one advertisable item.

A method to insert advertisement data based on a user's gaze location, the method comprising:

• receiving a video stream, the video stream including gaze metadata comprising (x,y) coordinates representing one or more advertisable items in the video stream;
• detecting a gaze of a viewer;
• using a gaze detection algorithm to determine (x,y) coordinates of the viewer attention on a display device;
• calculating an Area of Interest AOI corresponding to each of the one or more advertisable items using the (x,y) coordinates of the gaze metadata and the video stream;
• comparing the AOI with the (x,y) coordinates of the viewer attention;
• determining if the AOI matches the viewer attention;
• and
• if the AOI matches the viewer attention, selecting an advertisement URL;
• and
• rendering an advertisement corresponding to the advertisement URL.

A method for gaze advertisement, the method comprising:

• detecting a gaze associated with a viewer;
• using a gaze detection algorithm to determine (x,y) coordinates of the viewer attention relative to a display device;
• receiving a video stream, wherein the video stream comprises gaze metadata, the gaze metadata comprising frame quadrant location data corresponding to one or more advertisable items in the video stream;
• determining a frame quadrant corresponding to to the (x,y) coordinates of the viewer's attention relative to the display;
• selecting an advertisement URL based on the determined frame quadrant and the gaze metadata;
• and
• rendering an advertisement corresponding to the advertisement URL.

A method for gaze advertisement insertion, the method comprising:

• detecting a gaze direction of the at least one viewer relative to a display device, wherein the detection of the gaze is determined by head pose estimation methods;
• receiving a video stream, wherein the video stream comprises gaze metadata, the gaze metadata comprising frame location data corresponding to one or more advertisable items in the video stream;
• determining within the gaze metadata, if an advertisable item of the one or more advertised items is present in the left half of the frame or the right half of the frame;
• determining if the viewer's gaze direction corresponds to the determined half of the frame which comprises the advertisable item of the one or more advertised items;
• and
• rendering an advertisement if the gaze direction corresponds to the half of the frame which comprises the advertisable item of the one or more advertised items.

A system for to insert advertisement data based on a user's gaze location, the system comprising:

• a processor configured to:
• receive a video stream, the video stream including gaze metadata location data representing one or more advertisable items in the video stream;
• detect a gaze of a viewer;
• use a gaze detection algorithm to determine a gaze direction of the viewer;
• calculate an Area of Interest AOI corresponding to each of the one or more advertisable items using the location data of the gaze metadata and the video stream;
• compare the AOI with the gaze direction of the viewer;
• determine if the AOI matches the gaze direction of the viewer;
• and
• if the AOI matches the gaze direction of the viewer, select an advertisement URL;
• and
• render an advertisement corresponding to the advertisement URL.