Back to results
US 12,086,829 B2Granted
Marketing and couponing in a retail environment using computer vision
AssigneeGrabango Co.
InventorsWilliam Glaser, Brian Van Osdol
Life of this patent
Estimating the term…
Abstract
A system and method for digital retail marketing and couponing in a physical retail environment that includes collecting image data across a retail environment; tracking a user within the retail environment; processing the image data and detecting a customer-item interaction event in association with the user; and based in part on the customer-item interaction event, delivering content to an output interface.
Claims16
A method for digital communication in a physical environment comprising:
- collecting, from a set of image capture devices, image data across the physical environment;
- tracking, based on processing of the image data, an identified user within the retail environment;
- synchronizing the identified user in the image data to a detected application instance located within the physical environment, the application instance being operable on a computing device of the identified user;
- modeling, using processing of the image data and using pose estimation, attention of the identified user and determining a retail item based on the attention of the identified user and based on relative position of the user to the retail item;
- detecting, based on processing of the image data, a customer-item interaction event between the identified user and the retail item;
- monitoring a proximity threshold based on proximity of the identified user to the retail item;
- and
- in response to detecting the customer-item interaction event and while the identified user is within the proximity threshold, initiating a real-time content delivery auction, comprising selecting a set of auction bids based in part on the retail item and the identified user, ranking the set of auction bids, selecting content of a digital message based on the ranking of the set of auction bids, and, while the identified user is within the proximity threshold, transmitting, via a network, the digital message to the computing device.
5 more elements
A system for digital communication in a physical environment which comprises:
- a computer vision monitoring system that comprises a set of imaging devices installed in the environment, and that is configured to:
- collect, from the set of imaging devices, image data of the environment,
- track a set of users within the retail environment,
- for an identified user of the set of users, synchronize the identified user in the image data to a detected application instance located within the physical environment, the application instance being operable on a computing device of the identified user,
- model, using processing of the image data and pose estimation, attention of the identified user and determining a retail item based on the attention of the identified user and based on relative position of the user to the retail item,
- for the identified user, process the image data and detect a customer-item interaction event between the identified user and the retail item,
- monitor a proximity threshold based on proximity of the identified user to the retail item;
- and
- a content marketing system configured to, in response to detection of the customer-item interaction event and while the identified user is within the proximity threshold, initiate a real-time content delivery auction, which comprises:
- selecting a set of auction bids based in part on the retail item and the identified user,
- ranking the set of auction bids,
- selecting content of a digital message based on the ranking of the set of auction bids, and
- while the identified user is within the proximity threshold, transmitting, via a network, the digital message to the computing device.
10 more elements
Dependencies are inferred from the claim text.