# US 12,118,510 B2 · Intelligent marketing and advertising platform > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,510 B2 - Document ID: US12118510B2 - Status: Granted - Kind: B2 - Application number: 18/368,674 - Filed: 2023-09-15 - Published: 2024-01-04 - Granted: 2024-10-15 - Earliest claimed: 2017-08-10 - Assignees: Cooler Screens Inc. - Applicants: Cooler Screens - Inventors: Arsen Avakian; Robert Edwin Dravenstott - Web page: https://patentgrep.com/patent/US12118510B2 ## CPC - G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders - G06Q 30/0261: {based on user location} - G06Q 10/08724: {by shelf level inventory management, e.g. planograms} - G06Q 10/0877: {by inventory control or reporting using inventory tracking or counting} - G06Q 30/0201: Market modelling; Market analysis; Collecting market data - G06Q 30/0281: {Customer communication at a business location, e.g. providing product or service information, consulting} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/161: {Detection; Localisation; Normalisation} - G09F 9/30: in which the desired character or characters are formed by combining individual elements (panels comprising a number of electrodes in a single cell controlling light arriving from an independent light source, e.g. electro-optical or magneto-optical cell, G02F1/00) - H04N 7/183: {for receiving images from a single remote source} - G06Q 10/08744: {by distributed inventory management} - G06V 40/178: {estimating age from face image; using age information for improving recognition} - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G09F: DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An intelligent marketing and advertising platform which provides an innovative merchandising solution for retailers by effectively transforming the glass surface of retail product containers (such as cooler doors) into a non-transparent display of planograms. The merchandising solution provides for digital planograms and pricing management, real time promotional updates and sales data, etc. This is accomplished by converting/transforming the simple glass surface of a retail product container (such as cooler/freezer doors) into digital “smart” screens that provide for innovative advertising solutions. The cooler/freezer doors are configured to use at least one camera to capture images when the doors are opened, in order to effectively take inventory of what is inside the cooler/freezer. ## Claims ### Claim 1 A retail product container comprising: a display case door comprising an insulated panel assembly, and a door frame extending about and secured to a peripheral edge of the insulated panel assembly; a non-transparent display which prohibits viewing of an internal storage volume of the retail product container and is secured on the display case door of the retail product container, wherein the display case door of the retail product container is movable from an open position to a closed position, and wherein when in the closed position, one or more retail products physically contained in the retail product container are blocked from viewability from outside the retail product container, wherein the non-transparent display comprises an LCD panel with one or more touch zones; customer-detecting hardware comprising one or more customer-facing cameras mounted on the display case door of the retail product container configured to monitor customer presence; inventory-taking hardware comprising: at least one camera mounted on a back of the display case door facing retail products physically contained in the internal storage volume of the retail product container, wherein the at least one camera is housed within an empty bezel space between the non-transparent display and the door frame, and wherein the at least one camera is triggered by a door motion to capture images at a predetermined interval during a door operation, and at least one sensor disposed inside the retail product container to monitor the door motion during the door operation; and a controller in communication with the retail product container, wherein the controller is configured to control the non-transparent display of the retail product container such that the non-transparent display provides a planogram relating to the retail products physically contained in the internal storage volume of the retail product container based on inventory taken by said controller using the inventory-taking hardware of the retail product container, wherein the controller is configured to control the non-transparent display of the retail product container to display current pricing information regarding products physically contained in the internal storage volume of the retail product container, wherein the current pricing information is dictated by the controller, wherein the controller is configured to detect customers using the customer-detecting hardware, and wherein the controller is configured to display promotions on the non-transparent display of the retail product container based on what is detected by the controller using the customer-detecting hardware, wherein the controller uses the inventory-taking hardware to capture at least one image of the internal storage volume when the display case door is opened. ### Claim 2 (depends on 1) The retail product container of claim 1, wherein the customer-detecting hardware further comprises a proximity sensor, a camera, a facial sensor and an eye-sensor. ### Claim 3 (depends on 1) The retail product container of claim 1, wherein the one or more customer-facing cameras have a depth of field of view of twenty feet or more, and have a range of field of view of 170 degrees with preferably 150 degree of facial recognition ability. ### Claim 4 (depends on 1) The retail product container of claim 1, wherein the non-transparent display provides the planogram that optimizes a presentation of retail products which are blocked from view by other retail products, and wherein the non-transparent display comprises at least one of a background effects layer, a persistent labels layer, an inventory product assets and effects layer, a shelf-space effects layer, a labels and tags advertising products layer, an overlay advertising products layer and a foreground glass effect layer. ### Claim 5 (depends on 1) The retail product container of claim 1, wherein the display case door further comprises: a display retainer secured to the door frame and the display retainer comprises a mounting bezel secured to the door frame, the mounting bezel having a coupling end that is arranged to extend over an edge of the non-transparent display to secure the non-transparent display to the door frame; a transparent protective panel configured to be positioned between a front surface of the non-transparent display and the coupling end of the mounting bezel; and a cover bezel configured to couple with a front surface of the door frame, the cover bezel sized to overlay the front surface of the door frame and the coupling end of the mounting bezel. ### Claim 6 (depends on 1) The retail product container of claim 1, wherein the controller is configured to operate the non-transparent display to display the planogram of the retail products after determining that no motion is detected by the customer-detecting hardware. ### Claim 7 (depends on 1) The retail product container of claim 1, wherein the controller is configured to operate the non-transparent display to display the planogram relating to the retail products physically contained in the internal storage volume of the retail product container after determining that a motion is detected by the customer-detecting hardware. ### Claim 8 (depends on 1) The retail product container of claim 1, wherein the controller is configured to operate the non-transparent display to display promotional labels and tags after determining that a customer is within a predetermined distance from the retail product container, as detected by the customer-detecting hardware. ### Claim 9 (depends on 1) The retail product container of claim 1, wherein the controller is configured to operate the non-transparent display to display advertisement specific to a particular customer after determining that the particular customer lingers with a proximity of the retail product container for predetermined period of time, as detected by the customer-detecting hardware. ### Claim 10 (depends on 1) The retail product container of claim 1, wherein the retail product container comprises a cooler or a freezer and the non-transparent display of the retail product container is mounted on the display case door of said cooler or said freezer. ### Claim 11 (depends on 1) The retail product container of claim 1, wherein the inventory-taking hardware comprises at least one camera which captures at least one image when the display case door is opened. ### Claim 12 (depends on 11) The retail product container of claim 11, wherein the at least one camera captures a plurality of images when the display case door is opened. ### Claim 13 (depends on 1) The retail product container of claim 1, wherein the at least one camera starts taking images upon the at least one camera detecting the display case door being opened. ### Claim 14 (depends on 1) The retail product container of claim 1, wherein the at least one sensor comprises at least one accelerometer on the display case door, wherein the at least one camera starts capturing images upon the at least one accelerometer detecting the display case door being opened. ### Claim 15 (depends on 14) The retail product container of claim 14, wherein the at least one camera is positioned at a handle side of the display case door with a predetermined tilt towards a hinge side of the door without having a view of the at least one camera blocked by the non-transparent display. ### Claim 16 (depends on 15) The retail product container of claim 15, wherein the predetermined tilt is 40 degrees. ### Claim 17 (depends on 14) The retail product container of claim 14, wherein the at least one camera comprises three cameras. ### Claim 18 (depends on 14) The retail product container of claim 14, wherein the at least one camera consists of two cameras. ### Claim 19 (depends on 1) The retail product container of claim 1, wherein the at least one camera is positioned to protrude past an edge of the non-transparent display. ### Claim 20 A system comprising: a server comprising: one or more server processors; and a server memory storing computer-executable instructions that, when executed by the one or more server processors, cause the server to: identify, via image recognition using inventory-taking hardware affixed to a retail product container, an inventory of one or more retail products physically contained in the retail product container; generate a planogram of the one or more retail products physically contained in the retail product container; display, on a non-transparent display on a door of the retail product container, the planogram, wherein the door of the retail product container is movable from an open position to a closed position, and wherein when in the closed position, the non-transparent display blocks viewability from outside of the retail product container of the one or more retail products physically contained in the retail product container; determine, in real-time, current pricing information regarding the one or more retail products physically contained in the retail product container; detect, using customer-detecting hardware, that a customer has lingered within a proximity of the retail product container for a predetermined period of time; determining, in real-time, promotions related to the customer detected by the customer-detecting hardware; and display, on the non-transparent display, the promotions related to the customer and the current pricing information regarding the one or more retail products physically contained in the retail product, wherein the door comprises an insulated panel assembly, and a door frame extending about and secured to a peripheral edge of the insulated panel assembly; wherein the non-transparent display comprises an LCD panel with one or more touch zones; and wherein the inventory-taking hardware comprises: at least one camera mounted on a back of the door of the retail product container and the at least one camera face retail products physically contained in an internal storage volume of the retail product container, wherein the at least one camera is housed within an empty bezel space between the non-transparent display and a mechanical frame of the door, and wherein the at least one camera is triggered by a door motion to capture images at a predetermined interval during a door operation, and at least one sensor disposed inside the retail product container to monitor a door motion during the door operation, and wherein the customer-detecting hardware comprising one or more customer-facing cameras mounted on the door of the retail product container configured to monitor customer presence.