# US 12,002,071 B2 · Method and system for gesture-based cross channel commerce and marketing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,002,071 B2 - Document ID: US12002071B2 - Status: Granted - Kind: B2 - Application number: 16/921,105 - Filed: 2020-07-06 - Published: 2020-12-24 - Granted: 2024-06-04 - Earliest claimed: 2013-09-25 - Assignees: Transform Sr Brands LLC - Applicants: Transform Sr Brands LLC - Inventors: Vijan Bhaumik; Shubham Agarwal - Web page: https://patentgrep.com/patent/US12002071B2 ## CPC - G06Q 30/0269: {based on user profile or attribute} - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract A computing device (e.g., a server) coupled to a digital signage device may receive characteristic information associated with a visitor of the digital signage device. The received characteristic information may be analyzed, and based on a result of the analysis, advertisement attributes may be determined. The computing device may select, based on the determined advertisement attributes, a particular advertisement from a plurality of advertisement bids. The computing device may cause display of the selected particular advertisement on the digital signage device for the visitor. The characteristic information may be generated by the digital signage device utilizing a video analytics. The computing device may receive particular gesture information associated with a mobile device of the visitor who responds to the displayed particular advertisement. The computing device may cause a cloud computing platform to push content associated with the particular advertisement into the mobile device for the visitor to place an order. ## Claims ### Claim 1 A method, comprising: displaying an advertisement on a digital signage device; receiving, from a camera of the digital signage device, an image of a visitor performing a particular motion-based gesture, wherein the image of the visitor comprises a plurality of captured video images, and wherein the particular motion-based gesture is determined according to video analytics of the plurality of captured video images; receiving, via a first communication link from a mobile computing device of the visitor, an accelerometer measurement associated with the particular motion-based gesture; receiving, from a cloud network, a location of the visitor and a profile of the visitor, wherein: the location of the visitor and the profile of the visitor are sent, from the mobile computing device to the cloud network via a second communication link that is different than the first communication link, and access to the location of the visitor and the profile of the visitor is enabled in response to the mobile computing device detecting the particular motion-based gesture; generating, from the image of the visitor, characteristic information associated with the visitor of the digital signage device; determining advertisement attributes according to an analysis of the characteristic information; receiving, based on the determined advertisement attributes, a plurality of advertisements, wherein each advertisement of the plurality of advertisements is associated with a bid; displaying one or more of the plurality of advertisements via a multi-zone display; capturing an action of the visitor regarding the multi-zone display; selecting, a particular advertisement, from among the plurality of advertisements, according to the action of the visitor and which advertisement is associated with a winning bid; and pushing content associated with the particular advertisement into the mobile computing device of the visitor. ### Claim 2 (depends on 1) The method according to claim 1, comprising: displaying the particular advertisement on the digital signage device. ### Claim 3 (depends on 2) The method according to claim 2, wherein the characteristic information associated with the visitor comprises one or more of the following: demographic information; behavioral information; and location information in a field-of-view captured by the camera. ### Claim 4 (depends on 2) The method according to claim 2, wherein the characteristic is generated according to an analysis of video images captured by the camera. ### Claim 5 (depends on 1) The method according to claim 1, wherein the accelerometer measurement is associated with the motion-based gesture according to an analysis of video images captured by the camera. ### Claim 6 (depends on 1) The method according to claim 1, comprising: displaying a first version of the advertisement and a second version of the advertisement; and determining, based on a statistical analysis, whether the first version or the second version is displayed. ### Claim 7 (depends on 1) The method according to claim 1, wherein the location of the visitor and the profile of the visitor are associated with a particular application running on the mobile computing device. ### Claim 8 (depends on 1) The method according to claim 1, comprising testing a plurality of versions of the particular advertisement, wherein said testing comprises: receiving, from the digital signage device, action information associated with the visitor who views a first version of the particular advertisement; analyzing statistically the received action information associated with the first version of the particular advertisement and one or more other versions of the particular advertisement; and determining, based on a result of the analysis of the action information, a particular version among the plurality of versions for display on the digital signage device. ### Claim 9 (depends on 8) The method according to claim 8, wherein the action information comprises one or more of audience impression, viewing time, viewer facial gesture and viewer interaction. ### Claim 10 (depends on 8) The method according to claim 8, wherein the action information is generated by the digital signage device utilizing one or both of: video images captured by the camera, and sensor information captured by a sensor of the digital signage device. ### Claim 11 A system, comprising: a digital signage device operable to display an advertisement, wherein the digital signage device comprises: a camera operable to capture an image of a visitor performing a particular motion-based gesture, wherein the image of the visitor comprises a plurality of captured video images; and a processor operable to: utilize video analytics to determine the particular motion-based gesture according to of the plurality of captured video images, receive, via a first communication link from a mobile computing device of the visitor, an accelerometer measurement associated with the particular motion-based gesture; receive, from a cloud network, a location of the visitor and a profile of the visitor, wherein: the location of the visitor and the profile of the visitor are sent, from the mobile computing device to the cloud network via a second communication link that is different than the first communication link, and access to the location of the visitor and the profile of the visitor is enabled in response to the mobile computing device detecting the particular motion-based gesture, generate, from the image of the visitor, characteristic information associated with the visitor of the digital signage device; determine advertisement attributes according to an analysis of the characteristic information, receive, based on the determined advertisement attributes, a plurality of advertisements, wherein each advertisement of the plurality of advertisements is associated with a bid, display one or more of the plurality of advertisements via a multi-zone display, capture an action of the visitor regarding the multi-zone display, select, a particular advertisement, from among the plurality of advertisements, according to the action of the visitor and which advertisement is associated with a winning bid, and push content associated with the particular advertisement into the mobile computing device of the visitor. ### Claim 12 (depends on 11) The system according to claim 11, wherein the digital signage device is operable to display the particular advertisement. ### Claim 13 (depends on 12) The system according to claim 12, wherein the characteristic associated with the visitor comprises one or more of: demographic information; behavioral information; and location information in a field-of-view captured by the camera. ### Claim 14 (depends on 12) The system according to claim 12, wherein the processor is operable to generate the characteristic by an analysis of video images captured by the camera. ### Claim 15 (depends on 11) The system according to claim 11, wherein the accelerometer measurement is associated with the motion-based gesture according to an analysis of video images captured by the camera. ### Claim 16 (depends on 11) The system according to claim 11, wherein: the digital signage device is operable to display a first version of the advertisement and a second version of the advertisement, and the processor is operable to determine, based on a statistical analysis, whether the first version or the second version is displayed. ### Claim 17 (depends on 11) The system according to claim 11, wherein the location of the visitor and the profile of the visitor are associated with a particular application running on the mobile computing device. ### Claim 18 (depends on 11) The system according to claim 11, wherein the digital signage device is operable to: receive action information associated with the visitor who views a first version of the advertisement; analyze the received action information associated with the first version of the advertisement and one or more other versions of the advertisement; and determine, based on the analysis, a particular version among the plurality of versions for display on the digital signage device. ### Claim 19 (depends on 18) The system according to claim 18, wherein the action information comprises one or more of audience impression, viewing time, viewer facial gesture and viewer interaction. ### Claim 20 (depends on 18) The system according to claim 18, wherein the action information is generated by the digital signage device utilizing one or both of: video images captured by the camera, and sensor information captured by a sensor of the digital signage device.