# US 12,762,878 B2 · Method, system and device for analyzing placement of digital assets in a user interface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,762,878 B2 - Document ID: US12762878B2 - Status: Granted - Kind: B2 - Application number: 18/620,495 - Filed: 2024-03-28 - Published: 2024-10-03 - Granted: 2026-10-13 - Earliest claimed: 2023-03-31 - Applicants: Lucas Bertrand - Inventors: Lucas Bertrand - Web page: https://patentgrep.com/patent/US12762878B2 ## CPC - G06V 30/30: based on the type of data - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 30/19013: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching (specially adapted for image segmentation G06T7/10; specially adapted for the analysis of motion G06T7/20; specially adapted for image alignment G06T7/30; specially adapted for the calculation of depth from stereo images G06T7/50; specially adapted for position determination G06T7/70)} - G06V 30/191: {Design or setup of recognition systems or techniques; Extraction of features in feature space; Clustering techniques; Blind source separation} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06V 2201/02: Recognising information on displays, dials, clocks - G06V 2201/09: Recognition of logos - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method, carried out by one or more processors, for analysing the placement in a user interface, by an electronic device, of digital assets, the method comprising scanning image data of a user interface of an electronic device, capturing image data of an instance of the user interface of the electronic device, identifying a parameter of one or more digital assets in the captured image data. ## Claims ### Claim 1 A method, carried out by one or more processors, for analyzing placement in a user interface, by an electronic device, of digital assets, the method comprising: scanning image data of a user interface of an electronic device; capturing image data of an instance of the user interface of the electronic device; identifying a parameter of one or more digital assets in the captured image data, wherein identifying a parameter of one or more digital assets in the captured image data comprises analysing the captured image data to at least one of: identifying a selected digital asset in the captured image data; or determining position information of one or more digital assets in the captured image data; or capturing image data comprises encoding the captured image data with a geographical location of the electronic device being scanned to capture the image data wherein the method further comprises, for a plurality of users: obtaining, from a third party service, user data indicating performance data for user interactions with the digital asset on the third party service; combining the user data for each of the plurality of users with the position information for the digital asset; generating a value curve to indicate performance data is affected by the position of the digital asset on the user interface; applying the value curve to the user interface to generate a model of the user interface indicating a relative value of positions on the user interface. ### Claim 2 (depends on 1) The method of claim 1, further comprising: in response to identifying a selected digital asset in the captured image data, capturing further image data of a resultant instance of the user interface of the electronic device; and identifying another parameter of the one or more digital assets in the further captured image data. ### Claim 3 (depends on 1) The method of claim 1, further comprising: in response to identifying a selected digital asset in the captured image data, determining position information of one or more digital assets in the captured image data. ### Claim 4 (depends on 2) The method of claim 2, wherein identifying another parameter of the one or more digital assets in the further captured image data comprises analysing the further captured image data to: identify a further selected digital asset in the further captured image data; or determine position information of one or more digital assets in the further captured image data. ### Claim 5 (depends on 3) The method of claim 3, wherein the position information includes at least one of a page, a row, a column, or a spot at which the digital asset is disposed in the image data. ### Claim 6 (depends on 1) The method of claim 1, wherein the scanning and capturing are carried out by a first processor and the identifying is carried out by a second processor. ### Claim 7 (depends on 6) The method of claim 6, wherein the first processor and the second processor are located on a scanning device. ### Claim 8 (depends on 6) The method of claim 6, wherein the first processor is located on a scanning device and the second processor is located at one or more servers in communication with the scanning device via a communication network. ### Claim 9 (depends on 8) The method of claim 8, wherein the captured image data is provided, by the first processor on the scanning device, via the communication network, to the second processor on the one or more servers. ### Claim 10 (depends on 6) The method of claim 6, wherein identifying a parameter of the one or more digital assets in the captured image data further comprises: in response to the captured image data being received at the second processor, processing the captured image data to identify text and/or image features of the one or more digital assets in the captured image data; wherein processing the captured image data comprises using optical character recognition to identify text in the captured image data; and wherein the text includes a title of the digital asset. ### Claim 11 (depends on 9) The method of claim 9, further comprising: comparing the identified text and/or image features of a digital asset in the captured image data with text and/or image features of one or more stored digital assets in a database at the one or more servers to identify said digital asset. ### Claim 12 (depends on 10) The method of claim 10, wherein image features comprise one or more of a logo of an application, a design of an application icon, a design indicating a particular content item, and a symbol indicating a particular navigation option of a user interface. ### Claim 13 (depends on 8) The method of claim 8, wherein the scanning device is deployed remotely from the electronic device. ### Claim 14 (depends on 11) The method of claim 11, wherein processing, by the one or more servers, the captured image data comprises using artificial intelligence to identify the image features of the one or more digital assets, wherein the artificial intelligence is configured to identify image features based on variations of said image features. ### Claim 15 (depends on 8) The method of claim 8, wherein the scanning device is a first scanning device, the electronic device is a first electronic device, the image data is first image data, the one or more digital assets are one or more first digital assets, and position information is first position information, the method further comprising: capturing, by a second scanning device in communication with a second electronic device different to the first electronic device, second image data at the second electronic device; providing, to the one or more servers via the communication network, the captured second image data; identifying one or more second digital assets in the captured second image data; and for one or more second digital assets in the captured second image data: determining second position information indicating the placement of an identified second digital asset in the captured second image data; and comparing the second position information indicating the placement of an identified second digital asset in the captured second image data with the first position information indicating the placement of the same identified digital asset among the one or more first digital assets in the captured first image data; and indicating differences in the position information indicating the placement of each identified digital asset. ### Claim 16 (depends on 1) The method of claim 1, wherein the one or more digital assets comprise an application icon or a content item of a user interface or wherein the one or more digital assets further comprise a navigation option of a user interface. ### Claim 17 (depends on 1) The method of claim 1, wherein the electronic device comprises a set-top box, a television, a smart television, a mobile device, a computing device or a tablet computing device or the image data comprises an image or an encoded signal or the method further comprises encoding the image data with a timestamp representing the time of capturing the image data. ### Claim 18 (depends on 17) The method of claim 17, further comprising: determining that the image or the encoded signal is static before capturing the image data.