# US 2020/0401469 A1 · Computer method and a computer device for analyzing computer implemented applications > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0401469 A1 - Document ID: US20200401469A1 - Status: Published application - Kind: A1 - Application number: 16/445,621 - Filed: 2019-06-19 - Published: 2020-12-24 - Earliest claimed: 2019-06-19 - Assignees: King.Com Ltd. - Applicants: King.Com Limited - Inventors: Alexander ANDELKOVIC; Alice REINAUDO; Sara KARIMI - Web page: https://patentgrep.com/patent/US20200401469A1 ## CPC - G06F 9/451: Execution arrangements for user interfaces - G06F 11/0706: {the processing taking place on a specific hardware platform or in a specific software environment} - G06F 11/0751: {Error or fault detection not based on redundancy (power supply failures G06F1/30; network fault management H04L41/06)} - G06F 11/079: {Root cause analysis, i.e. error or fault diagnosis (in a hardware test environment G06F11/22; in a software test environment G06F11/36)} - G06F 18/22: Matching criteria, e.g. proximity measures - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A computer implemented method comprises analysing data defining the first image which is displayable when a computer application runs to determine at least one candidate user interactive area in the image. A user interactive area is one which is responsive to user input when the computer application is run. The method comprises attempting to interact with the determined at least one candidate user interactive area and comparing the data defining the first image with data defining a further image to determine if the respective candidate user interactive area is an interactive area. ## Claims ### Claim 1 A computer implemented method comprising: analysing by at least one processor of a computer device data defining the first image which is displayable when a computer application runs to determine at least one candidate user interactive area in the image, a user interactive area being one which is responsive to user input when the computer application is run; causing at least one processor of the computer device to attempt to interact with the determined at least one candidate user interactive area; and comparing by the at least one processor of the computer device the data defining the first image with data defining a further image to determine if the respective candidate user interactive area is an interactive area. ### Claim 2 (depends on 1) The method as claimed in claim 1, comprising causing the further image to be displayable in response to the attempt to interact with the determined at least one candidate user interactive area ### Claim 3 (depends on 1) The method as claimed in claim 1, comprising running the computer application on at least one of the at least processor of the computer device and at least one processor of another computer device. ### Claim 4 (depends on 1) The method as claimed in claim 1, comprising capturing at least one of the data defining the first image and the further image. ### Claim 5 (depends on 1) The method as clamed in claim 1, comprising causing at least one of the first image and the further image to be displayed on a display. ### Claim 6 (depends on 1) The method as claimed in claim 1, comprising determining if the respective candidate area is an interactive area by determining a similarity between the first and further images. ### Claim 7 (depends on 1) The method as claimed in claim 1, comprising determining if the respective candidate area is an interactive area by determining if the first and further images are substantially different. ### Claim 8 (depends on 1) The method as claimed in claim 1, comprising carrying out the method steps of claim 1 for a plurality of different images displayable when the computer application runs to provide a tree relationship between the different images which is displayable. ### Claim 9 (depends on 8) The method of claim 8, comprising storing the tree relationship. ### Claim 10 (depends on 9) The method of claim 9, comprising subsequently generating a further tree relationship. ### Claim 11 (depends on 8) The method of claim 8, comprising analysing the tree relationship to determine one or more anomalies. ### Claim 12 (depends on 11) The method as claimed in claim 11, comprising comparing at least a part of the provided tree relationship with a corresponding reference tree relationship to determine one or more anomalies. ### Claim 13 (depends on 1) The method of claim 1, comprising providing at least one file, the at least one file comprising data defining a plurality of different images displayable when the computer application runs. ### Claim 14 (depends on 1) The method of claim 1 comprising analysing data defining one or more of a plurality of different images displayable when the computer application runs to determine an error condition. ### Claim 15 (depends on 14) The method of claim 14, wherein the error condition comprises one or more of missing text information and missing texture information. ### Claim 16 A computer implemented method comprising: running on at least one processor of a computer device a computer application; capturing by at least one processor of the computer device data defining a first screenshot of an image caused to be displayed on a display of the device by the computer application; analysing by at least one processor of the computer device data defining the first screenshot to determine at least one candidate user interactive area in the screenshot, a user interactive area being one which is responsive to user input when the computer application is run; causing at least one processor of the computer device to attempt to interact with the determined at least one candidate user interactive area; capturing by at least one processor of the computer device data defining another screenshot of an image caused to be to be displayed on a display of the device by the computer application in response to the attempt to interact with the determined at least one candidate user interactive area; and comparing by the at least one processor of the computer device the first screenshot with the further screenshot to determine if the respective candidate user interactive area is an interactive area. ### Claim 17 A computer apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured, with the at least one processor, to cause the apparatus at least to: analyse the data defining the first image which is displayable when a computer application runs to determine at least one candidate user interactive area in the image, a user interactive area being one which is responsive to user input when the computer application is run; cause an to attempt to interact with the determined at least one candidate user interactive area; and compare the data defining the first image with data defining a further image to determine if the respective candidate user interactive area is an interactive area. ### Claim 18 (depends on 17) The apparatus as claimed in claim 17, wherein the at least one memory and the computer code are configured, with the at least one processor, to cause the apparatus to cause the further image to be displayable in response to the attempt to interact with the determined at least one candidate user interactive area ### Claim 19 (depends on 17) The apparatus as claimed in claim 17, wherein the at least one memory and the computer code are be configured, with the at least one processor, to cause the apparatus to determine if the respective candidate area is an interactive area by determining a similarity between the first and further images. ### Claim 20 (depends on 17) The apparatus as claimed in claim 17, wherein the at least one memory and the computer code are be configured, with the at least one processor, to cause the apparatus to carry out the steps of claim 17 for a plurality of different images displayable when the computer application runs to provide a tree relationship between the different images which is displayable. ### Claim 21 (depends on 17) The apparatus as claimed in claim 17, wherein the at least one memory and the computer code are be configured, with the at least one processor, to cause the apparatus to analyse the tree relationship to determine one or more anomalies. ### Claim 22 (depends on 17) The apparatus as claimed in claim 17, wherein the at least one memory and the computer code are be configured, with the at least one processor, to cause the apparatus to compare at least a part of the provided tree relationship with a corresponding reference tree relationship to determine one or more anomalies. ### Claim 23 A computer readable non-transitory storage medium carrying one or more computer executable instructions which when run on at least one processor cause: analysing of data defining the first image which is displayable when a computer application runs to determine at least one candidate user interactive area in the image, a user interactive area being one which is responsive to user input when the computer application is run; causing an attempt to interact with the determined at least one candidate user interactive area; and comparing the data defining the first image with data defining a further image to determine if the respective candidate user interactive area is an interactive area.