# US 2019/0171546 A1 · Application screen mapping for mobile analytics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171546 A1
- Document ID: US20190171546A1
- Status: Published application
- Kind: A1
- Application number: 16/264,738
- Filed: 2019-02-01
- Published: 2019-06-06
- Earliest claimed: 2015-07-10
- Assignees: CA, Inc.
- Applicants: CA, Inc.
- Inventors: Seshadri Venkataraman
- Web page: https://patentgrep.com/patent/US20190171546A1

## CPC

- G06F 11/3612: {by runtime analysis (performance monitoring G06F11/3466)}
- G06F 11/0742: {in a data processing system embedded in a mobile device, e.g. mobile phones, handheld devices}
- G06F 11/0748: {in a remote unit communicating with a single-box computer node experiencing an error/fault (remote testing G06F11/2294)}
- G06F 11/0778: {Dumping, i.e. gathering error/state information after a fault for later diagnosis}
- G06F 11/36: Prevention of errors by analysis, debugging or testing of software
- G06F 11/3604: Analysis of software for verifying properties of programs (testing of software G06F11/3668)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed herein are methods that include receiving application source code of a mobile application, analyzing the application source code to generate screen metadata that represents screen images that will be generated by the mobile application upon execution of binary application code generated from the application source code, storing the screen metadata in a screen metadata file, and associating the screen metadata file with the mobile application. Other methods disclosed herein include analyzing operation of a mobile application during runtime execution of the mobile application, identifying a reportable runtime event during operation of the mobile application, and in response to identifying the reportable runtime event, generating screen data that describes a screen image generated by the mobile application and associated with the reportable runtime event, generating a runtime event report, wherein the runtime event report includes the screen data, and transmitting the runtime event report to an application analysis computer.

## Claims

### Claim 1

A method performed by an application analysis computer operating in a communication network and in communication with a mobile computing device, the method comprising:
receiving application source code of a mobile application executed by the mobile computing device;
analyzing the application source code to generate screen metadata that represents screen images that will be generated by the mobile application upon execution of binary application code generated from the application source code by the mobile computing device;
storing the screen metadata in a screen metadata file; and
associating the screen metadata file with the mobile application.

### Claim 2 (depends on 1)

The method of claim 1, wherein generating the screen metadata comprises generating a storyboard file that provides a schematic representation of the screen images that are generated by the mobile application upon execution of compiled code generated from the application source code at the mobile computing device.

### Claim 3 (depends on 2)

The method of claim 2, wherein generating the storyboard file comprises parsing a NIB or XIB file and building a map of the screen images generated by the mobile application showing transitions between the screen images.

### Claim 4 (depends on 3)

The method of claim 3, wherein the site map includes controls associated with the screen images generated by the mobile application.

### Claim 5 (depends on 1)

The method of claim 1, wherein the method further comprises:
receiving analytic code that analyzes activity of the mobile application during runtime execution of the mobile application at the mobile computing device; and
generating an application installation package including the analytic code, the screen metadata, and the binary application code.

### Claim 6 (depends on 1)

The method of claim 1, wherein the screen metadata comprises metadata characterizing the screen images generated by the mobile application at runtime.

### Claim 7 (depends on 1)

The method of claim 1, wherein associating the screen metadata file with the mobile application comprises associating the screen metadata file with information identifying a particular version of the mobile application.

### Claim 8 (depends on 1)

The method of claim 1, wherein associating the screen metadata file with the mobile application comprises associating the screen metadata file with information identifying a particular operating platform.

### Claim 9 (depends on 1)

The method of claim 1, the method further comprising providing the screen metadata file, excluding the screen images, to the mobile computing device in an application package for extraction at the mobile computing device.

### Claim 10 (depends on 1)

The method of claim 1, wherein generating the screen metadata comprises generating screen IDs to associate with each of the screen images.

### Claim 11

A computer readable program product comprising executable instructions stored on a non-transitory computer readable medium that when executed by a processer of an application analysis computer operating in a communication network and in communication with a mobile computing device causes the processor to perform operations comprising:
receiving application source code of a mobile application executed by the mobile computing device;
analyzing the application source code to generate screen metadata that represents screen images that will be generated by the mobile application upon execution of binary application code generated from the application source code by the mobile computing device;
storing the screen metadata in a screen metadata file; and
associating the screen metadata file with the mobile application.

### Claim 12 (depends on 11)

The computer-readable program product of claim 11, wherein generating the screen metadata comprises generating a storyboard file that provides a schematic representation of the screen images that are generated by the mobile application upon execution of compiled code generated from the application source code at the mobile computing device.

### Claim 13 (depends on 11)

The computer-readable program product of claim 11, wherein the executable instructions executed by the processor causes the processor to further perform operations comprising:
receiving analytic code that analyzes activity of the mobile application during runtime execution of the mobile application at the mobile computing device; and
generating an application installation package including the analytic code, the screen metadata, and the binary application code.

### Claim 14

A method performed by an application analysis computer operating in a communication network and in communication with a mobile computing device, the method comprising:
receiving, from the mobile computing device, a runtime event report detailing a runtime event of a mobile application executed by the mobile computing device, the runtime event report including screen data that describes a screen image associated with the runtime event; and
generating a simulated screen image of the mobile application associated with the runtime event from the screen data.

### Claim 15 (depends on 14)

The method of claim 14, wherein the runtime event report comprises user interaction data associated with the runtime event, the method further comprising:
generating an animation of user interaction with the mobile application using the simulated screen image and the user interaction data.

### Claim 16 (depends on 14)

The method of claim 14, wherein the screen data comprises a screen name.

### Claim 17 (depends on 14)

The method of claim 14, wherein the screen data comprises metadata that describes a control, menu, controller and/or widget associated with the screen image.

### Claim 18 (depends on 14)

The method of claim 14, wherein the screen data excludes the screen image associated with the runtime event.

### Claim 19 (depends on 14)

The method of claim 14, wherein generating the simulated screen image of the mobile application comprises generating the simulated screen image based on a screen ID included in the screen data associated with the runtime event.

### Claim 20

A computer readable program product comprising computer executable instructions stored on a non-transitory computer readable medium that when executed by a processer of an application analysis computer operating in a communication network and in communication with a mobile computing device causes the processor to perform operations comprising:
receiving, from the mobile computing device, a runtime event report detailing a runtime event of a mobile application executed by the mobile computing device, the runtime event report including screen data that describes a screen image associated with the runtime event; and
generating a simulated screen image of the mobile application associated with the runtime event from the screen data.
