# US 12,001,501 B1 · System and method for using inspect element framework for building mobile DAP content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,001,501 B1
- Document ID: US12001501B1
- Status: Granted
- Kind: B1
- Application number: 18/174,760
- Filed: 2023-02-27
- Granted: 2024-06-04
- Earliest claimed: 2023-02-27
- Assignees: Whatfix Private Limited
- Applicants: Whatfix Private Limited
- Inventors: Sahil Sachdeva; Shreyas Arunkumar
- Web page: https://patentgrep.com/patent/US12001501B1

## CPC

- G06F 16/957: Browsing optimisation, e.g. caching or content distillation
- G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A technique for inspecting screen elements of a mobile device with a laptop or desktop computer displays a screen-shot of the mobile device. Visible screen elements are identified as the user moves a user interface pointer over the screen-shot. Individual screen elements are highlighted and a user may select individual screen elements. Additional information regarding screen element identification and attributes may be displayed. The screen element attributes may be captured for use in generating DAP content for a mobile device.

## Claims

### Claim 1

A method of inspecting a mobile device screen by a larger screen device to identify screens for a mobile digital adoption platform (DAP), comprising:
capturing a screen-shot of a mobile computing device having an associated screen element hierarchy for screen elements of the screen-shot;
displaying, on a display screen of a computer, the screen-shot of the mobile computing device;
determining a user interface pointer position and matching the user interface pointer position with boundaries of visible screen elements of the screen-shot;
highlighting elements of the screen-shot in response to a user hovering a user interface pointer over a screen element, wherein the highlighting elements of the screen-shot comprises identifying a smallest element the user interface pointer is hovering over;
receiving at least one user interface command, via the computer, to select a highlighted element of the screen-shot; and
capturing element attributes associated with the selected highlighted element.

### Claim 2 (depends on 1)

The method of claim 1, wherein at least one user interface command comprises a command to click on an element of the screen-shot to select it.

### Claim 3 (depends on 1)

The method of claim 1, further comprising displaying element attributes of the selected highlighted element.

### Claim 4

A method of inspecting a mobile device screen by a larger screen device to identify screens for a mobile digital adoption platform (DAP), comprising:
capturing a screen-shot of a mobile computing device having an associated screen element hierarchy for screen elements of the screen-shot;
displaying, on a display screen of a computer, the screen-shot of the mobile computing device;
detecting if an element is a web element or a native element, and in response identifying to a user whether the element is a web element or a native element;
receiving at least one user interface command, via the computer, to select an element of the screen-shot; and
capturing element attributes associated with the selected element of the screen-shot.

### Claim 5 (depends on 4)

The method of claim 4, wherein the detecting and identifying occur in response to a user hovering a user interface pointer over a screen element.

### Claim 6 (depends on 4)

The method of claim 4, further comprising, in response to identifying a web element, determining whether the web element is identifiable.

### Claim 7 (depends on 6)

The method of claim 6, further comprising in response to determining the web element is non-identifiable, generating an indication that the web element is non-identifiable.

### Claim 8

A method of inspecting screen elements of a mobile device for a mobile digital adoption platform (DAP), comprising:
initiating, in response to a user command, a capture of a screen-shot of a mobile computing device having an associated screen element hierarchy for screen elements of the screen-shot;
displaying the screen-shot on a dashboard of a display screen of a computer;
determining coordinates of a user interface pointer of the computer with respect to the screen-shot displayed on the display screen of the computer;
in response to the user interface pointer hovering over a visible screen element of the screen-shot, highlighting the screen element, wherein the highlighting comprises identifying a smallest element the user interface pointer is hovering over; and
in response to a user selecting the highlighted element, capturing element attributes of the highlighted element.

### Claim 9 (depends on 8)

The method of claim 8, wherein the selecting comprises a command to click on an element of the screen-shot to select it.

### Claim 10 (depends on 8)

The method of claim 8, further comprising displaying element attributes of the selected element on the screen of screen of the computer.

### Claim 11

A method of inspecting screen elements of a mobile device for a mobile digital adoption platform (DAP), comprising:
initiating, in response to a user command, a capture of a screen-shot of a mobile computing device having an associated screen element hierarchy for the screen elements of the screen-shot;
displaying the screen-shot on a dashboard of a display screen of a computer;
determining coordinates of a user interface pointer of the computer with respect to the screen-shot displayed on the display screen of the computer;
in response to the user interface pointer hovering over a visible screen element of the screen-shot, highlighting the screen element;
detecting if a highlighted element is a web element or a native element, and in response identifying to the user whether the element is a web element or a native element; and
in response to a user selecting the highlighted element, capturing element attributes of the highlighted element.

### Claim 12 (depends on 11)

The method of claim 11, further comprising, in response to identifying a web element, determining whether the web element is identifiable.
