# US 2020/0396303 A1 · Network latency detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0396303 A1
- Document ID: US20200396303A1
- Status: Published application
- Kind: A1
- Application number: 16/439,961
- Filed: 2019-06-13
- Published: 2020-12-17
- Earliest claimed: 2019-06-13
- Assignees: FullStory, Inc.
- Applicants: FullStory, Inc.
- Inventors: Joel Grayson Webber; Joshua Calvin Teague
- Web page: https://patentgrep.com/patent/US20200396303A1

## CPC

- H04L 67/148: Migration or transfer of sessions
- H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)}
- H04L 41/22: comprising specially adapted graphical user interfaces [GUI]
- H04L 41/5067: Customer-centric QoS measurements
- H04L 43/065: related to network devices
- H04L 67/75: Indicating network or usage conditions on the user display
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing user interface development tools. In one aspect, a method includes receiving, from a client device, network request data that specifies, for each of multiple network requests that were transmitted from the client device to a server during a user session, a requested user interface element and a load time that indicates a duration of time between a time at which the network request was initiated and a time at which the user interface element was loaded in a user interface at the client device. An interactive interface is generated. The interactive interface includes a session replay area that presents playback of visual changes of the one or more user interfaces that occurred during the user session and a network request area that presents a list of network requests that were transmitted during the user session.

## Claims

### Claim 1

A system comprising:
a data store; and
one or more computers that interact with the data store and execute instructions that cause the one or more computers to perform operations comprising:
receiving, from a client device, network request data that specifies, for each of a plurality of network requests that were transmitted from the client device to a remote server during a user session, a requested user interface element and a load time that indicates a duration of time between a time at which the network request was initiated by the client device and a time at which the user interface element was loaded in a user interface at the client device; and
generating and providing an interactive interface that includes:
a session replay area that presents playback of visual changes of the one or more user interfaces that occurred during the user session;
a network request area that presents a list of network requests that were transmitted during the user session and, for each network request in the list, the load time for the network request; and
an animation that visually specifies, during playback of the visual changes to the one or more user interfaces in the session replay area, which network request in the list of network requests was initiated by the client device as the visual changes occurred during the user session.

### Claim 2 (depends on 1)

The system of claim 1, wherein the network request area includes a waterfall chart that includes a bar for each network request in the list, the bar for each network request including a first end that indicates a time at which the network request was initiated and a second end that indicates a time at which the user interface element requested by the network request was loaded in the user interface, wherein a length of the bar between the first end and the second end indicate the load time for the network request.

### Claim 3 (depends on 1)

The system of claim 1, wherein the animation comprises presenting a network request identifier element next to the network request in the list that was generated by the client device as the visual changes occurred during the user session.

### Claim 4 (depends on 1)

The system of claim 1, wherein the client device generates the network request data, including:
identifying, for a given network request, at least one of (i) a request message body that includes data being transmitted with the given network request and by the client device or (ii) a received message body that includes data received by the client in response to the given network request;
examining each message body to identify portions of data having a data type that is not included in a whitelist of data types; and
removing the identified portions of data from each message body; and
including, in the network request data, each remaining portion of data of each message body.

### Claim 5 (depends on 1)

The system of claim 1, wherein the operations comprise:
detecting selection of a given network request in the list of network requests; and
visually updating the interactive interface to present a network request details panel that includes a timing summary for the given network request, the timing summary including measured time durations for events related to requesting and loading a given user interface element that was requested by the given network request.

### Claim 6 (depends on 5)

The system of claim 5, wherein the timing summary for the given network request includes one or more measured time durations for processes performed by the client device to request and load the given user interface element and one or more measured time durations related to waiting to receive the given user interface element from the remote server.

### Claim 7 (depends on 5)

The system of claim 5, wherein the timing summary for the given network request includes data specifying the given user interface element and a data size of the given user interface element.

### Claim 8 (depends on 1)

The system of claim 1, wherein the operations comprise:
detecting user interaction with a given network request in the list of network requests; and
causing the playback of the visual changes to the one or more user interfaces to present visual changes that occurred when the given network request was initiated.

### Claim 9 (depends on 1)

The system of claim 1, wherein the interactive interface comprises an event stream area that includes information about pages presented by the client device during the user session, the information including, for a page that is being presented in the session replay area, page speed metrics that each indicate a duration of time taken to reach particular milestones in loading the page.

### Claim 10 (depends on 9)

The system of claim 9, wherein the page speed metrics include a first meaningful paint metric that indicates a duration of time between a time at which the client device requests the page and a time at which the client device renders at least one of text, an image, or a canvas of the page at a display of the client device.

### Claim 11 (depends on 9)

The system of claim 9, wherein the page speed metrics include a Document Model Object (DOM) content loaded metric that indicates a duration of time between a time at which the client device requests the page and a time at which the client device loads and parses an initial markup language document of the page.

### Claim 12 (depends on 9)

The system of claim 9, wherein the page speed metrics include a page load metric that indicates a duration of time between a time at which the client device requests the page and a time at which the client device renders an entirety of the page.

### Claim 13

A method, comprising:
receiving, from a client device, network request data that specifies, for each of a plurality of network requests that were transmitted from the client device to a remote server during a user session, a requested user interface element and a load time that indicates a duration of time between a time at which the network request was initiated by the client device and a time at which the user interface element was loaded in a user interface at the client device; and
generating and providing an interactive interface that includes:
a session replay area that presents playback of visual changes of the one or more user interfaces that occurred during the user session;
a network request area that presents a list of network requests that were transmitted during the user session and, for each network request in the list, the load time for the network request; and
an animation that visually specifies, during playback of the visual changes to the one or more user interfaces in the session replay area, which network request in the list of network requests was initiated by the client device as the visual changes occurred during the user session.

### Claim 14 (depends on 13)

The method of claim 13, wherein the network request area includes a waterfall chart that includes a bar for each network request in the list, the bar for each network request including a first end that indicates a time at which the network request was initiated and a second end that indicates a time at which the user interface element requested by the network request was loaded in the user interface, wherein a length of the bar between the first end and the second end indicate the load time for the network request.

### Claim 15 (depends on 13)

The method of claim 13, wherein the animation comprises presenting a network request identifier element next to the network request in the list that was generated by the client device as the visual changes occurred during the user session.

### Claim 16 (depends on 13)

The method of claim 13, wherein the client device generates the network request data, including:
identifying, for a given network request, at least one of (i) a request message body that includes data being transmitted with the given network request and by the client device or (ii) a received message body that includes data received by the client in response to the given network request;
examining each message body to identify portions of data having a data type that is not included in a whitelist of data types; and
removing the identified portions of data from each message body; and
including, in the network request data, each remaining portion of data of each message body.

### Claim 17 (depends on 13)

The method of claim 13, further comprising:
detecting selection of a given network request in the list of network requests; and
visually updating the interactive interface to present a network request details panel that includes a timing summary for the given network request, the timing summary including measured time durations for events related to requesting and loading a given user interface element that was requested by the given network request.

### Claim 18 (depends on 17)

The method of claim 17, wherein the timing summary for the given network request includes one or more measured time durations for processes performed by the client device to request and load the given user interface element and one or more measured time durations related to waiting to receive the given user interface element from the remote server.

### Claim 19 (depends on 17)

The method of claim 17, wherein the timing summary for the given network request includes data specifying the given user interface element and a data size of the given user interface element.

### Claim 20

A non-transitory computer readable medium storing instructions that upon execution by one or more computers cause the one or more computers to perform operations comprising:
receiving, from a client device, network request data that specifies, for each of a plurality of network requests that were transmitted from the client device to a remote server during a user session, a requested user interface element and a load time that indicates a duration of time between a time at which the network request was initiated by the client device and a time at which the user interface element was loaded in a user interface at the client device; and
generating and providing an interactive interface that includes:
a session replay area that presents playback of visual changes of the one or more user interfaces that occurred during the user session;
a network request area that presents a list of network requests that were transmitted during the user session and, for each network request in the list, the load time for the network request; and
an animation that visually specifies, during playback of the visual changes to the one or more user interfaces in the session replay area, which network request in the list of network requests was initiated by the client device as the visual changes occurred during the user session.
