# US 2018/0007165 A1 · Dynamic adjustment of boxcarring of action requests from component-driven cloud applications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0007165 A1
- Document ID: US20180007165A1
- Status: Published application
- Kind: A1
- Application number: 15/199,759
- Filed: 2016-06-30
- Published: 2018-01-04
- Earliest claimed: 2016-06-30
- Assignees: salesforce.com, inc.
- Applicants: salesforce.com, inc.
- Inventors: Ashraya Raj Mathur; Shweta Joshi; Ronnie Fong; Jianxun Jason Ding
- Web page: https://patentgrep.com/patent/US20180007165A1

## CPC

- H04L 67/63: Routing a service request depending on the request content or context
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04W 4/50: Service provisioning or reconfiguring
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Performance of web pages and mobile device applications with multiple components rendered on a user device is dynamically speeded up, including dynamically measuring network communication latency, adjusting inter-boxcar intervals used to dispatch batches of action requests from the user device to a production server, and dispatching boxcarred requests to the server. Adjustments to the boxcar intervals are based on the dynamically measured network communication latency and a number of connections supported between the user device and the server. The measured network communication latency is calculated as dispatch-to-completed response time minus server processing time and the server processing time is received from the server for a boxcar of completed responses. The system adjusts according to feedback received, as a browser or mobile device changes network connections or the network conditions change, and adapting over time for a particular user. Inter-boxcar intervals are tunable and programmatically changeable, with values learned from experience.

## Claims

### Claim 1

A system including a user device and a server, coupled in communication, including:
a data consuming application, running on a user device, that makes action requests to at least one server and that consumes data received from the server responsive to the action requests;
a middleware application, also running on the user device, that measures network communication latency, adjusts inter-boxcar intervals used to dispatch batches of action requests, and dispatches boxcars of batched action requests;
wherein the measured network communication latency is calculated as dispatch-to-completed response time minus server processing time and the server processing time is received from the server for a boxcar of completed responses; and
wherein the inter-boxcar intervals are adjusted, taking into account at least (a) a number of connections supported between the user device and the server and (b) the measured network communication latency;
a browser or app running on the user device, in communication with the middleware application, that supports the data consuming application; and
the server, running a dispatcher and one or more application programs, wherein the dispatcher receives the boxcar of action requests, forwards the action requests to the application programs, and returns the boxcar of completed responses; and
wherein the dispatcher further calculates the server processing time as a difference between when the boxcar of action requests is received and when the boxcar of completed responses is ready to be returned, and reports the calculated server processing time back to the middleware application.

### Claim 2 (depends on 1)

The system of claim 1, wherein the middleware application repeatedly measures network communication latency and readjusts the inter-boxcar intervals used to dispatch batches of action requests based on updated measurements.

### Claim 3 (depends on 1)

The system of claim 1, wherein the middleware application adjusts the inter-boxcar intervals used to time when to dispatch batches of action requests to 250-350 ms when the measured network communication latency exceeds 300 ms.

### Claim 4 (depends on 1)

The system of claim 1, wherein the middleware application identifies the browser or app through which it is coupled in communication with the server and looks up the number of connections supported by the identified browser or app.

### Claim 5 (depends on 1)

The system of claim 1, wherein the middleware application receives the boxcar of completed responses grouped to respond to a respective boxcar of action requests.

### Claim 6

A user device running a middleware application, including:
a middleware application, running on the user device, coupled in communication with a data consuming application and a browser or app running on the user device, and also coupled in communication with at least one server through the browser or app;
wherein the middleware application receives action requests from the data consuming application and returns data received from the server responsive to the action requests;
wherein the middleware application measures network communication latency, adjusts inter-boxcar intervals used to dispatch batches of action requests, batches the action requests into boxcars, and dispatches boxcars of batched action requests;
wherein the middleware application calculates the measured network communication latency as dispatch-to-completed response time minus server processing time, using the server processing time received from the server for a boxcar of completed responses; and
wherein the inter-boxcar intervals are adjusted, taking into account at least (a) a number of connections supported between the user device and the server and (b) the measured network communication latency.

### Claim 7 (depends on 6)

The user device of claim 6, wherein the middleware application repeatedly measures network communication latency and readjusts the inter-boxcar intervals used to dispatch batches of action requests based on updated measurements.

### Claim 8 (depends on 6)

The user device of claim 6, wherein the middleware application adjusts the inter-boxcar intervals used to time when to dispatch batches of action requests to 250-350 ms when the measured network communication latency exceeds 300 ms.

### Claim 9 (depends on 6)

The user device of claim 6, wherein the middleware application identifies the browser or app through which it is coupled in communication with the server and looks up the number of connections supported by the identified browser or app.

### Claim 10 (depends on 6)

The user device of claim 6, wherein the middleware application receives the boxcar of completed responses grouped to respond to a respective boxcar of action requests.

### Claim 11

A server running a dispatching application, including:
the dispatcher running on the server and coupled in communication with a multiplicity (100 or more) of middleware applications running on respective user devices and one or more application programs running on the server;
wherein the dispatcher receives boxcarred batches of action requests from the middleware applications, forwards the action requests to the application programs, and returns responsive boxcars of completed responses; and
wherein the dispatcher further calculates a server processing time as a difference between when a particular boxcar of action requests is received and when a respective boxcar of completed responses is ready to be returned and further reports the calculated server processing time back to the middleware application for the respective boxcar of completed responses.

### Claim 12 (depends on 11)

The server of claim 11, wherein the dispatcher further identifies respective application programs that will respond to the action requests received in a particular boxcar from one of the middleware applications and dispatches the action requests from the particular boxcar to the responsive application programs.

### Claim 13 (depends on 11)

The server of claim 11, wherein the dispatcher postpones returning responses to action requests from a particular boxcar until it has received (or timed out on) responses to all of the action requests in the particular boxcar.

### Claim 14

A method, including:
running a middleware application on a user device, coupled in communication with a data consuming application and a browser or app running on the user device, and also coupled in communication with at least one server through the browser or app;
the middleware application receiving action requests from the data consuming application and returning data received from the server responsive to the action requests;
the middleware application measuring network communication latency, adjusting inter-boxcar intervals used to dispatch batches of action requests, batching the action requests into boxcars, and dispatching the boxcars of batched action requests;
the middleware application calculating the measured network communication latency as dispatch-to-completed response time minus server processing time, using the server processing time received from the server for a boxcar of completed responses; and
the middleware application adjusting the inter-boxcar intervals taking into account at least (a) a number of connections supported between the user device and the server and (b) the measured network communication latency.

### Claim 15 (depends on 14)

The method of claim 14, further including repeatedly measuring network communication latency and readjusting the inter-boxcar intervals used to dispatch batches of action requests based on updated measurements.

### Claim 16 (depends on 14)

The method of claim 14, further including adjusting the inter-boxcar intervals used to time when to dispatch batches of action requests to 250-350 ms when the measured network communication latency exceeds 300 ms.

### Claim 17 (depends on 14)

The method of claim 14, further including the middleware application identifying the browser or app through which it is coupled in communication with the server and looking up the number of connections supported by the identified browser or app.

### Claim 18 (depends on 14)

The method of claim 14, further including the middleware application receiving the boxcar of completed responses grouped to respond to a respective boxcar of action requests.

### Claim 19

A method that conserves connections between a browser or app running on a user device and at least one server, including:
a dispatcher running on the server and coupled in communication with a multiplicity of middleware applications running on respective user devices and one or more application programs running on the server;
the dispatcher receiving boxcarred batches of action requests from the middleware applications, forwarding the action requests to the application programs, and returning responsive boxcars of completed responses; and
the dispatcher further calculating a server processing time as a difference between when a particular boxcar of action requests is received and when a respective boxcar of completed responses is ready to be returned and further reporting the calculated server processing time back to the middleware application for the respective boxcar of completed responses.

### Claim 20 (depends on 19)

The method of claim 19, further including the dispatcher identifying respective application programs that will respond to the action requests received in a particular boxcar from one of the middleware applications and dispatching the action requests from the particular boxcar to the responsive application programs.

### Claim 21 (depends on 19)

The method of claim 19, further including the dispatcher postponing returning responses to action requests from a particular boxcar until it has received (or timed out on) responses to all of the action requests in the particular boxcar.
