# US 2022/0027258 A1 · Online query execution using a big data framework

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0027258 A1
- Document ID: US20220027258A1
- Status: Published application
- Kind: A1
- Application number: 16/938,353
- Filed: 2020-07-24
- Published: 2022-01-27
- Earliest claimed: 2020-07-24
- Assignees: Paypal, Inc.
- Applicants: PayPal, Inc.
- Inventors: Ramakrishna Vedula; Lokesh Nyati
- Web page: https://patentgrep.com/patent/US20220027258A1

## CPC

- G06F 11/3698: Environments for analysis, debugging or testing of software
- G06F 11/3684: {for test design, e.g. generating new test cases}
- G06F 11/3688: {for test execution, e.g. scheduling of test suites}
- G06F 11/3692: {for test results analysis}
- G06F 11/3696: {Methods or tools to render software testable}
- G06F 16/284: {Relational databases}
- G06F 16/9538: Presentation of query results
- G06Q 20/4016: {involving fraud or risk level assessment in transaction processing}
- G06F 11/3006: {where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems (multiprogramming arrangements G06F9/46; allocation of resources G06F9/50)}
- G06F 16/2264: {Multidimensional index structures}
- G06F 16/2358: {Change logging, detection, and notification (replication G06F16/27)}
- G06F 16/2379: {Updates performed during online database operations; commit processing}
- G06F 16/2425: {Iterative querying; Query formulation based on the results of a preceding query}
- G06F 16/2455: Query execution
- G06F 16/24554: {Unary operations; Data partitioning operations}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Techniques are disclosed relating to the execution of queries in an online manner. For example, in some embodiments, a server system may include a distributed computing system that, in turn, includes a distributed storage system operable to store transaction data associated with a plurality of users, and a distributed computing engine operable to perform distributed processing jobs based on the transaction data. In various embodiments, the server system preemptively creates a compute session on the distributed computing engine, where the compute session provides access to various functionalities of the distributed computing engine. The distributed computing engine may then use these preemptively created compute sessions to execute queries (e.g., for end users of the server system) against the transaction data and return the results dataset to the requesting users in an online manner.

## Claims

### Claim 1

A method, comprising:
maintaining, by a server system, a distributed computing system that includes a plurality of computing nodes, wherein the distributed computing system includes:
a distributed storage system operable to store transaction data associated with a plurality of users; and
a distributed computing engine operable to perform distributed processing jobs based on the transaction data;
preemptively creating, by the server system, a first compute session on the distributed computing engine, wherein the first compute session provides access to one or more functionalities of the distributed computing engine;
subsequent to the preemptively creating the first compute session, receiving, by the server system from a client device, a first data request associated with a first user of the plurality of users;
using the first compute session, executing, by the distributed computing engine, a query associated with the first data request against the transaction data to retrieve a results dataset; and
sending, by the server system, the results dataset to the client device.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
storing, by an extraction service in the server system, the transaction data in the distributed storage system using a column-oriented data storage format.

### Claim 3 (depends on 2)

The method of claim 2, wherein the column-oriented data storage format is the Apache™ Parquet file format.

### Claim 4 (depends on 2)

The method of claim 2, wherein the storing includes:
retrieving, by the extraction service, first transaction data associated with the first user from a fraud detection service hosted by the server system; and
storing, by the extraction service, the first transaction data in a user-specific partition of the distributed storage system that is reserved for the first user;
wherein the executing the query includes retrieving data in the results dataset from the user-specific partition of the distributed storage system.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first data request includes one or more parameters, wherein the method further comprises:
generating the query based on the one or more parameters prior to routing the query to the distributed computing engine.

### Claim 6 (depends on 5)

The method of claim 5, wherein the query is specified using the Apache™ Hive Query Language (HQL).

### Claim 7 (depends on 1)

The method of claim 1, wherein the results dataset is sent to the client device, by the server system, within a predetermined time threshold after the first data request is received by the server system; and wherein the results dataset corresponds to a simulation of one or more fraud detection filters based on the transaction data.

### Claim 8 (depends on 7)

The method of claim 7, wherein the predetermined time threshold is 15 seconds.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
providing, by the server system to the client device, interface data for a simulation user interface that is operable to graphically depict simulated results of modifications to fraud detection filters, wherein the first data request is a first simulation request to simulate a modified version of a first fraud detection filter utilized by the first user.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
preemptively creating, by the server system, a second compute session on the distributed computing engine;
subsequent to the preemptively creating the second compute session, receiving, by the server system from a second client device, a second simulation request to simulate a modified version of a second fraud detection filter utilized by a second user of the plurality of users; and
using the second compute session, executing, by the distributed computing engine, a second query associated with the second simulation request against the transaction data to retrieve a second results dataset, wherein the distributed computing engine executes at least a portion of the second query at the same time as at least a portion of the query.

### Claim 11

A non-transitory, computer-readable medium having instructions stored thereon that are executable by a server system to perform operations comprising:
accessing a distributed computing system that includes a plurality of computing nodes, wherein the distributed computing system includes:
a distributed storage system operable to store transaction data associated with a plurality of users; and
a distributed computing engine operable to perform distributed processing jobs based on the transaction data;
preemptively creating a first compute session on the distributed computing engine, wherein the first compute session provides access to one or more functionalities of the distributed computing engine;
subsequent to the preemptively creating the first compute session, receiving, from a client device, a first data request associated with a first user of the plurality of users;
using the first compute session, executing, by the distributed computing engine, a query associated with the first data request against the transaction data to retrieve a results dataset; and
sending the results dataset to the client device.

### Claim 12 (depends on 11)

The non-transitory, computer-readable medium of claim 11, wherein the operations further comprise:
storing, by an extraction service, the transaction data in the distributed storage system using a column-oriented data storage format.

### Claim 13 (depends on 12)

The non-transitory, computer-readable medium of claim 12, wherein the storing includes:
retrieving, by the extraction service, first transaction data associated with the first user from a fraud detection service hosted by the server system; and
storing, by the extraction service, the first transaction data in a user-specific partition of the distributed storage system that is reserved for the first user;
wherein the executing the query includes retrieving data in the results dataset from the user-specific partition of the distributed storage system.

### Claim 14 (depends on 11)

The non-transitory, computer-readable medium of claim 11, wherein the first data request includes one or more parameters, wherein the operations further comprise:
generating the query based on the one or more parameters prior to routing the query to the distributed computing engine.

### Claim 15 (depends on 11)

The non-transitory, computer-readable medium of claim 11, wherein the operations further comprise:
while executing at least a portion of the query using the first compute session, executing, by the distributed computing engine using a second preemptively created compute session, a second query, associated with a second user of the plurality of users, against the transaction data.

### Claim 16 (depends on 11)

The non-transitory, computer-readable medium of claim 11, wherein the executing the query includes the distributed computing engine executing the query using a single computing node of the plurality of computing nodes.

### Claim 17

A server system, comprising:
a distributed computing system that includes a plurality of computing nodes, wherein the distributed computing system includes:
a distributed storage system operable to store transaction data associated with a plurality of users; and
a distributed computing engine operable to perform distributed processing jobs based on the transaction data;
at least one processor; and
a non-transitory, computer-readable medium having instructions stored thereon that are executable by the at least one processor to cause the server system to:
preemptively creating a first compute session on the distributed computing engine, wherein the first compute session provides access to one or more functionalities of the distributed computing engine;
subsequent to preemptively creating the first compute session, receive, from a client device, a first data request associated with a first user of the plurality of users;
using the first compute session, execute, by the distributed computing engine, a query associated with the first data request against the transaction data to retrieve a results dataset; and
send the results dataset to the client device.

### Claim 18 (depends on 17)

The server system of claim 17, wherein the instructions are further executable to cause the server system to:
retrieve first transaction data associated with the first user from a fraud detection service hosted by the server system; and
store the first transaction data in a user-specific partition of the distributed storage system that is reserved for the first user.

### Claim 19 (depends on 18)

The server system of claim 18, wherein, to execute the query, the instructions are further executable to cause the server system to:
retrieve data in the results dataset from the user-specific partition of the distributed storage system that is reserved for the first user.

### Claim 20 (depends on 17)

The server system of claim 17, wherein the first data request includes one or more parameters, wherein the instructions are further executable to cause the server system to:
generate the query based on the one or more parameters prior to routing the query to the distributed computing engine.
