# US 2026/0064670 A1 · Natural language endpoint manipulation with a large language model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0064670 A1
- Document ID: US20260064670A1
- Status: Published application
- Kind: A1
- Application number: 18/819,699
- Filed: 2024-08-29
- Published: 2026-03-05
- Earliest claimed: 2024-08-29
- Applicants: Palo Alto Networks, Inc.
- Inventors: Bin Wang; Sayali Pradip Kamat
- Web page: https://patentgrep.com/patent/US20260064670A1

## CPC

- G06F 16/243: {Natural language query formulation}
- G06F 9/4843: {by program, e.g. task dispatcher, supervisor, operating system}
- G06F 9/547: {Remote procedure calls [RPC]; Web services}
- G06F 16/212: {with details for data modelling support}
- G06F 16/258: {Data format conversion from or to a database}
- G06F 40/30: Semantic analysis
- G06F 40/56: Natural language generation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A user query that includes a natural language description for access to a backend service of a plurality of backend services is received from a client device. The user query is routed to the backend service based in part on an large language model understanding of the natural language description. A response is received from the backend service. The response is provided to the client device.

## Claims

### Claim 1

A method, comprising:
receiving at a routing service from a client device a user query that includes a natural language description for access to a backend service of a plurality of backend services;
routing the user query from the routing service to the backend service based in part on a first large language model understanding of the natural language description, wherein the backed service is associated with a plurality of endpoints, wherein the backend service processes the user query in part by generating a prompt for a second large language model included in the backend service, and wherein based on the prompt, the second large language model generates an application program interface (API) request to obtain a response to the user query and determines which endpoint of the plurality of endpoints to call to answer the user query, wherein the backend service provides the user query to the determined endpoint using the generated API request;
receiving a response from the backend service; and
providing the response to the client device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the backend service is a telemetry access service.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first large language model understanding of the natural language description includes one or more of an intent associated with the user query, a sub-intent associated with the user query, one or more features associated with the user query, and one or more products associated with the user query.

### Claim 4 (depends on 1)

The method of claim 1, wherein the backend service performs one or more validation checks on the user query.

### Claim 5

(canceled)

### Claim 6 (depends on 1)

The method of claim 1, wherein the prompt includes an example schema and one or more examples.

### Claim 7 (depends on 6)

The method of claim 6, wherein the example schema is a Pydantic style schema.

### Claim 8

(canceled)

### Claim 9

(canceled)

### Claim 10 (depends on 1)

The method of claim 1, wherein the backend service utilizes the applications program interface request to call the determined endpoint.

### Claim 11 (depends on 10)

The method of claim 10, wherein the backend service receives an endpoint response from the determined endpoint.

### Claim 12 (depends on 11)

The method of claim 11, wherein the backend service formats the endpoint response into a human-readable format.

### Claim 13 (depends on 12)

The method of claim 12, wherein the received response is the formatted response.

### Claim 14 (depends on 12)

The method of claim 12, wherein the backend service formats the endpoint response into a table or graph.

### Claim 15 (depends on 1)

The method of claim 1, wherein the backend service updates a task status associated with the user query in response to receiving the user query.

### Claim 16 (depends on 15)

The method of claim 15, wherein the backed service updates the task status associated with the user query in response to provide an endpoint associated with the backend service an applications program interface request.

### Claim 17 (depends on 16)

The method of claim 16, wherein the backend service updates the task status associated with the user query in response to receiving an endpoint response from the endpoint associated with the backend service.

### Claim 18

A system, comprising:
a processor configured to:
receive at a routing service from a client device a user query that includes a natural language description for access to a backend service of a plurality of backend services;
route the user query from the routing service to the backend service based in part on a first large language model understanding of the natural language description, wherein the backed service is associated with a plurality of endpoints, wherein the backend service processes the user query in part by generating a prompt for a second large language model included in the routing service, and wherein based on the prompt, the second large language model generates an application program interface (API) request and determines which endpoint of the plurality of endpoints to call to answer the user query, wherein the backend service provides the user query to the determined endpoint using the generated API request;
receive a response from the backend service; and
provide the response to the client device; and
a memory coupled to the processor and configured to provide the processor with instructions.

### Claim 19 (depends on 18)

The system of claim 18, wherein the backend service is a telemetry access service.

### Claim 20

A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
receiving at a routing service from a client device a user query that includes a natural language description for access to a backend service of a plurality of backend services;
routing the user query from the routing service to the backend service based in part on a first large language model understanding of the natural language description, wherein the backed service is associated with a plurality of endpoints, wherein the backend service processes the user query in part by generating a prompt for a second large language model included in the backend service, and wherein based on the prompt, the second large language model generates an application program interface (API) request to obtain a response to the user query and determines which endpoint of the plurality of endpoints to call to answer the user query, wherein the backend service provides the user query to the determined endpoint using the generated API request;
receiving a response from the backend service; and
providing the response to the client device.
