US 2026/0064974 A1 · USING GENERATIVE AI TO INTEGRATE MULTI-DIMENSIONAL DATA WITH DATA CONSUMERS USING NATURAL LANGUAGE

Abstract

Systems, methods, and computer-readable media are provided for triggering functionality on data to be generated in a user interface and/or data shown or visualized in a user interface based on a natural language request that references actions to be performed and data items to use in performing the actions. The user interface actions are triggered based on a structured object generated by a large language model (LLM), which may then be processed, validated, and used to carry out the actions. The LLM may be further instructed based on available interface functionality control(s) and which content has been selected on the user interface. The structured object may be used to generate output content that is based on the selected content, such as a summary or other text transformation, a targeted visualization, output document for consumption by another application, or other consumable content. The output content may be stored in association with a content consumer for display in a user interface.

Claims24

Dependent claims

A computer-implemented method comprising:

accessing a natural language request received in a user session with an application;
wherein content is graphically selected in the user session when the natural language request is received;
generating a prompt that includes the natural language request, information indicating the selected content, and one or more interface functionality controls for controlling interface functionality to generate output content;
prompting a large language model with the prompt;
receiving a result of the prompt, the result comprising an interface functionality specification that uses at least one of the one or more interface functionality controls and is based at least in part on the information indicating the selected content;
causing execution of the at least one of the one or more interface functionality controls to generate particular output content that is based at least in part on the information indicating the selected content;
storing the particular output content in association with a content consumer for display in a user interface.

4 more elements

A computer-program product comprising one or more non-transitory machine-readable storage media, including stored instructions configured to cause a computing system to perform a set of actions including:

accessing a natural language request received in a user session with an application;
wherein content is graphically selected in the user session when the natural language request is received;
generating a prompt that includes the natural language request, information indicating the selected content, and one or more interface functionality controls for controlling interface functionality to generate output content;
prompting a large language model with the prompt;
receiving a result of the prompt, the result comprising an interface functionality specification that uses at least one of the one or more interface functionality controls and is based at least in part on the information indicating the selected content;
causing execution of the at least one of the one or more interface functionality controls to generate particular output content that is based at least in part on the information indicating the selected content;
storing the particular output content in association with a content consumer for display in a user interface.

4 more elements

A system comprising:

one or more processors;
one or more non-transitory computer-readable media storing instructions, which, when executed by the system, cause the system to perform a set of actions including:
accessing a natural language request received in a user session with an application;
wherein content is graphically selected in the user session when the natural language request is received;
generating a prompt that includes the natural language request, information indicating the selected content, and one or more interface functionality controls for controlling interface functionality to generate output content;
prompting a large language model with the prompt;
receiving a result of the prompt, the result comprising an interface functionality specification that uses at least one of the one or more interface functionality controls and is based at least in part on the information indicating the selected content;
causing execution of the at least one of the one or more interface functionality controls to generate particular output content that is based at least in part on the information indicating the selected content;
storing the particular output content in association with a content consumer for display in a user interface.

6 more elements

Dependencies are inferred from the claim text.

Using generative ai to integrate multi-dimensional data with data consumers using natural language

Life of this patent

Using generative ai to integrate multi-dimensional data with data consumers using natural language

Life of this patent

Abstract

Claims24