# US 2025/0156464 A1 · Dynamic data processing of structured data and adaptive contextual mining of unstructured data during skill runtime

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0156464 A1
- Document ID: US20250156464A1
- Status: Published application
- Kind: A1
- Application number: 18/420,326
- Filed: 2024-01-23
- Published: 2025-05-15
- Earliest claimed: 2023-11-14
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: PalaniRaj KALIYAPERUMAL; Aman SINGHAL; Syed Adnan AHMED; Kuralmani ELANGO; Deepanjan BHOL; Julie STRAUSS; Albert Michael BELTON
- Web page: https://patentgrep.com/patent/US20250156464A1

## CPC

- G06F 16/335: Filtering based on additional data, e.g. user or group profiles (filtering in web context G06F16/9535, G06F16/9536)
- G06F 16/55: Clustering; Classification
- G06F 16/685: {using automatically derived transcript of audio data, e.g. lyrics (speech recognition G10L15/00)}
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods are provided for facilitating the discovery and presentations of skills and data processed by the skills within blocks of a canvas displayed to a user within a user interface. The systems selectively process structured and unstructured data based on user context for facilitating presentation of contextually relevant data to a user.

## Claims

### Claim 1

A method implemented by a computing system for processing structured and unstructured data based on user context for facilitating presentation of contextually relevant data to a user, the method comprising:
identifying a user context;
identifying relevant skills that are accessible to the system to gather and process data for display within blocks of a canvas of an interface;
identifying data obtained from the relevant skills;
determining whether the data is structured or unstructured data;
processing the data by generating (i) knowledge graphs for any unstructured data with knowledge graph records for portions of the unstructured data that are determined to be contextually relevant to the user context and (ii) tables for the structured data with table records for portions of the structured data that are determined to be contextually relevant to the user context;
during a user interface session in which a user is presented the interface, using the knowledge graphs and the tables to identify contextually relevant data to be displayed within the blocks of the canvas based at least in part on the user context; and
selectively presenting a filtered set of the data obtained from the relevant skills by presenting the contextually relevant data identified with the knowledge graphs and the tables while refraining from presenting other portions of the data obtained from the relevant skills that are determined to be contextually less relevant than the contextually relevant data based on the user context.

### Claim 2 (depends on 1)

The method of claim 1, wherein the identification of the relevant skills is further based on an identified application context.

### Claim 3 (depends on 1)

The method of claim 1, wherein the method further comprises refraining from classifying portions of the unstructured data that are determined to be contextually irrelevant to the user context and refraining from storing a knowledge graph record for the portions of the unstructured data that are determined to be contextually irrelevant to the user context.

### Claim 4 (depends on 1)

The method of claim 1, wherein the method further comprises refraining from generating table records for portions of the structured data that are determined to be contextually irrelevant to the user context.

### Claim 5 (depends on 1)

The method of claim 1, wherein the processing the data further comprises classifying objects within an image.

### Claim 6 (depends on 1)

The method of claim 1, wherein the processing the data further comprises generating a transcript from an audio file.

### Claim 7 (depends on 1)

The method of claim 1, wherein the method further includes automatically deleting an index or knowledge graph upon determining the index or knowledge graph was last accessed a predetermined period of time prior to a current period of time.

### Claim 8

A system comprising:
a processor system; and
a computer storage medium that stores computer-executable instructions that are executable by the processor system to implement a method for processing structured and unstructured data based on user context for facilitating presentation of contextually relevant data to a user, and by at least causing the system to:
identify a user context;
identify relevant skills that are accessible to the system to gather and process data for display within blocks of a canvas of an interface;
identify data obtained from the relevant skills;
determine whether the data is structured or unstructured data;
process the data by generating (i) knowledge graphs for any unstructured data with knowledge graph records for portions of the unstructured data that are determined to be contextually relevant to the user context and (ii) tables for the structured data with table records for portions of the structured data that are determined to be contextually relevant to the user context;
during a user interface session in which a user is presented the interface, use the knowledge graphs and the tables to identify contextually relevant data to be displayed within the blocks of the canvas based at least in part on the user context; and
selectively present a filtered set of the data obtained from the relevant skills by presenting the contextually relevant data identified with the knowledge graphs and the tables while refraining from presenting other portions of the data obtained from the relevant skills that are determined to be contextually less relevant than the contextually relevant data based on the user context.

### Claim 9 (depends on 8)

The system of claim 8, wherein the identification of the relevant skills is further based on an identified application context.

### Claim 10 (depends on 8)

The system of claim 8, wherein the computer-executable instructions are further executable for causing the system to refrain from classifying portions of the unstructured data that are determined to be contextually irrelevant to the user context and refraining from storing a knowledge graph record for the portions of the unstructured data that are determined to be contextually irrelevant to the user context.

### Claim 11 (depends on 8)

The system of claim 8, wherein the computer-executable instructions are further executable for causing the system to refrain from generating table records for portions of the structured data that are determined to be contextually irrelevant to the user context.

### Claim 12 (depends on 8)

The system of claim 8, wherein computer-executable instructions are further executable for causing the system to classify objects within an image.

### Claim 13 (depends on 8)

The system of claim 8, wherein computer-executable instructions are further executable for causing the system to generate a transcript from an audio file.

### Claim 14 (depends on 8)

The system of claim 8, wherein the computer-executable instructions are further executable for causing the system to automatically delete an index or knowledge graph upon determining the index or knowledge graph was last accessed a predetermined period of time prior to a current period of time.

### Claim 15

A hardware storage device storing computer-executable instructions that are executable by one or more hardware processors of a computing system for causing the computing system to implement a method for processing structured and unstructured data based on user context for facilitating presentation of contextually relevant data to a user, and by at least causing the computing system to:
identify a user context;
identify relevant skills that are accessible to the system to gather and process data for display within blocks of a canvas of an interface;
identify data obtained from the relevant skills;
determine whether the data is structured or unstructured data;
process the data by generating (i) knowledge graphs for any unstructured data with knowledge graph records for portions of the unstructured data that are determined to be contextually relevant to the user context and (ii) tables for the structured data with table records for portions of the structured data that are determined to be contextually relevant to the user context;
during a user interface session in which a user is presented the interface, use the knowledge graphs and the tables to identify contextually relevant data to be displayed within the blocks of the canvas based at least in part on the user context; and
selectively present a filtered set of the data obtained from the relevant skills by presenting the contextually relevant data identified with the knowledge graphs and the tables while refraining from presenting other portions of the data obtained from the relevant skills that are determined to be contextually less relevant than the contextually relevant data based on the user context.

### Claim 16 (depends on 15)

The hardware storage device of claim 15, wherein the identification of the relevant skills is further based on an identified application context.

### Claim 17 (depends on 15)

The hardware storage device of claim 15, wherein the computer-executable instructions are further executable for causing the system to refrain from classifying portions of the unstructured data that are determined to be contextually irrelevant to the user context and refraining from storing a knowledge graph record for the portions of the unstructured data that are determined to be contextually irrelevant to the user context.

### Claim 18 (depends on 15)

The hardware storage device of claim 15, wherein the computer-executable instructions are further executable for causing the system to refrain from generating table records for portions of the structured data that are determined to be contextually irrelevant to the user context.

### Claim 19 (depends on 15)

The hardware storage device of claim 15, wherein computer-executable instructions are further executable for causing the system to classify objects within an image and to generate a transcript from an audio file.

### Claim 20 (depends on 15)

The hardware storage device of claim 15, wherein the computer-executable instructions are further executable for causing the system to automatically delete an index or knowledge graph upon determining the index or knowledge graph was last accessed a predetermined period of time prior to a current period of time.
