# US 2025/0028715 A1 · Data standardization using machine learning for comprehensive query processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0028715 A1
- Document ID: US20250028715A1
- Status: Published application
- Kind: A1
- Application number: 18/222,592
- Filed: 2023-07-17
- Published: 2025-01-23
- Earliest claimed: 2023-07-17
- Assignees: UKG Inc.
- Applicants: UKG Inc.
- Inventors: Viraj Thakur; Brett Philip Myers; Alexander Khvesko; Yaraslau Byshyk
- Web page: https://patentgrep.com/patent/US20250028715A1

## CPC

- G06F 16/24528: {Standardisation; Simplification}
- G06F 16/243: {Natural language query formulation}
- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G06F 40/30: Semantic analysis
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Techniques and systems for data standardization using machine learning are provided. The techniques include identifying a query that includes a data unit, representing the data unit via token(s), processing the token(s) using a plurality of machine learning models (MLMs) to identify cluster(s) associated with at least one token of the data unit. Processing may include using a first MLM to evaluate statistical associations of the token(s) with cluster(s). Processing may further include using a second MLM to evaluate lexical associations of the token(s) with the cluster(s). The techniques may further include retrieving, using the one or more identified clusters, data associated with the query.

## Claims

### Claim 1

A method comprising:
identifying, by a processing device, a query comprising a data unit;
representing, by the processing device, the data unit via one or more tokens;
processing, by the processing device, the one or more tokens using a plurality of machine learning models (MLMs) to identify one or more clusters of a plurality of clusters, wherein each of the one or more identified clusters is associated with at least one token of the one or more tokens, wherein processing the one or more tokens comprises:
processing the one or more tokens using a first MLM of the plurality of MLMs to generate a first embedding vector comprising a first plurality of components, wherein an individual component of the first plurality of components characterizes a likelihood of a historical association of the one or more tokens with a respective cluster of the plurality of clusters;
processing the one or more tokens using a second MLM of the plurality of MLMs to generate a second embedding vector comprising a second plurality of components, wherein an individual component of the second plurality of components characterizes a likelihood of a lexical association of the one or more tokens with a respective cluster of the plurality of clusters; and
identifying the one or more clusters using a third embedding, aggregated from the first embedding and the second embedding; and
retrieving, using the one or more identified clusters, data associated with the query.

### Claim 2 (depends on 1)

The method of claim 1, wherein individual clusters of the plurality of clusters are initialized by associating one or more anchor tokens with a respective cluster.

### Claim 3 (depends on 2)

The method of claim 2, wherein the historical association of the one or more tokens with the respective cluster of the plurality of clusters characterizes a number of times the one or more tokens have been encountered in training data units together with the one or more anchor tokens associated with the respective cluster.

### Claim 4 (depends on 3)

The method of claim 3, wherein the training data units comprise data units previously processed by the first MLM.

### Claim 5 (depends on 3)

The method of claim 3, further comprising:
updating one or more parameters of the first MLM in view of the one or more tokens and the one or more identified clusters.

### Claim 6 (depends on 1)

The method of claim 1, wherein each cluster of at least a subset of the plurality of clusters is associated with different lexical units having a substantially same semantic meaning.

### Claim 7 (depends on 1)

The method of claim 1, wherein the second MLM is trained using:
a plurality of training data units, and
ground truth labels generated by application of the first MLM to the plurality of training data units.

### Claim 8 (depends on 1)

The method of claim 1, wherein representing the data unit via one or more tokens comprises performing at least one of:
correcting spelling of one or more words in the data unit, translating one or more foreign-language words in the data unit, replacing one or more acronyms in the data unit,
expanding one or more abbreviations in the data unit, or
adding one or more spaces between two or more words in the data unit.

### Claim 9

A method comprising:
initiating a plurality of clusters by assigning one or more anchor tokens to each cluster of the plurality of clusters; and
training a first MLM using a training data unit comprising one or more tokens, wherein training the first MLM comprises:
causing the first MLM to access a first cluster score of each token of the one or more tokens;
causing the first MLM to modify the first cluster score of each token of the one or more tokens in view of a first number of occurrences, in the training data unit, of the one or more anchor tokens assigned to a first cluster of the plurality of clusters;
receiving a query comprising one or more query tokens;
causing the first MLM to generate, using the first cluster scores of each of the one or more query tokens, an embedding vector comprising a plurality of components, wherein an individual component of the plurality of components characterizes a likelihood of a historical association of the one or more query tokens with the first cluster; and
processing, using a machine learning classifier, the embedding vector to retrieve data associated with the query.

### Claim 10 (depends on 9)

The method of claim 9, wherein training the first MLM further comprises:
causing the first MLM to access a second cluster score of each token of the one or more tokens; and
causing the first MLM to modify the second cluster score of each token of the one or more tokens in view of a second number of occurrences in the training data unit of the one or more anchor tokens assigned to a second cluster of the plurality of clusters.

### Claim 11 (depends on 9)

The method of claim 9, wherein each cluster of at least a subset of the plurality of clusters is associated with different lexical units having a substantially same semantic meaning.

### Claim 12 (depends on 9)

The method of claim 9, wherein, prior to training the first MLM using the training data unit, the first cluster score characterizes a number of times a respective token of the one or more tokens has been encountered in previous training data units together with the one or more anchor tokens assigned to the first cluster.

### Claim 13 (depends on 9)

The method of claim 9, wherein a higher first cluster score indicates a higher probability of occurrence, in a same data unit, of a respective token of the one or more tokens with the one or more anchor tokens assigned to the first cluster.

### Claim 14 (depends on 9)

The method of claim 9, further comprising:
processing, using the trained first MLM, a data unit associated with a query, to identify association of the data unit with one or more clusters of the plurality of clusters.

### Claim 15 (depends on 9)

The method of claim 9, further comprising:
training a second MLM of the one or more MLMs using a plurality of training data units and ground truth labels generated by application of the first MLM to the plurality of training data units, wherein the second MLM is a pre-trained embeddings language model.

### Claim 16

A system comprising:
a memory; and
a processing device coupled to the memory, the processing device to perform operations comprising:
identifying, by a processing device, a query comprising a data unit;
representing, by the processing device, the data unit via one or more tokens;
processing, by the processing device, the one or more tokens using a plurality of machine learning models (MLMs) to identify one or more clusters of a plurality of clusters, wherein each of the one or more identified clusters is associated with at least one token of the one or more tokens, wherein processing the one or more tokens comprises:
processing the one or more tokens using a first MLM of the plurality of MLMs to generate a first embedding vector comprising a first plurality of components, wherein an individual component of the first plurality of components characterizes a likelihood of a historical association of the one or more tokens with a respective cluster of the plurality of clusters;
processing the one or more tokens using a second MLM of the plurality of MLMs to generate a second embedding vector comprising a second plurality of components, wherein an individual component of the second plurality of components characterizes a likelihood of a lexical association of the one or more tokens with a respective cluster of the plurality of clusters; and
identifying the one or more clusters using a third embedding, aggregated from the first embedding and the second embedding; and
retrieving, using the one or more identified clusters, data associated with the query.

### Claim 17 (depends on 16)

The system of claim 16, wherein individual clusters of the plurality of clusters are initialized by associating one or more anchor tokens with a respective cluster.

### Claim 18 (depends on 17)

The system of claim 17, historical association of the one or more tokens with the respective cluster of the plurality of clusters characterizes a number of times the one or more tokens have been encountered in training data units together with the one or more anchor tokens associated with the respective cluster.

### Claim 19 (depends on 16)

The system of claim 16, wherein each cluster of at least a subset of the plurality of clusters is associated with different lexical units having a substantially same semantic meaning.

### Claim 20 (depends on 16)

The system of claim 16, wherein representing the data unit via one or more tokens comprises performing at least one of:
correcting spelling of one or more words in the data unit, translating one or more foreign-language words in the data unit, replacing one or more acronyms in the data unit,
expanding one or more abbreviations in the data unit, or
adding one or more spaces between two or more words in the data unit.
