# US 2023/0266940 A1 · Semantic based ordinal sorting

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0266940 A1
- Document ID: US20230266940A1
- Status: Published application
- Kind: A1
- Application number: 17/678,836
- Filed: 2022-02-23
- Published: 2023-08-24
- Earliest claimed: 2022-02-23
- Assignees: Fujitsu Limited
- Applicants: Fujitsu Limited
- Inventors: Mehdi BAHRAMI; Wei-Peng CHEN
- Web page: https://patentgrep.com/patent/US20230266940A1

## CPC

- G06F 7/08: Sorting, i.e. grouping record carriers in numerical or other ordered sequence according to the classification of at least some of the information they carry (by merging two or more sets of carriers in ordered sequence G06F7/16)
- G06F 40/30: Semantic analysis
- G06F 16/285: {Clustering or classification}
- G06F 40/247: Thesauruses; Synonyms
- G06N 20/00: Machine learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Operations may include obtaining a dataset that includes a plurality of unique values and obtaining a plurality of permutations with respect to the plurality of unique values. Additionally, the operations may include, for each respective permutation, obtaining a respective overall permutation probability for the respective permutation based on masked value probabilities determined by a masked language model (MLM). Each masked value probability may be determined with respect to a respective masked version of a plurality of masked versions of the respective permutation. The operations may also include selecting a particular permutation from the plurality of permutations based on a comparison between the respective overall permutation probabilities of the plurality of permutations. In addition, the operations may include determining a semantic order of the unique values of the plurality of unique values based on the particular permutation in which the semantic order is related to respective meanings of the unique values.

## Claims

### Claim 1

A method comprising:
obtaining a dataset that includes a plurality of unique values;
obtaining a plurality of permutations with respect to the plurality of unique values, each permutation including a unique sequence of two or more of the unique values;
for each respective permutation of the plurality of permutations:
generating a plurality of masked versions of the respective permutation, each respective masked version of the plurality of masked versions masking a different unique value of the respective permutation;
providing each masked version to a masked language model (MLM);
obtaining, from the MLM, a plurality of masked value probabilities, each respective masked value probability of the plurality of masked value probabilities corresponding to a different masked version and indicating a probability associated with the masked unique value with respect to the respective permutation; and
obtaining a respective overall permutation probability for the respective permutation based on the plurality of masked value probabilities determined with respect to the plurality of masked versions of the respective permutation;
selecting a particular permutation from the plurality of permutations based on a comparison between the respective overall permutation probabilities of the plurality of permutations;
determining a semantic order of the unique values of the plurality of unique values based on the particular permutation in which the semantic order is related to respective meanings of the unique values;
assigning an ordinal value to each of one or more of the unique values based on the semantic order; and
encoding the dataset with the ordinal values as assigned to each unique value.

### Claim 2 (depends on 1)

The method of claim 1, further comprising processing the encoded dataset based on the ordinal values encoded therein.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
each respective permutation of the plurality of permutations does not include a particular unique value of the plurality of unique values; and
wherein the method further comprises:
obtaining a plurality of additional permutations based on the selected particular permutation and based on the particular unique value in which the particular unique value is added to the selected particular permutation to generate each respective additional permutation of the plurality of permutations and in which a position of the particular unique value differs in each respective additional permutation;
masking the particular unique value in each respective additional permutation to generate a plurality of masked additional permutations;
providing each masked additional permutation to the MLM;
obtaining, from the MLM, a plurality of additional permutation probabilities, each respective additional permutation probability of the plurality of additional permutation probabilities corresponding to a different masked additional permutation and indicating a probability associated with the particular unique value with respect to the corresponding additional permutation;
selecting a particular additional permutation from the plurality of additional permutations based on a comparison between the respective additional permutation probabilities of the plurality of additional masked value probabilities; and
updating the semantic order of the unique values based on the particular additional permutation.

### Claim 4 (depends on 1)

The method of claim 1, further comprising recommending further review of the unique values based on the comparison between the respective overall permutation probabilities.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
replacing two or more particular unique values with a single representative value based on each of the two or more particular unique values including a common token;
including the representative value in the plurality of permutations; and
determining a position in the semantic order of the two or more particular unique values with respect to other unique values based on a position of the representative value in the selected particular permutation.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
obtaining a plurality of additional permutations with respect to the two or more particular unique values;
for each respective additional permutation of the plurality of additional permutations:
generating a plurality of masked additional permutation versions of the respective additional permutation, each respective masked additional permutation version of the plurality of masked additional permutation versions masking a different particular unique value of the respective additional permutation;
providing each masked additional permutation version to the MLM;
obtaining, from the MLM, a plurality of additional masked value probabilities, each respective additional masked value probability of the plurality of additional masked value probabilities corresponding to a different masked additional permutation version and indicating a probability associated with the masked particular unique value with respect to the respective additional permutation; and
obtaining a respective overall additional permutation probability for the respective additional permutation based on the plurality of additional masked value probabilities determined with respect to the plurality of masked additional permutation versions of the respective additional permutation;
selecting a particular additional permutation from the plurality of additional permutations based on a comparison between the respective overall additional permutation probabilities of the plurality of additional permutations; and
determining a position in the semantic order of the two or more particular unique values with respect to each other based on the selected particular additional permutation.

### Claim 7

One or more non-transitory computer-readable storage media configured to store instructions that, in response to being executed, cause a system to perform operations, the operations comprising:
obtaining a dataset that includes a plurality of unique values;
obtaining a plurality of permutations with respect to the plurality of unique values, each permutation including a unique sequence of two or more of the unique values;
for each respective permutation of the plurality of permutations, obtaining a respective overall permutation probability for the respective permutation based on a plurality of masked value probabilities determined by a masked language model (MLM) in which each masked value probability is determined with respect to a respective masked version of a plurality of masked versions of the respective permutation;
selecting a particular permutation from the plurality of permutations based on a comparison between the respective overall permutation probabilities of the plurality of permutations; and
determining a semantic order of the unique values of the plurality of unique values based on the particular permutation in which the semantic order is related to respective meanings of the unique values.

### Claim 8 (depends on 7)

The one or more non-transitory computer-readable storage media of claim 7, wherein the operations further comprise:
assigning an ordinal value to each of one or more of the unique values based on the semantic order; and
encoding the dataset with the ordinal values as assigned to each unique value.

### Claim 9 (depends on 7)

The one or more non-transitory computer-readable storage media of claim 7, wherein obtaining the respective overall permutation probability of the respective permutation includes:
generating the plurality of masked versions of the respective permutation, each respective masked version of the plurality of masked versions masking a different unique value of the respective permutation;
providing each masked version to the MLM; and
obtaining, from the MLM, the plurality of masked value probabilities, each respective masked value probability of the plurality of masked value probabilities corresponding to a different masked version and indicating a probability associated with the masked unique value with respect to the respective permutation.

### Claim 10 (depends on 7)

The one or more non-transitory computer-readable storage media of claim 7, wherein:
each respective permutation of the plurality of permutations does not include a particular unique value of the plurality of unique values; and
wherein the operations further comprise:
obtaining a plurality of additional permutations based on the selected particular permutation and based on the particular unique value in which the particular unique value is added to the selected particular permutation to generate each respective additional permutation of the plurality of permutations and in which a position of the particular unique value differs in each respective additional permutation;
masking the particular unique value in each respective additional permutation to generate a plurality of masked additional permutations;
providing each masked additional permutation to the MLM;
obtaining, from the MLM, a plurality of additional permutation probabilities, each respective additional permutation probability of the plurality of additional permutation probabilities corresponding to a different masked additional permutation and indicating a probability associated with the particular unique value with respect to the corresponding additional permutation;
selecting a particular additional permutation from the plurality of additional permutations based on a comparison between the respective additional permutation probabilities of the plurality of additional masked value probabilities; and
updating the semantic order of the unique values based on the particular additional permutation.

### Claim 11 (depends on 7)

The one or more non-transitory computer-readable storage media of claim 7, the operations further comprising recommending further review of the unique values based on the comparison between the respective overall permutation probabilities.

### Claim 12 (depends on 7)

The one or more non-transitory computer-readable storage media of claim 7, the operations further comprising:
replacing two or more particular unique values with a single representative value based on each of the two or more particular unique values including a common token;
including the representative value in the plurality of permutations; and
determining a position in the semantic order of the two or more particular unique values with respect to other unique values based on a position of the representative value in the selected particular permutation.

### Claim 13 (depends on 12)

The one or more non-transitory computer-readable storage media of claim 12, the operations further comprising:
obtaining a plurality of additional permutations with respect to the two or more particular unique values;
for each respective additional permutation of the plurality of additional permutations:
generating a plurality of masked additional permutation versions of the respective additional permutation, each respective masked additional permutation version of the plurality of masked additional permutation versions masking a different particular unique value of the respective additional permutation;
providing each masked additional permutation version to the MLM;
obtaining, from the MLM, a plurality of additional masked value probabilities, each respective additional masked value probability of the plurality of additional masked value probabilities corresponding to a different masked additional permutation version and indicating a probability associated with the masked particular unique value with respect to the respective additional permutation; and
obtaining a respective overall additional permutation probability for the respective additional permutation based on the plurality of additional masked value probabilities determined with respect to the plurality of masked additional permutation versions of the respective additional permutation;
selecting a particular additional permutation from the plurality of additional permutations based on a comparison between the respective overall additional permutation probabilities of the plurality of additional permutations; and
determining a position in the semantic order of the two or more particular unique values with respect to each other based on the selected particular additional permutation.

### Claim 14

A system comprising:
one or more processors; and
one or more non-transitory computer-readable storage media configured to store instructions that, in response to being executed by the one or more processors, cause the system to perform operations, the operations comprising:
obtaining a dataset that includes a plurality of unique values;
obtaining a plurality of permutations with respect to the plurality of unique values, each permutation including a unique sequence of two or more of the unique values;
for each respective permutation of the plurality of permutations, obtaining a respective overall permutation probability for the respective permutation based on a plurality of masked value probabilities determined by a masked language model (MLM) in which each masked value probability is determined with respect to a respective masked version of a plurality of masked versions of the respective permutation;
selecting a particular permutation from the plurality of permutations based on a comparison between the respective overall permutation probabilities of the plurality of permutations; and
determining a semantic order of the unique values of the plurality of unique values based on the particular permutation in which the semantic order is related to respective meanings of the unique values.

### Claim 15 (depends on 14)

The system of claim 14, wherein the operations further comprise:
assigning an ordinal value to each of one or more of the unique values based on the semantic order; and
encoding the dataset with the ordinal values as assigned to each unique value.

### Claim 16 (depends on 14)

The system of claim 14, wherein obtaining the respective overall permutation probability of the respective permutation includes:
generating the plurality of masked versions of the respective permutation, each respective masked version of the plurality of masked versions masking a different unique value of the respective permutation;
providing each masked version to the MLM; and
obtaining, from the MLM, the plurality of masked value probabilities, each respective masked value probability of the plurality of masked value probabilities corresponding to a different masked version and indicating a probability associated with the masked unique value with respect to the respective permutation.

### Claim 17 (depends on 14)

The system of claim 14, wherein:
each respective permutation of the plurality of permutations does not include a particular unique value of the plurality of unique values; and
wherein the operations further comprise:
obtaining a plurality of additional permutations based on the selected particular permutation and based on the particular unique value in which the particular unique value is added to the selected particular permutation to generate each respective additional permutation of the plurality of permutations and in which a position of the particular unique value differs in each respective additional permutation;
masking the particular unique value in each respective additional permutation to generate a plurality of masked additional permutations;
providing each masked additional permutation to the MLM;
obtaining, from the MLM, a plurality of additional permutation probabilities, each respective additional permutation probability of the plurality of additional permutation probabilities corresponding to a different masked additional permutation and indicating a probability associated with the particular unique value with respect to the corresponding additional permutation;
selecting a particular additional permutation from the plurality of additional permutations based on a comparison between the respective additional permutation probabilities of the plurality of additional masked value probabilities; and
updating the semantic order of the unique values based on the particular additional permutation.

### Claim 18 (depends on 14)

The system of claim 14, the operations further comprising recommending further review of the unique values based on the comparison between the respective overall permutation probabilities.

### Claim 19 (depends on 14)

The system of claim 14, the operations further comprising:
replacing two or more particular unique values with a single representative value based on each of the two or more particular unique values including a common token;
including the representative value in the plurality of permutations; and
determining a position in the semantic order of the two or more particular unique values with respect to other unique values based on a position of the representative value in the selected particular permutation.

### Claim 20 (depends on 14)

The system of claim 14, the operations further comprising:
obtaining a plurality of additional permutations with respect to the two or more particular unique values;
for each respective additional permutation of the plurality of additional permutations:
generating a plurality of masked additional permutation versions of the respective additional permutation, each respective masked additional permutation version of the plurality of masked additional permutation versions masking a different particular unique value of the respective additional permutation;
providing each masked additional permutation version to the MLM;
obtaining, from the MLM, a plurality of additional masked value probabilities, each respective additional masked value probability of the plurality of additional masked value probabilities corresponding to a different masked additional permutation version and indicating a probability associated with the masked particular unique value with respect to the respective additional permutation; and
obtaining a respective overall additional permutation probability for the respective additional permutation based on the plurality of additional masked value probabilities determined with respect to the plurality of masked additional permutation versions of the respective additional permutation;
selecting a particular additional permutation from the plurality of additional permutations based on a comparison between the respective overall additional permutation probabilities of the plurality of additional permutations; and
determining a position in the semantic order of the two or more particular unique values with respect to each other based on the selected particular additional permutation.
