# US 2021/0279606 A1 · Automatic detection and association of new attributes with entities in knowledge bases

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279606 A1
- Document ID: US20210279606A1
- Status: Published application
- Kind: A1
- Application number: 16/813,510
- Filed: 2020-03-09
- Published: 2021-09-09
- Earliest claimed: 2020-03-09
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Vijay Srinivasan; Christian Koehler; Hongxia Jin
- Web page: https://patentgrep.com/patent/US20210279606A1

## CPC

- G06N 3/08: Learning methods
- G06N 5/04: Inference or reasoning models
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/09: Supervised learning
- G06N 3/091: Active learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06N 5/025: Extracting rules from data
- G06N 20/00: Machine learning
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/045: Combinations of networks
- G06N 5/02: Knowledge representation; Symbolic representation
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems and methods are described for adding new attributes to entities of a knowledge base. A plurality of correlations may be identified between the new attribute and existing attributes of the entities using a rule-based model, such that attribute rules may be associated with each identified correlation exceeding a predetermined confidence threshold. An unstructured data model may then be applied to the knowledge base to identify unstructured data associated with each entity of the plurality of entities correlated to presence of the new attribute. Then a meta learner model may be applied to identify weights for each attribute rule and the identified unstructured data. After the weights have been set for the meta learner model, the meta learner model may then be applied to each entity in the knowledge base to accurately identify entities having the new attribute.

## Claims

### Claim 1

A method comprising:
retrieving, at an electronic device, a new attribute;
mining, at the electronic device, attribute rules determining relationships between existing attributes of a first plurality of entities from a knowledge base (KB) and the new attribute, wherein each attribute rule is associated with a confidence value;
training a rule-based classifier by applying the attribute rules to a second plurality of entities, wherein the rule-based classifier controls application of an attribute rule based on a confidence value threshold; and
training a meta learner by applying a weight to an output of the rule-based classifier, wherein the meta learner identifies association of entities of the KB with the new attributes.

### Claim 2 (depends on 1)

The method of claim 1, further comprising identifying, using an unstructured data model, unstructured data associated with each entity of the second plurality of entities that is correlated to presence of the new attribute, the training the meta learner further comprising applying weights for the identified unstructured data based on prediction probabilities associated with the identified unstructured data and identifying association of entities of the KB with the new attributes based on the weighted output of the rule-based classifier and the weighted identified unstructured data associated with each entity of the second plurality of entities.

### Claim 3 (depends on 2)

The method of claim 2, the identifying unstructured data being based on positive and negative entity-attribute training data, the training data being augmented by entity-attribute data generated by the rule-based model, the generated entity-attribute data from the rule-based model having confidence values exceeding a predetermined threshold.

### Claim 4 (depends on 1)

The method of claim 1, the identifying correlations between the new attribute and existing attributes being based on selected positive and negative entity-attribute training data, the selecting comprising:
receiving a plurality of entity-attribute pairs provided by users, the entity-attribute pairs comprising an entity of the plurality of entities and a label of either positive or negative presence of the new attribute;
determining a utility of each entity-attribute pair based on entity similarity and uncertainty values determined for each pair; and
selecting a subset of the plurality of entity-attribute pairs base based on having a utility greater than a predetermined threshold.

### Claim 5 (depends on 4)

The method of claim 4, the identifying correlations between the new attribute and existing attributes further comprising using the selected subset of the plurality of entity-attribute pairs to generate entity fact baskets for each of the selected subset, the fact baskets each comprising all of the attributes of a corresponding entity-attribute pair, the associating an attribute rule further comprising identifying individual existing attributes and combinations of existing attributes within the subset of entity-attribute pairs having confidence values greater than the predetermined threshold as rules.

### Claim 6 (depends on 1)

The method of claim 1, the plurality of attribute rules comprising positive rules, indicating presence of the new attribute, and negative rules, indicating absence of the new attribute.

### Claim 7 (depends on 1)

The method of claim 1, the identifying correlations between the new attribute and existing attributes being based on selected positive and negative entity-attribute training data, wherein the identifying the unstructured data comprises:
receiving a plurality of entity-attribute pairs provided by users, the entity-attribute pairs comprising an entity of the plurality of entities and either positive or negative presence of the new attribute, each entity of the entity-attribute pairs being further associated with unstructured data; and
based on the unstructured data of the entity-attribute pairs, identifying correlations between features of the unstructured data of the entity-attribute pairs and both presence and absence of the new attribute, the identified unstructured data comprising unstructured data of the entity-attribute pairs having a prediction probability exceeding a second predetermined threshold.

### Claim 8 (depends on 7)

The method of claim 7, the identifying the unstructured data further comprising receiving additional entity-attribute pairs from the rule-based model, the additional entity-attribute pairs comprising entities identified using the plurality of attribute rules as having the new attribute, and identifying additional correlations between features of unstructured data associated with each of the additional entity-attribute pairs, the identified unstructured data further comprising unstructured data of the additional entity-attribute pairs having a prediction probability exceeding the second predetermined threshold.

### Claim 9 (depends on 1)

The method of claim 1, wherein the identified unstructured data is interpreted as a virtual rule by the meta learner model such that the weights for each attribute rule and each virtual rule are applied based on the confidences associated with each attribute rule and each associated identified unstructured data.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
expressing the plurality of attribute rules as constraints on Boolean decision variables for entity existing attributes;
identifying embeddings for entities identified using the plurality of attribute rules.

### Claim 11

A computer program product comprising computer-readable program code to be executed by one or more processors when retrieved from a non-transitory computer-readable medium, the program code including instructions to:
retrieve a new attribute;
mine attribute rules determining relationships between existing attributes of a first plurality of entities from a knowledge base (KB) and the new attribute, wherein each attribute rule is associated with a confidence value;
training a rule-based classifier by applying the attribute rules to a second plurality of entities, wherein the rule-based classifier controls application of an attribute rule based on a confidence value threshold; and
train a meta learner by applying a weight to an output of the rule-based classifier, wherein the meta learner identifies association of entities of the KB with the new attributes.

### Claim 12 (depends on 11)

The computer program product of claim 11, further comprising instructions to identify, using an unstructured data model, unstructured data associated with each entity of the second plurality of entities that is correlated to presence of the new attribute, the training the meta learner further comprising applying weights for the identified unstructured data based on prediction probabilities associated with the identified unstructured data and identifying association of entities of the KB with the new attributes based on the weighted output of the rule-based classifier and the weighted identified unstructured data associated with each entity of the second plurality of entities.

### Claim 13 (depends on 12)

The computer program product of claim 12, the identifying unstructured data being based on positive and negative entity-attribute training data, the training data being augmented by entity-attribute data generated by the rule-based model, the generated entity-attribute data from the rule-based model having confidence values exceeding a predetermined threshold.

### Claim 14 (depends on 11)

The computer program product of claim 11, the identifying correlations between the new attribute and existing attributes being based on selected positive and negative entity-attribute training data, the selecting comprising:
receiving a plurality of entity-attribute pairs provided by users, the entity-attribute pairs comprising an entity of the plurality of entities and a label of either positive or negative presence of the new attribute;
determining a utility of each entity-attribute pair based on entity similarity and uncertainty values determined for each pair; and
selecting a subset of the plurality of entity-attribute pairs base based on having a utility greater than a predetermined threshold.

### Claim 15 (depends on 14)

The computer program product of claim 14, the identifying correlations between the new attribute and existing attributes further comprising using the selected subset of the plurality of entity-attribute pairs to generate entity fact baskets for each of the selected subset, the fact baskets each comprising all of the attributes of a corresponding entity-attribute pair, the associating an attribute rule further comprising identifying individual existing attributes and combinations of existing attributes within the subset of entity-attribute pairs having confidence values greater than the predetermined threshold as rules.

### Claim 16 (depends on 11)

The computer program product of claim 11, the plurality of attribute rules comprising positive rules, indicating presence of the new attribute, and negative rules, indicating absence of the new attribute.

### Claim 17 (depends on 11)

The computer program product of claim 11, the identifying correlations between the new attribute and existing attributes being based on selected positive and negative entity-attribute training data, wherein the identifying the unstructured data comprises:
receiving a plurality of entity-attribute pairs provided by users, the entity-attribute pairs comprising an entity of the plurality of entities and either positive or negative presence of the new attribute, each entity of the entity-attribute pairs being further associated with unstructured data; and
based on the unstructured data of the entity-attribute pairs, identifying correlations between features of the unstructured data of the entity-attribute pairs and both presence and absence of the new attribute, the identified unstructured data comprising unstructured data of the entity-attribute pairs having a prediction probability exceeding a second predetermined threshold.

### Claim 18 (depends on 17)

The computer program product of claim 17, the identifying the unstructured data further comprising receiving additional entity-attribute pairs from the rule-based model, the additional entity-attribute pairs comprising entities identified using the plurality of attribute rules as having the new attribute, and identifying additional correlations between features of unstructured data associated with each of the additional entity-attribute pairs, the identified unstructured data further comprising unstructured data of the additional entity-attribute pairs having a prediction probability exceeding the second predetermined threshold.

### Claim 19 (depends on 11)

The computer program product of claim 11, wherein the identified unstructured data is interpreted as a virtual rule by the meta learner model such that the weights for each attribute rule and each virtual rule are applied based on the confidences associated with each attribute rule and each associated identified unstructured data.

### Claim 20 (depends on 11)

The computer program product of claim 11, further comprising instructions to:
express the plurality of attribute rules as constraints on Boolean decision variables for entity existing attributes; and
identify embeddings for entities identified using the plurality of attribute rules.
