# US 2023/0067688 A1 · Knowledge base with type discovery

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0067688 A1
- Document ID: US20230067688A1
- Status: Published application
- Kind: A1
- Application number: 17/460,123
- Filed: 2021-08-27
- Published: 2023-03-02
- Earliest claimed: 2021-08-27
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Elena POCHERNINA; John WINN; Matteo VENANZI; Ivan KOROSTELEV; Pavel MYSHKOV; Samuel Alexander WEBSTER; Yordan Kirilov ZAYKOV; Nikita VORONKOV; Dmitriy MEYERZON; Marius Alexandru BUNESCU; Alexander Armin SPENGLER; Vladimir GVOZDEV; Thomas P. MINKA; Anthony Arnold WIESER; Sanil RAJPUT
- Web page: https://patentgrep.com/patent/US20230067688A1

## CPC

- G06N 5/02: Knowledge representation; Symbolic representation
- G06N 5/022: Knowledge engineering; Knowledge acquisition
- G06F 16/3344: {using natural language analysis}
- G06F 16/367: {Ontology}
- G06F 40/186: Templates
- G06N 3/045: Combinations of networks
- G06N 3/0475: Generative networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In various examples there is a computer-implemented method of database construction. The method comprises storing a knowledge graph comprising nodes connected by edges, each node representing a topic. Accessing a topic type hierarchy comprising a plurality of types of topics, the topic type hierarchy having been computed from a corpus of text documents. One or more text documents are accessed and the method involves labelling a plurality of the nodes with one or more labels, each label denoting a topic type from the topic type hierarchy, by, using a deep language model; or for an individual one of the nodes representing a given topic, searching the accessed text documents for matches to at least one template, the template being a sequence of words and containing the given topic and a placeholder for a topic type; and storing the knowledge graph comprising the plurality of labelled nodes.

## Claims

### Claim 1

A computer-implemented method of database construction comprising:
storing a knowledge graph comprising nodes connected by edges, each node representing a topic;
accessing a topic type hierarchy comprising a plurality of types of topics, the topic type hierarchy having been computed from a corpus of text documents;
accessing one or more text documents;
labelling a plurality of the nodes with one or more labels, each label denoting a topic type from the topic type hierarchy, by,
using a deep language model; or
for an individual one of the nodes representing a given topic,
searching the accessed text documents for matches to at least one template, the template being a sequence of words and containing the given topic and a placeholder for a topic type; and
storing the knowledge graph comprising the plurality of labelled nodes.

### Claim 2 (depends on 1)

The method of claim 1 comprising receiving a query comprising a topic, searching the knowledge graph to identify nodes representing topics similar to the query, outputting a topic of at least one of the identified nodes, and outputting a topic type of the at least one identified node.

### Claim 3 (depends on 2)

The method of claim 2 comprising receiving a selection of a topic type and filtering the identified nodes to include only the identified nodes having the selected topic type.

### Claim 4 (depends on 1)

The method of claim 1 comprising receiving a query comprising a topic type, searching the knowledge graph to identify nodes having topic type labels corresponding to the topic type of the query, outputting topics of the identified nodes.

### Claim 5 (depends on 1)

The method of claim 1 comprising receiving a query comprising a topic, searching the knowledge graph to identify nodes within a specified number of hops away from a node representing the topic of the query, outputting a topic of at least one of the identified nodes and outputting a topic type of the at least one identified node.

### Claim 6 (depends on 5)

The method of claim 5 comprising filtering the identified nodes to include only the identified nodes having a same topic type as a topic type of the query topic, and outputting the topics of the filtered identified nodes.

### Claim 7 (depends on 1)

The method of claim 1 comprising computing the types of the topic type hierarchy from a corpus of text documents and using a plurality of seed types.

### Claim 8 (depends on 7)

The method of claim 7 comprising: searching for topics in the corpus of text documents to identify topics having one of the seed types.

### Claim 9 (depends on 8)

The method of claim 8 comprising: for each identified topic, searching text near to the identified topic for matches to the at least one template, and when a template match is found which fills the placeholder for topic type, outputting the contents of the placeholder as a candidate topic type.

### Claim 10 (depends on 9)

The method of claim 9 comprising filtering the candidate topic types to retain a specified number of most frequently occurring candidate topic types.

### Claim 11 (depends on 10)

The method of claim 10 comprising using the retained candidate topic types as seed types and repeating the process of searching for topics in the same corpus of text documents to identify topics having one of the seed types, and for each identified topic, searching text near to the identified topic for matches to the at least one template, and when a template match is found which fills the placeholder for topic type, outputting the contents of the placeholder as a candidate topic type.

### Claim 12 (depends on 10)

The method of claim 10 comprising using the retained candidate topic types as seed types and repeating the process of searching for topics in a different corpus of text documents to identify topics having one of the seed types, and for each identified topic, searching text near to the identified topic for matches to the at least one template, and when a template match is found which fills the placeholder for topic type, outputting the contents of the placeholder as a candidate topic type.

### Claim 13 (depends on 12)

The method of claim 12 comprising selecting a top n of the candidate topic types ranked by confidence.

### Claim 14 (depends on 13)

The method of claim 13 comprising forming a hierarchy of topic types from the ranked candidate topic types and storing the hierarchy.

### Claim 15

A database construction apparatus comprising:
at least one processor;
a memory (712) storing instructions that, when executed by the at least one processor (714), perform a method for:
storing a knowledge graph comprising nodes connected by edges, each node representing a topic;
accessing a topic type hierarchy comprising a plurality of types of topics, the topic type hierarchy having been computed automatically from a corpus of text documents;
accessing one or more text documents;
labelling a plurality of the nodes with one or more labels, each label denoting a topic type from the topic type hierarchy, by,
using a deep language model; or
for an individual one of the nodes representing a given topic,
searching the accessed text documents for matches to at least one template, the template being a sequence of words and containing the given topic and a placeholder for a topic type; and
storing the knowledge graph comprising the plurality of labelled nodes.

### Claim 16 (depends on 15)

The database construction apparatus of claim 15 wherein accessing the one or more text documents comprises accessing document from the corpus.

### Claim 17 (depends on 15)

The database construction apparatus of claim 15 wherein an individual one of the nodes has two or more labels.

### Claim 18 (depends on 15)

The database construction apparatus of claim 15 wherein the instructions are for receiving a query comprising a topic type, searching the knowledge graph to identify nodes having topic type labels corresponding to the topic type of the query, and outputting topics of the identified nodes.

### Claim 19 (depends on 15)

The database construction apparatus of claim 15 wherein the instructions are for receiving a query comprising a topic, searching the knowledge graph to identify nodes within a specified number of hops away from a node representing the topic of the query, outputting a topic of at least one of the identified nodes and outputting a topic type of the at least one identified node.

### Claim 20

A database construction apparatus comprising:
at least one processor;
a memory storing instructions that, when executed by the at least one processor, perform a method for:
storing a knowledge graph comprising nodes connected by edges, each node representing a topic and where a plurality of the nodes are labelled with labels denoting a topic type from a plurality of specified topic types;
wherein the nodes have been labelled, by,
using a deep language model; or
for an individual one of the nodes representing a given topic,
searching text documents for matches to at least one template, the template being a sequence of words and containing the given topic and a placeholder for a topic type of the plurality of specified topic types.
