# US 2022/0277144 A1 · Word embedding vector integration device, word embedding vector integration method, and word embedding vector integration program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0277144 A1
- Document ID: US20220277144A1
- Status: Published application
- Kind: A1
- Application number: 17/620,680
- Filed: 2020-06-15
- Published: 2022-09-01
- Earliest claimed: 2019-06-19
- Assignees: Nippon Telegraph and Telephone Corporation
- Applicants: Nippon Telegraph and Telephone Corporation
- Inventors: Tsutomu HIRAO; Masaaki NAGATA; Katsuhiko HAYASHI
- Web page: https://patentgrep.com/patent/US20220277144A1

## CPC

- G06F 40/30: Semantic analysis
- G06F 16/36: Creation of semantic tools, e.g. ontology or thesauri
- G06F 40/216: using statistical methods
- G06F 40/279: Recognition of textual entities
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

To make it possible to efficiently learn word embedding vectors of respective words contained in two corpora. A basis vector correspondence determination unit 22 determines correspondence between basis vectors obtained from word embedding vectors of respective words generated from a corpus A and basis vectors obtained from word embedding vectors of respective words generated from a corpus B. Based on the determined correspondence, a word embedding vector integration unit 24 changes the word embedding vectors of the respective words contained in the corpus B so as to rearrange elements of the word embedding vectors of the respective words contained in the corpus B.

## Claims

### Claim 1

A word embedding vector integration apparatus comprising circuitry configured to execute a method comprising:
determining correspondence between basis vectors obtained from word embedding vectors of respective words generated from a first corpus and contained in the first corpus,
each of the basis vectors being made up of a value of a same element of the word embedding vectors of the respective words, and basis vectors obtained from word embedding vectors of respective words generated from a second corpus different from the first corpus and contained in the second corpus, each of the basis vectors being made up of a value of a same element of the word embedding vectors of the respective words, the correspondence being determined based on the word embedding vectors of the respective words contained in the first corpus and on the word embedding vectors of the respective words contained in the second corpus; and
changing the word embedding vectors of the respective words contained in the second corpus based on the determined correspondence so as to rearrange elements of the word embedding vectors of the respective words contained in the second corpus.

### Claim 2 (depends on 1)

The word embedding vector integration apparatus according to claim 1, wherein the first corpus and the second corpus differ from each other in language or domain.

### Claim 3 (depends on 1)

The word embedding vector integration apparatus according to claim 1, wherein by presenting words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the first corpus and words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the second corpus, and
the circuitry further configured to execute a method comprising: accepting input of the correspondence.

### Claim 4 (depends on 1)

The word embedding vector integration apparatus according to claim 1, the circuitry further configured to execute a method comprising, when there is any word common to the first corpus and the second corpus, using a mean vector of the word embedding vector of the word in the first corpus and the changed word embedding vector of the word in the second corpus as a word embedding vector of the word.

### Claim 5

A computer-implemented method for integrating a word embedding vector, comprising:
determining correspondence between basis vectors obtained from word embedding vectors of respective words generated from a first corpus and contained in the first corpus,
each of the basis vectors being made up of a value of a same element of the word embedding vectors of the respective words, and basis vectors obtained from word embedding vectors of respective words generated from a second corpus different from the first corpus and contained in the second corpus, each of the basis vectors being made up of a value of a same element of the word embedding vectors of the respective words, the correspondence being determined based on the word embedding vectors of the respective words contained in the first corpus and on the word embedding vectors of the respective words contained in the second corpus; and
changing the word embedding vectors of the respective words contained in the second corpus based on the determined correspondence so as to rearrange elements of the word embedding vectors of the respective words contained in the second corpus.

### Claim 6

A computer-readable non-transitory recording medium storing computer-executable program instructions that when executed by a processor cause a computer system to execute a method comprising:
determining correspondence between basis vectors obtained from word embedding vectors of respective words generated from a first corpus and contained in the first corpus,
each of the basis vectors being made up of a value of a same element of the word embedding vectors of the respective words, and basis vectors obtained from word embedding vectors of respective words generated from a second corpus different from the first corpus and contained in the second corpus, each of the basis vectors being made up of a value of a same element of the word embedding vectors of the respective words, the correspondence being determined based on the word embedding vectors of the respective words contained in the first corpus and on the word embedding vectors of the respective words contained in the second corpus; and
changing the word embedding vectors of the respective words contained in the second corpus based on the determined correspondence so as to rearrange elements of the word embedding vectors of the respective words contained in the second corpus.

### Claim 7 (depends on 2)

The word embedding vector integration apparatus according to claim 2, wherein by presenting words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the first corpus and words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the second corpus, and
the circuitry further configured to execute a method comprising: accepting input of the correspondence.

### Claim 8 (depends on 2)

The word embedding vector integration apparatus according to claim 2, the circuitry further configured to execute a method comprising:
when there is any word common to the first corpus and the second corpus, using a mean vector of the word embedding vector of the word in the first corpus and the changed word embedding vector of the word in the second corpus as a word embedding vector of the word.

### Claim 9 (depends on 3)

The word embedding vector integration apparatus according to claim 3, the circuitry further configured to execute a method comprising:
when there is any word common to the first corpus and the second corpus, using a mean vector of the word embedding vector of the word in the first corpus and the changed word embedding vector of the word in the second corpus as a word embedding vector of the word.

### Claim 10 (depends on 5)

The computer-implemented method according to claim 5, wherein the first corpus and the second corpus differ from each other in language or domain.

### Claim 11 (depends on 5)

The computer-implemented method according to claim 5, wherein by presenting words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the first corpus and words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the second corpus, and
the circuitry further configured to execute a method comprising: accepting input of the correspondence.

### Claim 12 (depends on 5)

The computer-implemented method according to claim 5, the method further comprising: when there is any word common to the first corpus and the second corpus, using a mean vector of the word embedding vector of the word in the first corpus and the changed word embedding vector of the word in the second corpus as a word embedding vector of the word.

### Claim 13 (depends on 6)

The computer-readable non-transitory recording medium according to claim 6, wherein the first corpus and the second corpus differ from each other in language or domain.

### Claim 14 (depends on 6)

The computer-readable non-transitory recording medium according to claim 6, wherein by presenting words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the first corpus and words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the second corpus, and
the circuitry further configured to execute a method comprising: accepting input of the correspondence.

### Claim 15 (depends on 6)

The computer-readable non-transitory recording medium according to claim 6, the circuitry further configured to execute a method comprising:
when there is any word common to the first corpus and the second corpus, using a mean vector of the word embedding vector of the word in the first corpus and the changed word embedding vector of the word in the second corpus as a word embedding vector of the word.

### Claim 16 (depends on 10)

The computer-implemented method according to claim 10,
wherein by presenting words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the first corpus and words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the second corpus, and
the method further comprising:
accepting input of the correspondence.

### Claim 17 (depends on 10)

The computer-implemented method according to claim 10, the method further comprising:
when there is any word common to the first corpus and the second corpus, using a mean vector of the word embedding vector of the word in the first corpus and the changed word embedding vector of the word in the second corpus as a word embedding vector of the word.

### Claim 18 (depends on 11)

The computer-implemented method according to claim 11, the method further comprising:
when there is any word common to the first corpus and the second corpus, using a mean vector of the word embedding vector of the word in the first corpus and the changed word embedding vector of the word in the second corpus as a word embedding vector of the word.

### Claim 19 (depends on 13)

The computer-readable non-transitory recording medium according to claim 13, wherein by presenting words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the first corpus and words related to the basis vectors corresponding to the word embedding vectors of the respective words contained in the second corpus, and
the circuitry further configured to execute a method comprising:
accepting input of the correspondence.

### Claim 20 (depends on 13)

The computer-readable non-transitory recording medium according to claim 13,
when there is any word common to the first corpus and the second corpus, using a mean vector of the word embedding vector of the word in the first corpus and the changed word embedding vector of the word in the second corpus as a word embedding vector of the word.
