Learning device, extraction device, and learning method
AssigneeNippon Telegraph and Telephone Corporation
InventorTakeshi Yamada
Life of this patent
Estimating the term…
Abstract
An extraction apparatus (10) includes: a pre-processing unit (141) configured to perform, on training data that is written in a natural language and is obtained by tagging important description portions, pre-processing for calculating pointwise mutual information indicating a degree of relevance to a tag for each word, and for deleting description portions with low relevance to the tag from the training data based on the pointwise mutual information of each word; and a learning unit (142) configured to learn the pre-processed training data and generate a list of conditional probabilities relating to the tagged description portions.
Claims12
A learning apparatus comprising:
- a pre-processing unit, including one or more processors, configured to perform, on training data that is data described in natural language and in which a tag has been provided to a description portion in advance, pre-processing for calculating pointwise mutual information that indicates a degree of relevance to the tag for each word and deleting a description portion with low relevance to the tag from the training data based on the pointwise mutual information of each word;
- and
- a learning unit including one or more processors, configured to learn the pre-processed training data and generate a list of conditional probabilities relating to the tagged description portion.
An extraction apparatus comprising:
- a pre-processing unit, including one or more processors, configured to perform, on training data that is data described in natural language and in which a tag has been provided to a description portion in advance, pre-processing for calculating pointwise mutual information that indicates a degree of relevance to the tag for each word and deleting a description portion with low relevance to the tag from the training data based on the pointwise mutual information of each word;
- a learning unit including one or more processors, configured to learn the pre-processed training data and generate a list of conditional probabilities relating to the tagged description portion;
- a tagging unit including one or more processors, configured to tag description content of test data based on the list of conditional probabilities;
- and
- an extraction unit including one or more processors, configured to extract a test item from the tagged description content of the test data.
A learning method to be executed by a learning apparatus, the learning method comprising:
- a pre-processing step of performing, on training data that is data described in natural language and in which a tag has been provided to a description portion in advance, pre-processing for calculating pointwise mutual information that indicates a degree of relevance to the tag for each word and deleting a description portion with low relevance to the tag from the training data based on the pointwise mutual information of each word;
- and
- a learning step of learning the pre-processed training data and generating a list of conditional probabilities relating to the tagged description portion.
Dependencies are inferred from the claim text.