Readability awareness in natural language processing systems
AssigneeInternational Business Machines Corporation
InventorsDonna K. Byron, Devendra Goyal, Lakshminarayanan Krishnamurthy, Priscilla Santos Moraes, Michael C. Smith
Life of this patent
Estimating the term…
Abstract
Electronic natural language processing in a natural language processing (NLP) system, such as a Question-Answering (QA) system. A receives electronic text input, in question form, and determines a readability level indicator in the question. The readability level indicator includes at least a grammatical error, a slang term, and a misspelling type. The computer determines a readability level for the electronic text input based on the readability level indicator, and retrieves candidate answers based on the readability level.
Claims18
A method for electronic natural language processing in an electronic natural language processing (NLP) system, comprising:
- receiving an electronic text input;
- determining a readability level indicator of the electronic text input, wherein the readability level indicator comprises at least one of a grammatical error, a slang term, and a misspelling type in the electronic text input;
- comparing the readability level indicator of the electronic text input with readability indicators of one or more questions in a corpus of questions;
- and
- determining a readability level of the electronic text input based on the readability level indicator and further based on readability levels of the one or more questions.
A computer system for electronic natural language processing, comprising:
- one or more computer devices each having one or more processors and one or more tangible storage devices;
- and
- a program embodied on at least one of the one or more storage devices, the program having a plurality of program instructions for execution by the one or more processors, the program instructions comprising instructions for:
- receiving an electronic text input;
- determining a readability level indicator of the electronic text input, wherein the readability level indicator comprises at least one of a grammatical error, a slang term, and a misspelling type in the electronic text input;
- comparing the readability level indicator of the electronic text input with readability indicators of one or more questions in a corpus of questions;
- and
- determining a readability level of the electronic text input based on the readability level indicator and further based on readability levels of the one or more questions.
A computer program product for electronic natural language processing, comprising a non-transitory tangible storage device having program code embodied therewith, the program code executable by a processor of a computer to perform a method, the method comprising:
- receiving an electronic text input, by the computer;
- determining, by the computer, a readability level indicator of the electronic text input, wherein the readability level indicator comprises at least one of a grammatical error, a slang term, and a misspelling type in the electronic text input;
- comparing, by the computer, the readability level indicator of the electronic text input with readability indicators of one or more questions in a corpus of questions;
- and
- determining, by the computer, a readability level of the electronic text input based on the readability level indicator and further based on readability levels of the one or more questions.
Dependencies are inferred from the claim text.