Comparing text based documents
AssigneeCurtin University of Technology
InventorsRobert Francis Williams, Heinz Dreher
Life of this patent
Estimating the term…
Abstract
Text based documents are compared by lexically normalising each word of the text of a first document (104) to form a first normalised representation. A vector representation of the first document is built (206) from the first normalised representation. Each word of the text of a second document (110) is lexically normalised to form a second normalised representation. A vector representation of the second document is built (204) from the second normalised representation. The alignment of the vector representations is compared (210) to produce a score (218) of the similarity of the second document to the first document.
Claims61
A method of comparing text based documents comprising:
- lexically normalising each word of the text of a first document to form a first normalised representation;
- building a vector representation of the first document from the first normalised representation;
- lexically normalising each word of the text of a second document to form a second normalised representation;
- building a vector representation of the second document from the second normalised representation;
- comparing the alignment of the vector representations to produce a score of the similarity of the second document to the first document.
A system for comparing text based documents comprising:
- means for lexically normalising each word of the text of a first document to form a first normalised representation;
- means for building a vector representation of the first document from the first normalised representation;
- means for lexically normalising each word of the text of a second document to form a second normalised representation;
- means for building a vector representation of the second document from the second normalised representation;
- means for lexically normalising the text of a first document;
- means for comparing the alignment of the vector representations to produce a score of the similarity of the second document to the first document.
A method of comparing text based documents comprising:
- partitioning words of a first document into noun phrases and verb clauses;
- partitioning words of a second document into noun phrases and verb clauses;
- comparing the partitioning of the first document to the second document to produce a score of the similarity of the second document to the first document.
A system for comparing text based documents comprising:
- means for partitioning words of a first document into noun phrases and verb clauses;
- means for partitioning words of a second document into noun phrases and verb clauses;
- means for comparing the partitioning of the first document to the second document to produce a score of the similarity of the second document to the first document.
A method of comparing text based documents comprising:
- lexically normalising each word of the text of a first document to form a first normalised representation;
- determining the number of root concepts in the first document from the first normalised representation;
- lexically normalising each word of the text of a second document to form a second normalised representation;
- determining the number of root concepts in the second document from the second normalised representation;
- comparing the number of root concepts in the first document to the number of root concepts in the second document to produce a score of the similarity of the second document to the first document.
A system for comparing text based documents comprising:
- means for lexically normalising each word of the text of a first document to form a first normalised representation;
- means for determining the number of root concepts in the first document from the first normalised representation;
- means for lexically normalising each word of the text of a second document to form a second normalised representation;
- means for determining the number of root concepts in the second document from the second normalised representation;
- means for comparing the number of root concepts in the first document to the number of root concepts in the second document to produce a score of the similarity of the second document to the first document.
A method of grading a text based essay document comprising:
- providing a model answer;
- providing a plurality of hand marked essays;
- providing a plurality of essays to be graded;
- providing an equation for grading essays, wherein the equation has a plurality of measures with each measure having a coefficient, the equation producing a score of the essay being calculated by summing each measure as modified by its respective coefficient, each measure being determined by comparing each essay to be graded with the model essay;
- determining the coefficients from the hand marked essays;
- applying the equation to each essay to be graded to produce a score for each essay.
A system for grading a text based essay document comprising:
- means for determining coefficients in an equation from a plurality of hand marked essays, wherein the equation is for grading an essay to be marked, the equation comprising a plurality of measures with each measure having one of the coefficients, the equation producing a score for the essay which is calculated by summing each measure as modified by its respective coefficient,
- means for determining each measure by comparing each essay to be graded with the model essay;
- means for applying the equation to each essay to be graded to produce a score for each essay from the determined coefficients and determined measures.
A method of providing visual feedback on an essay grade comprising:
- displaying a count of each root concept in the graded essay and a count of each root concepts expected in the answer based on a model essay.
A system for providing visual feedback on an essay grading comprising:
- means for displaying a count of each root concept in the graded essay and a count of each root concepts expected in the answer.
A method of numerically representing a document comprising:
- lexically normalising each word of the document;
- partitioning the normalised words of the document into parts, which each part designates as one of a noun phrase or a verb clause.
A system for numerically representing a document comprising:
- means for lexically normalising each word of the document;
- means for partitioning the normalised words of the document into parts, which each part designates as one of a noun phrase or a verb clause.
60-71. (canceled)
A method of comparing text based documents comprising:
- partitioning words of a first document into noun phrases and verb clauses;
- partitioning words of a second document into noun phrases and verb clauses;
- comparing the partitioning of the first document to the second document to produce a score of the similarity of the second document to the first document.
Dependencies are inferred from the claim text.