Text, character encoding and language recognition
AssigneeClearswift Limited
InventorsKevin Schofield, Istvan Biro
Life of this patent
Estimating the term…
Loading patent…
AssigneeClearswift Limited
InventorsKevin Schofield, Istvan Biro
Estimating the term…
A method is disclosed, for recognizing whether some electronic data is the digital representation of a piece of text and, if so, in which character encoding it has been encoded. A fingerprint is constructed from the data, wherein the fingerprint comprises, for each of a plurality of predetermined character encoding schemes, at least one confidence value, representing a confidence that the data was encoded using said character encoding scheme. The fingerprint also comprises a frequency value for each of a subset of byte values, each frequency value representing the frequency of occurrence of a respective byte value in the data. A statistical classification of the data is then performed based on the fingerprint.
A method for classifying data, the method comprising:
A computer program product, comprising computer readable code, suitable for causing a computer to perform a method for classifying data, the computer program product comprising:
Dependencies are inferred from the claim text.