Methods and systems for detecting the alphabetic order used by different languages
AssigneeInternational Business Machines Corporation
InventorsMark Davis, Vladimir Weinstein
Life of this patent
Estimating the term…
Abstract
Embodiments of the present invention can gather data from native language sources to produce a valid collation sequence that is appropriate for a particular language and application. Sequences of characters in this data are tested to determine strength levels used by the given language. The data is also recursively probed with other sequences to test for contractions and identify expansions. Sequences in the data may then be compared against a known or predetermined sequence to generate a set of sorting rules that is specific to the language and application. The rules are formatted to replicate the sorting order found in the data.
Claims26
A method for determining a set of rules for ordering text of a language, said method comprising:
- receiving information that indicates a target order of sets of characters in text of a language;
- determining strengths of differences between the characters based on the target order;
- identifying strings of characters that were sorted in the target order as a shorter string of characters;
- identifying strings of characters that were sorted in the target order as a longer string of characters;
- and
- determining a set of rules for ordering text of the language based on the strengths of differences between the characters, the identified strings of characters that were sorted in the target order as a shorter string, and the identified strings of characters that were sorted in the target order as a longer string.
An apparatus for determining a set of rules for ordering text of a language, said apparatus comprising:
- means for receiving information that indicates a target order of sets of characters in text of a language;
- means for determining strengths of differences between the characters based on the target order;
- means for identifying strings of characters that were sorted in the target order as a shorter string of characters;
- means for identifying strings of characters that were sorted in the target order as a longer string of characters;
- and
- means for determining a set of rules for ordering text of the language based on the strengths of differences between the characters, the identified strings of characters that were sorted in the target order as a shorter string, and the identified strings of characters that were sorted in the target order as a longer string.
A system that is configured to determine a set of rules for ordering text of a language, said system comprising:
- an interface configured to receive information that indicates a target order of sets of characters in text of a language;
- and
- a processor configured by program code to determine strengths of differences between the characters based on the target order, identify strings of characters that were sorted in the target order as a shorter string of characters, identify strings of characters that were sorted in the target order as a longer string of characters, determine a set of rules for ordering text of the language based on the strengths of differences between the characters, the identified strings of characters that were sorted in the target order as a shorter string, and the identified strings of characters that were sorted in the target order as a longer string.
The system of 18, wherein the processor determines the set of probing characters based on program code for determining at least one character that has a primary difference that is greater than or equal to all characters in the group of characters.
Dependencies are inferred from the claim text.