Method and system for diacritizing Arabic text

A system comprising:

• a processor;
• and
• a memory storing instructions which, when executed by the processor, cause the processor to:
• (A) receive a source sentence;
• (B) convert the source sentence into a word sequence, wherein the word sequence comprises a plurality of words including a target source word;
• (C) overlay a context window at a first position within the word sequence to select a first subset of the word sequence contained within the context window at the first position, wherein the first subset of the word sequence contains the target source word;
• (D) generate a first diacritized form of the target source word based on the first subset of the word sequence;
• (E) translate the context window to a second position within the word sequence to select a second subset of the word sequence contained within the context window at the second position, wherein the second subset of the word sequence contains the target source word;
• (F) generate a second diacritized form of the target source word in the second subset of the word sequence;
• (G) repeat steps (E) through (F) to generate a plurality of diacritized forms of the target source word;
• and
• (H) select a final diacritized form of the target source word from the plurality of diacritized forms of the target source word according to a voting scheme, wherein the context window is a varying number of words in length and the voting scheme weights each diacritized form of the plurality of diacritized forms based on a given length of the context window used to generate a corresponding diacritized form.

A non-transitory, computer-readable medium storing instructions which, when performed by a processor, cause the processor to:

• (A) receive a source sentence;
• (B) convert the source sentence into a word sequence, wherein the word sequence comprises a plurality of words including a target source word;
• (C) overlay a context window at a first position within the word sequence to select a first subset of the word sequence contained within the context window at the first position, wherein the first subset of the word sequence contains the target source word;
• (D) generate a first diacritized form of the target source word based on the first subset of the word sequence;
• (E) translate the context window to a second position within the word sequence to select a second subset of the word sequence contained within the context window at the second position, wherein the second subset of the word sequence contains the target source word;
• (F) generate a second diacritized form of the target source word in the second subset of the word sequence;
• (G) repeat steps (E) through (F) to generate a plurality of diacritized forms of the target source word;
• and
• (H) select a final diacritized form of the target source word from the plurality of diacritized forms of the target source word according to a voting scheme, wherein the context window is a varying number of words in length and the voting scheme weights each diacritized form of the plurality of diacritized forms based on a given length of the context window used to generate a corresponding diacritized form.