Machine learning approach to cross-language translation and search

A system comprising:

• one or more processors;
• and
• one or more machine-readable storage media having instructions stored thereon that, in response to being executed by the one or more processors, cause the system to perform operations comprising:
• in response to receiving an input symbol, retrieving an index file from a server, wherein the index file includes a plurality of work tokens;
• determining, by a preprocessing module, a frequency of each word token included in the index file;
• calculating, by the preprocessing module, respective frequency scores based on the determining;
• identifying, by the preprocessing module, important word tokens based in part of the frequency scores;
• and
• determining, a match between the received input symbol and the one or more word tokens, wherein the determining includes using an elimination criteria and the important word tokens.

A method comprising:

• in response to receiving an input symbol, retrieving an index file from a server, wherein the index file includes a plurality of word tokens;
• determining, by a preprocessing module, a frequency of each word token included in the index file;
• calculating, by the preprocessing module, respective frequency scores based on the determining;
• identifying, by the preprocessing module, important word tokens based in part of the frequency scores;
• and
• determining, a match between the received input symbol and the one or more word tokens, wherein the determining includes using an elimination criteria and the important word tokens.

A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause a machine to perform operations comprising:

• in response to receiving an input symbol, retrieving an index file from a server, wherein the index file includes a plurality of work tokens;
• determining, by a preprocessing module, a frequency of each word token included in the index file;
• calculating, by the preprocessing module, respective frequency scores based on the determining;
• identifying, by the preprocessing module, important word tokens based in part of the frequency scores;
• and
• determining, a match between the received input symbol and the one or more word tokens, wherein the determining includes using an elimination criteria and the important word tokens.