Toxic vector mapping across languages
AssigneeSpectrum Labs, Inc.
InventorsJonathan Thomas Purnell, Josh Newman, Indrajit Haridas, Alex Greene, Yacov Salomon
Life of this patent
Estimating the term…
Loading patent…
AssigneeSpectrum Labs, Inc.
InventorsJonathan Thomas Purnell, Josh Newman, Indrajit Haridas, Alex Greene, Yacov Salomon
Estimating the term…
Methods, systems, and devices for language mapping are described. Some machine learning models may be trained to support multiple languages. However, word embedding alignments may be too general to accurately capture the meaning of certain words when mapping different languages into a single reference vector space. To improve the accuracy of vector mapping, a system may implement a supervised learning layer to refine the cross-lingual alignment of particular vectors corresponding to a vocabulary of interest (e.g., toxic language). This supervised learning layer may be trained using a dictionary of toxic words or phrases across the different supported languages in order to learn how to weight an initial vector alignment to more accurately map the meanings behind insults, threats, or other toxic words or phrases between languages. The vector output from this weighted mapping can be sent to supervised models, trained on the reference vector space, to determine toxicity scores.
A method for language mapping on a server, comprising:
An apparatus for language mapping on a server, comprising:
A non-transitory computer-readable medium storing code for language mapping on a server, the code comprising instructions executable by a processor to:
Dependencies are inferred from the claim text.