# US 2021/0240938 A1 · Neural network systems and methods for target identification from text > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0240938 A1 - Document ID: US20210240938A1 - Status: Published application - Kind: A1 - Application number: 17/235,386 - Filed: 2021-04-20 - Published: 2021-08-05 - Earliest claimed: 2019-06-27 - Assignees: Conduent Business Services, LLC - Applicants: Conduent Business Services, LLC - Inventors: Niraj KUMAR - Web page: https://patentgrep.com/patent/US20210240938A1 ## CPC - G06F 40/30: Semantic analysis - G06N 3/044: Recurrent networks, e.g. Hopfield networks - G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] - G06N 3/045: Combinations of networks - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/08: Learning methods - G06N 3/09: Supervised learning - G06N 3/048: Activation functions - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Neural network systems are provided that comprise one or more neural networks. The first neural network can comprise a convolutional neural network (CNN) long short-term memory (LSTM) architecture for receiving a primary data set comprising text messages and output a primary data structure comprising a text pattern-based feature. The second neural network can comprise a CNN architecture for receiving a secondary data sets derived from the primary data set and output a plurality of secondary data structures. The third neural network can combine the data structures to produce a combined data structure, and then process it to produce a categorized data structure comprising the text messages assigned to targets. The primary data set can comprise hate speech and the categorized data structure can comprise target categories, for example, hate targets. Methods of operating neural network systems and computer program products for performing such methods are also provided. ## Claims ### Claim 1 A method of operating a target identification system, the method comprising: receiving a primary data set comprising text messages; constructing a graph comprising nodes corresponding to words in the text messages and edges connecting nodes based on occurrence within a predetermined distance; identifying words biased by predetermined keywords in the graph to produce a first graph-based data set of a secondary data set; identifying words having a high load determined by a number of shortest path passes using a node corresponding to a word to produce a second graph-based data set of the secondary data set; identifying words having similarity to the predetermined keywords based on occurrence with the predetermined keywords within the predetermined distance to produce a semantic based data set of the secondary data set; and processing the primary data set and a plurality of secondary data sets using one or more neural networks to output a categorized data structure comprising the text messages assigned to targets. ### Claim 2 (depends on 1) The method of claim 1, wherein the text messages comprise language relating to hate, an event, a product, an individual, a hobby, music, a location, an activity, a health issue, a utility issue, a safety issue, a weather phenomenon, a complaint, or an emotion, or any combination thereof. ### Claim 3 (depends on 1) The method of claim 1, wherein the categorized data structure comprises a plurality of target categories. ### Claim 4 (depends on 3) The method of claim 3, wherein the target categories comprise hate targets, events, products, individuals, hobbies, music genres, songs, locations, activities, health issues, utility issues, safety issues, weather phenomena, complaints, or emotions, or any combination thereof. ### Claim 5 (depends on 1) The method of claim 1, wherein: the text messages comprise language relating to hate, an event, a product, an individual, a hobby, music, a location, an activity, a health issue, a utility issue, a safety issue, a weather phenomenon, a complaint, or an emotion, or any combination thereof; the categorized data structure comprises a plurality of target categories; and the target categories comprise hate targets, events, products, individuals, hobbies, music genres, songs, locations, activities, health issues, utility issues, safety issues, weather phenomena, complaints, or emotions, or any combination thereof. ### Claim 6 (depends on 1) The method of claim 1, further comprising ranking the nodes based on an effect of a bias to produce the first graph-based data set. ### Claim 7 (depends on 6) The method of claim 6, wherein the bias is based on a predetermined lexicon comprising the predetermined keywords. ### Claim 8 (depends on 1) The method of claim 1, further comprising determining loads for the nodes based on the number of shortest path passes through each node. ### Claim 9 (depends on 8) The method of claim 8, further comprising weighing the loads to produce the second graph-based data set. ### Claim 10 (depends on 1) The method of claim 1, wherein the targets comprise hate targets. ### Claim 11 (depends on 10) The method of claim 10, wherein the hate targets comprise race, religion, ethnic origin, national origin, biological sex, disability, sexual orientation, or gender identity, or any combination thereof. ### Claim 12 (depends on 1) The method of claim 1, wherein the one or more neural networks comprise a convolutional neural network (CNN) having a long short-term memory (LSTM) architecture, a CNN, or a deep neural network (DNN), or any combination thereof. ### Claim 13 (depends on 1) The method of claim 1, wherein the one or more neural networks comprise at least three neural networks. ### Claim 14 (depends on 1) The method of claim 1, wherein the one or more neural networks comprise: a first neural network configured to receive the primary data set and output a primary data structure; and a second neural network configured to receive the plurality of secondary data sets and output a plurality of secondary data structures. ### Claim 15 (depends on 14) The method of claim 14, wherein the one or more neural networks further comprise a third data structure configured to: combine the primary data structure and the plurality of second data structures to produce a combined data structure; and process the combined data structure to produce the categorized data structure. ### Claim 16 A target identification system comprising: a computer readable medium comprising instructions to: receive a primary data set comprising text messages, construct a graph comprising nodes corresponding to words in the text messages and edges connecting nodes based on occurrence within a predetermined distance, identify words biased by predetermined keywords in the graph to produce a first graph-based data set of a secondary data set, identify words having a high load determined by a number of shortest path passes using a node corresponding to a word to produce a second graph-based data set of the secondary data set, identify words having similarity to the predetermined keywords based on occurrence with the predetermined keywords within the predetermined distance to produce a semantic based data set of the secondary data set, and process the primary data set and a plurality of secondary data sets using one or more neural networks to output a categorized data structure comprising the text messages assigned to targets; and a processor configured to perform the instructions. ### Claim 17 (depends on 16) The system of claim 16, wherein the one or more neural networks comprise a convolutional neural network (CNN) having a long short-term memory (LSTM) architecture, a CNN, or a deep neural network (DNN), or any combination thereof. ### Claim 18 (depends on 16) The system of claim 16, wherein the one or more neural networks comprise: a first neural network configured to receive the primary data set and output a primary data structure; and a second neural network configured to receive the plurality of secondary data sets and output a plurality of secondary data structures. ### Claim 19 (depends on 18) The system of claim 18, wherein the one or more neural networks further comprise a third data structure configured to: combine the primary data structure and the plurality of second data structures to produce a combined data structure; and process the combined data structure to produce the categorized data structure. ### Claim 20 A computer program product comprising a non-transitory computer readable medium, wherein the non-transitory computer readable medium stores a computer program code for operating a neural network system, wherein the computer program code is executable by one or more processors of an application server of the system to: receive a primary data set comprising text messages; construct a graph comprising nodes corresponding to words in the text messages and edges connecting nodes based on occurrence within a predetermined distance; identify words biased by predetermined keywords in the graph to produce a first graph-based data set of a secondary data set; identify words having a high load determined by a number of shortest path passes using a node corresponding to a word to produce a second graph-based data set of the secondary data set; identify words having similarity to the predetermined keywords based on occurrence with the predetermined keywords within the predetermined distance to produce a semantic based data set of the secondary data set; process the primary data set and a plurality of secondary data sets using one or more neural networks to output a categorized data structure comprising the text messages assigned to targets.