# US 12,015,585 B2 · System and method for detection, translation, and categorization of visual content associated with malicious electronic communication > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,015,585 B2 - Document ID: US12015585B2 - Status: Granted - Kind: B2 - Application number: 18/140,871 - Filed: 2023-04-28 - Published: 2023-11-02 - Granted: 2024-06-18 - Earliest claimed: 2022-04-29 - Assignees: Bank of America Corporation - Applicants: Bank of America Corporation - Inventors: Michael Robert Young - Web page: https://patentgrep.com/patent/US12015585B2 ## CPC - H04L 51/212: using filtering or selective blocking - H04L 51/23: Reliability checks, e.g. acknowledgments or fault reporting - H04L 51/07: characterised by the inclusion of specific contents - H04L 51/52: for supporting social networking services - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Embodiments of the present invention provide a system for detecting, translating, and categorizing visual content associated with malicious electronic communication. The system is configured for establishing a communication link with one or more third party systems, continuously monitoring one or more electronic communications associated with the one or more third party systems, detecting at least one electronic communication from the one or more electronic communications that meets one or more triggers, analyzing the at least one electronic communication to translate the at least one electronic communication to text, and categorizing the at least one electronic communication based on the text associated with the at least one electronic communication. ## Claims ### Claim 1 A system for detecting, translating, and categorizing visual content associated with malicious electronic communication, the system comprising: at least one network communication interface; at least one non-transitory storage device; and at least one processing device coupled to the at least one non-transitory storage device and the at least one network communication interface, wherein the at least one processing device is configured to: establish a communication link with one or more third party systems; continuously monitor one or more electronic communications associated with the one or more third party systems; detect at least one electronic communication from the one or more electronic communications that meets one or more triggers, wherein the one or more triggers comprise identification of at least one of an entity name, entity logo, currency logo, currency images, and one or more predefined phrases; analyze the at least one electronic communication to translate the at least one electronic communication to text, via optical character recognition and natural language processing; and categorize the at least one electronic communication based on the text associated with the at least one electronic communication, wherein categorizing the at least one electronic communication comprises assigning one or more exposure tags to the at least one electronic communication, wherein the one or more exposure tags comprise low exposure tag, medium exposure tag, and high exposure tag. ### Claim 2 (depends on 1) The system of claim 1, wherein the at least one processing device is configured to: perform one or more remediation actions based on assigning the at least one electronic communication the low exposure tag, the medium exposure tag, or the high exposure tag. ### Claim 3 (depends on 2) The system of claim 2, wherein the one or more remediation actions comprise at least one of: automatically deleting the at least one electronic communication; notifying the one or more third party systems; notifying one or more users associated with an entity, wherein the one or more users are users who viewed the at least one electronic communication or will review the at least one electronic communication in the future; and notifying one or more other entities. ### Claim 4 (depends on 1) The system of claim 1, wherein the at least one processing device is configured to categorize the at least one electronic communication based on analyzing the text. ### Claim 5 (depends on 1) The system of claim 1, wherein the one or more third party systems comprise at least one of social media systems, non-indexed internet system, open web system, and user device messaging system. ### Claim 6 (depends on 1) The system of claim 1, wherein the at least one electronic communication is visual content. ### Claim 7 A computer program product for detecting, translating, and categorizing visual content associated with malicious electronic communication, the computer program product comprising a non-transitory computer-readable storage medium having computer executable instructions for causing a computer processor to perform the steps of: establishing a communication link with one or more third party systems; continuously monitoring one or more electronic communications associated with the one or more third party systems; detecting at least one electronic communication from the one or more electronic communications that meets one or more triggers, wherein the one or more triggers comprise identification of at least one of an entity name, entity logo, currency logo, currency images, and one or more predefined phrases; analyzing the at least one electronic communication to translate the at least one electronic communication to text, via optical character recognition and natural language processing; and categorizing the at least one electronic communication based on the text associated with the at least one electronic communication, wherein categorizing the at least one electronic communication comprises assigning one or more exposure tags to the at least one electronic communication, wherein the one or more exposure tags comprise low exposure tag, medium exposure tag, and high exposure tag. ### Claim 8 (depends on 7) The computer program product of claim 7, wherein the computer executable instructions cause the computer processor to perform the steps of performing one or more remediation actions based on assigning the at least one electronic communication the low exposure tag, the medium exposure tag, or the high exposure tag. ### Claim 9 (depends on 8) The computer program product of claim 8, wherein the one or more remediation actions comprise at least one of: automatically deleting the at least one electronic communication; notifying the one or more third party systems; notifying one or more users associated with an entity, wherein the one or more users are users who viewed the at least one electronic communication or will review the at least one electronic communication in the future; and notifying one or more other entities. ### Claim 10 (depends on 7) The computer program product of claim 7, wherein the computer executable instructions cause the computer processor to perform the step of categorizing the at least one electronic communication based on analyzing the text. ### Claim 11 (depends on 7) The computer program product of claim 7, wherein the one or more third party systems comprise at least one of social media systems, non-indexed internet system, open web system, and user device messaging system. ### Claim 12 (depends on 7) The computer program product of claim 7, wherein the at least one electronic communication is visual content. ### Claim 13 A computer implemented method for detecting, translating, and categorizing visual content associated with malicious electronic communication, wherein the method comprises: establishing a communication link with one or more third party systems; continuously monitoring one or more electronic communications associated with the one or more third party systems; detecting at least one electronic communication from the one or more electronic communications that meets one or more triggers, wherein the one or more triggers comprise identification of at least one of an entity name, entity logo, currency logo, currency images, and one or more predefined phrases; analyzing the at least one electronic communication to translate the at least one electronic communication to text, via optical character recognition and natural language processing; and categorizing the at least one electronic communication based on the text associated with the at least one electronic communication, wherein categorizing the at least one electronic communication comprises assigning one or more exposure tags to the at least one electronic communication, wherein the one or more exposure tags comprise low exposure tag, medium exposure tag, and high exposure tag. ### Claim 14 (depends on 13) The computer implemented method of claim 13, wherein the method further comprises performing one or more remediation actions based on assigning the at least one electronic communication the low exposure tag, the medium exposure tag, or the high exposure tag. ### Claim 15 (depends on 14) The computer implemented method of claim 14, wherein the one or more remediation actions comprise at least one of: automatically deleting the at least one electronic communication; notifying the one or more third party systems; notifying one or more users associated with an entity, wherein the one or more users are users who viewed the at least one electronic communication or will review the at least one electronic communication in the future; and notifying one or more other entities. ### Claim 16 (depends on 13) The computer implemented method of claim 13, wherein categorizing the at least one electronic communication is based on analyzing the text. ### Claim 17 (depends on 13) The computer implemented method of claim 13, wherein the one or more third party systems comprise at least one of social media systems, non-indexed internet system, open web system, and user device messaging system.