# US 10,482,280 B2 · Structured text and pattern matching for data loss prevention in object-specific image domain > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,280 B2 - Document ID: US10482280B2 - Status: Granted - Kind: B2 - Application number: 15/419,756 - Filed: 2017-01-30 - Published: 2018-08-02 - Granted: 2019-11-19 - Earliest claimed: 2017-01-30 - Assignees: Symantec Corporation - Applicants: Symantec Corporation - Inventors: Ramzi Abi Antoun; Jinyu Zuo - Web page: https://patentgrep.com/patent/US10482280B2 ## CPC - G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes} - G06F 21/34: involving the use of external additional devices, e.g. dongles or smart cards - G06F 21/554: {involving event detection and direct action} - G06T 7/11: Region-based segmentation - G06V 30/413: Classification of content, e.g. text, photographs or tables - G06V 40/161: {Detection; Localisation; Normalisation} - H04L 63/1408: {by monitoring network traffic (monitoring network traffic per se H04L43/00)} - G06T 2207/10004: Still image; Photographic image - G06V 30/10: Character recognition - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Structured text and pattern matching may be performed for data loss prevention in object-specific image domain. According to some embodiments, a method may include receiving an image, identifying one or more objects in the image based on attributes of the one or more objects, and determining an object type of a first object of the one or more objects by a computing device. The method may include identifying, by the computing device, one or more specific regions of the first object for recognition based on the object type of the first object and recognizing text in the one or more specific regions of the first object. In some embodiments, the method may then include providing, by the computing device, the text recognized in the one or more specific regions of the first object to a security engine, wherein the security engine may be configured to evaluate whether the text comprises sensitive information. ## Claims ### Claim 1 A computer-implemented method comprising: receiving, by a computing device, an image; identifying, by the computing device, multiple physical objects represented in the image based on attributes of the multiple physical objects; determining, by the computing device, an object type of a first object of the multiple physical objects; determining, by the computing device, an object type of a second object of the multiple physical objects; identifying, by the computing device, one or more specific regions of the first object for recognition based on the object type of the first object; identifying, by the computing device, one or more specific regions of the second object for recognition based on the object type of the second object; responsive to identifying the one or more specific regions, recognizing, by the computing device, text in the one or more specific regions of the first object; recognizing, by the computing device, text in the one or more specific regions of the second object; providing, by the computing device, the text recognized in the one or more specific regions of the first object to a security engine, the security engine configured to evaluate whether the text comprises sensitive information; and providing, by the computing device, the text in the one or more specific regions of the second object to the security engine. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising: in response to the security engine determining that the text in the one or more specific regions of the first object does not comprise sensitive information, classifying, by the computing device, the first object as not including sensitive information. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, further comprising: determining, by the computing device, whether text is present in the one or more specific regions of the first object; and in response to determining that no text is present in the one or more specific regions, classifying the object as not including sensitive information. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein a location of each specific region of the one or more specific regions is determined based on a known layout of the object type. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein the security engine is further configured to determine whether the text comprises sensitive information based on the metadata tagged on the text. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, further comprising: determining that the image contains sensitive information based on the object type of the first object and the object type of the second object. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein it is determined that the image contains sensitive information responsive to the object type of the first object being a first particular type and the object type of the second object being a second, different particular object type. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, wherein the security engine evaluates whether the text comprises sensitive information by matching the text in the one or more specific regions of the first object against a database of defined sensitive information. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, further comprising: automatically blocking the image from being electronically transferred in response to the text recognized in the one or more specific regions of the first object being evaluated as including sensitive information. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, further comprising: automatically transmitting an electronic message to an administrator in response to the text recognized in the one or more specific regions of the first object being evaluated as including sensitive information. ### Claim 11 (depends on 1) The computer-implemented method of claim 1 comprising: adjusting a rotation or a perspective of the one or more specific regions using a determined rotation or perspective of the first object in order to facilitate text recognition within the one or more specific regions of the first object. ### Claim 12 (depends on 1) The computer-implemented method of claim 1, wherein the attributes comprise dimensions of the first object. ### Claim 13 (depends on 1) The computer-implemented method of claim 1, wherein the object type of the first object comprises a check. ### Claim 14 (depends on 13) The computer-implemented method of claim 13, wherein the check is identified based on attributes comprising MICR (Magnetic Ink Character Recognition) characters. ### Claim 15 (depends on 1) The computer-implemented method of claim 1, wherein the object type of the first object comprises a photo identification card. ### Claim 16 (depends on 15) The computer-implemented method of claim 15, wherein the photo identification card is identified based on attributes comprising an image of a face at a given location. ### Claim 17 A non-transitory computer readable medium storing instructions that, when executed by a computing device having one or more processors, causes the one or more processors to perform operations comprising: receiving, by a computing device, an image; identifying, by the computing device, multiple physical objects represented in the image based on attributes of the multiple physical objects; determining, by the computing device, an object type of a first object of the multiple physical objects; determining, by the computing device, an object type of a second object of the multiple physical objects; identifying, by the computing device, one or more specific regions of the first object for recognition based on the object type of the first object; identifying, by the computing device, one or more specific regions of the second object for recognition based on the object type of the second object; responsive to identifying the one or more specific regions, recognizing, by the computing device, text in the one or more specific regions of the first object; recognizing, by the computing device, text in the one or more specific regions of the second object; providing, by the computing device, the text recognized in the one or more specific regions of the first object to a security engine, the security engine configured to evaluate whether the text comprises sensitive information; and providing, by the computing device, the text in the one or more specific regions of the second object to the security engine. ### Claim 18 A computer system comprising: a receiving module programmed to receive an image, at least one processor configured to execute the receiving module; an object identification module programmed to identify multiple physical objects represented in the image based on attributes of the multiple physical objects, the at least one processor configured to execute the object identification module, the object identification module communicatively coupled to the receiving module; an object analysis module programmed to determine an object type of a first object of the multiple physical objects, determine an object type of a second object of the multiple physical objects, identify one or more specific regions of the first object for recognition based on the object type of the first object, and identify one or more specific regions of the second object for recognition based on the object type of the second object, the at least one processor configured to execute the object analysis module, the object analysis module communicatively coupled to the object identification module; and a text recognition module programmed to, responsive to identifying the one or more specific regions, recognize text in the one or more specific regions of the first object, recognize text in the one or more specific regions of the second object, tag the text recognized in each specific region of the one or more specific regions of the first object with metadata based on a location of the specific region on the first object, provide the text recognized in the one or more specific regions of the first object to a security engine, and provide the text in the one or more specific regions of the second object to the security engine, the metadata indicating a data type expected to be found at the location of the specific region on an object having the object type of the first object, the security engine configured to evaluate whether the text of the first object or the second object comprises sensitive information, the at least one processor configured to execute the text recognition module, the text recognition module communicatively coupled to the object analysis module.