# US 9,436,884 B2 · Comparing extracted card data with user data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,436,884 B2 - Document ID: US9436884B2 - Status: Granted - Kind: B2 - Application number: 14/504,214 - Filed: 2014-10-01 - Published: 2016-05-12 - Granted: 2016-09-06 - Earliest claimed: 2013-06-28 - Assignees: Google Inc. - Applicants: Google Inc. - Inventors: Xiaohang Wang; Farhan Shamsi; Sanjiv Kumar; Henry Allan Rowley; Marcus Quintana Mitchell - Web page: https://patentgrep.com/patent/US9436884B2 ## CPC - G06V 30/416: Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors - G06K 7/10: by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation - G06Q 20/3223: {Realising banking transactions through M-devices} - G06Q 20/3276: {using a pictured code, e.g. barcode or QR-code, being read by the M-device} - G06Q 20/34: using cards, e.g. integrated circuit [IC] cards or magnetic cards - G06Q 20/36: using electronic wallets or electronic money safes - G06V 30/142: using hand-held instruments; Constructional details of the instruments - G06V 30/224: of printed characters having additional code marks or containing code marks - G06V 30/2253: {Recognition of characters printed with magnetic ink (G06V30/2247 takes precedence)} - G06Q 20/326: {Payment applications installed on the mobile devices} - G06V 30/10: Character recognition - H04N 1/00307: {with a mobile telephone apparatus (constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00)} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Extracting card data comprises receiving, by one or more computing devices, a digital image of a card; perform an image recognition process on the digital representation of the card; identifying an image in the digital representation of the card; comparing the identified image to an image database comprising a plurality of images and determining that the identified image matches a stored image in the image database; determining a card type associated with the stored image and associating the card type with the card based on the determination that the identified image matches the stored image; and performing a particular optical character recognition algorithm on the digital representation of the card, the particular optical character recognition algorithm being based on the determined card type. Another example uses an issuer identification number to improve data extraction. Another example compares extracted data with user data to improve accuracy. ## Claims ### Claim 1 A computer-implemented method to extract financial card information, comprising: applying, by the one or more computing devices, an optical character recognition algorithm to a digital image of a financial card to obtain a result; identifying, by the one or more computing devices, a name associated with the financial card based on information obtained via application of the optical character recognition algorithm to the digital image of the financial card; determining, by the one or more computing devices, a set of user data that indicates an identity of a user; and determining, by the one or more computing devices, a confidence level of the result of the optical character recognition algorithm based at least in part on a comparison of the identified name to the set of user data indicating that the name correlates to data from the set of user data. ### Claim 2 (depends on 1) The method of claim 1, wherein the set of user data comprises one or more of a contact list of the user, social network data of the user, or email applications. ### Claim 3 (depends on 1) The method of claim 1, further comprising reapplying, by the one or more computing devices, the optical character recognition algorithm to the digital image of the financial card upon a determination that the confidence level is below a preconfigured threshold. ### Claim 4 (depends on 1) The method of claim 1, further comprising: requesting, by the one or more computing devices, an input of a revision of the identified name upon a determination that the confidence level is below a threshold validation; and receiving, by the one or more computing devices, the input of the revision of the identified name. ### Claim 5 (depends on 1) The method of claim 1, wherein the card comprises a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card. ### Claim 6 A computer program product, comprising: a non-transitory computer-readable storage device having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to extract financial card information, comprising: computer-readable program instructions to apply an optical character recognition algorithm to a digital image of a financial card to obtain a result; computer-readable program instructions to identify a name associated with the financial card based on information obtained via application of the optical character recognition algorithm to the digital image of the financial card; computer-readable program instructions to determine a set of user data that indicates an identity of a user; and computer-readable program instructions to determine a confidence level of the result of the optical character recognition algorithm based at least in part on a comparison of the identified name to the set of user data indicating that the name correlates to data from the set of user data. ### Claim 7 (depends on 6) The computer program product of claim 6, wherein the set of user data comprises one or more of a contact list of the user, social network data of the user, or email applications. ### Claim 8 (depends on 6) The computer program product of claim 6, further comprising computer-executable program instructions to reapply the optical character recognition algorithm to the digital image of the financial card upon a determination that the confidence level is below a preconfigured threshold. ### Claim 9 (depends on 6) The computer program product of claim 6, further comprising: computer-readable program instructions to request an input of a revision of the identified name upon a determination that the confidence level is below a threshold validation; and computer-readable program instructions to receive the input of the revision of the identified name. ### Claim 10 (depends on 6) The computer program product of claim 6, wherein the card comprises a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card. ### Claim 11 A system to extract financial card information, comprising: a storage resource; a processor communicatively coupled to the storage resource, wherein the processor is configured to execute computer-readable instructions that are stored in the storage resource to cause the system to: apply an optical character recognition algorithm to a digital image of a financial card to obtain a result; identify a name associated with the card based on information obtained via application of the optical character recognition algorithm to the digital image of the financial card; determine a set of user data that indicates an identity of a user; and determine a confidence level of the result of the optical character recognition algorithm based at least in part on a comparison of the identified name to the set of user data indicating that the name correlates to data from the set of user data. ### Claim 12 (depends on 11) The system of claim 11, wherein the set of user data comprises one or more of a contact list of the user, social network data of the user, or email applications. ### Claim 13 (depends on 11) The system of claim 11, wherein the processor executes instructions stored in the storage resource to further cause the system to reapply the optical character recognition algorithm to the digital image of the financial card upon a determination that the confidence level is below a preconfigured threshold. ### Claim 14 (depends on 11) The system of claim 11, wherein the card comprises a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card. ### Claim 15 (depends on 11) The system of claim 11, wherein the processor executes instructions stored in the storage resource to further cause the system to: request an input of a revision of the identified user name upon a determination that the confidence level is below a threshold validation; and receive the input of the revision of the identified name.