# US 8,543,501 B2 · Systems and methods for capturing and processing payment coupon information > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,543,501 B2 - Document ID: US8543501B2 - Status: Granted - Kind: B2 - Application number: 12/818,961 - Filed: 2010-06-18 - Published: 2011-12-22 - Granted: 2013-09-24 - Earliest claimed: 2010-06-18 - Assignees: Fiserv, Inc. - Applicants: Mary Elizabeth Lawson; Joseph Carl Dickerson; Barbara Wilson Whiteside; Donald Kenneth Hobday; Hans Daniel Dreyer - Inventors: Mary Elizabeth Lawson; Joseph Carl Dickerson; Barbara Wilson Whiteside; Donald Kenneth Hobday; Hans Daniel Dreyer - Web page: https://patentgrep.com/patent/US8543501B2 ## CPC - G06Q 40/00: Finance; Insurance; Tax strategies; Processing of corporate or income taxes - G06Q 20/102: {Bill distribution or payments} - G06Q 20/322: {Aspects of commerce using mobile devices [M-devices]} - G06Q 20/325: {using wireless networks} - G06Q 20/3276: {using a pictured code, e.g. barcode or QR-code, being read by the M-device} - G06Q 30/0207: Discounts or incentives, e.g. coupons or rebates - G06V 20/62: Text, e.g. of license plates, overlay texts or captions on TV images - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Embodiments of the invention may provide systems and methods for capturing and processing payment coupon information. In one embodiment, a method includes receiving an image representing a payment coupon from a payer and determining an identity of a biller associated with the payment coupon from the image. It may then be determined that no payment coupon metadata for obtaining one or more fields from the payment coupon is stored in association with the biller. The method may then include requesting a respective set of one or more field indicators representing at least an approximate size or an approximate location for one or more fields within the image. Upon receipt, the field indicators for the fields within the image are stored as the payment coupon metadata in association with the biller. ## Claims ### Claim 1 A method, comprising: receiving, by a payment service provider system comprising one or more computers, an image representing a payment coupon; determining, by the payment service provider system, an identity of a biller associated with the payment coupon from the image; determining, by the payment service provider system based on the identity of the biller, that no payment coupon metadata for obtaining one or more fields from the payment coupon is stored in association with the biller; requesting, by the payment service provider system responsive to determining that no payment coupon metadata is stored for the biller, a respective set of one or more field indicators representing at least an approximate size or an approximate location for each of the one or more fields within the image, wherein requesting the respective set of one or more field indicators for the one or more fields within the image further includes, presenting the image to a user, and instructing the user to graphically indicate on the image at least the approximate size or the approximate location for each of the one or more fields; receiving, by the payment service provider system, the respective set of one or more field indicators for each of the one or more fields within the image; and storing, by the payment service provider system, the respective set of one or more field indicators for the one or more fields within the image as at least a portion of the payment coupon metadata, wherein the payment coupon metadata is stored in association with the biller. ### Claim 2 (depends on 1) The method of claim 1, wherein the image comprises one of: (a) a scanned image of the payment coupon; or (b) a photograph of the payment coupon. ### Claim 3 (depends on 1) The method of claim 1, wherein determining the identity of the biller from the image comprises one of: (a) utilizing optical character recognition processing at a predetermined location on the image; or (b) receiving the identity of the biller from the user. ### Claim 4 (depends on 1) The method of claim 1, wherein the respective set of one or more field indicators for the one or more fields within the image comprises at least one of: (a) an x and y coordinate pair indicating the approximate location of the respective field; (b) an x and y coordinate pair indicating the approximate center of the respective field; (c) an x and y coordinate pair indicating a starting point for the respective field; (d) an x and y coordinate pair indicating an ending point for the respective field; (e) an indication of a location of one or more corners of the respective field; (f) a horizontal dimension; (g) a vertical dimension; (h) dimensions of a rectangle; or (i) a distance from a predetermined location within the image. ### Claim 5 (depends on 1) The method of claim 1, wherein receiving the respective set of one or more field indicators for the one or more fields within the image further comprises receiving an association of a field type for the one or more fields. ### Claim 6 (depends on 1) The method of claim 1, further comprising extracting data from the image based at least in part on the respective set of one or more field indicators for the one or more fields within the image. ### Claim 7 (depends on 6) The method of claim 6, further comprising presenting the extracted data to a user for confirmation or modification. ### Claim 8 (depends on 7) The method of claim 7, wherein the confirmation is presented with the image. ### Claim 9 (depends on 7) The method of claim 7, further comprising receiving modified data from the user responsive to presenting the extracted data to the user. ### Claim 10 (depends on 6) The method of claim 6, further comprising storing at least part of the extracted data in association with at least one of: (a) the biller; or (b) the user associated with the payment coupon. ### Claim 11 (depends on 6) The method of claim 6, further comprising processing a payment associated with the payment coupon based at least in part on the extracted data. ### Claim 12 (depends on 1) The method of claim 1, further comprising presenting the image to the user with a graphical indication of the location of the one or more fields within the image based at least in part on the one or more field indicators received. ### Claim 13 (depends on 12) The method of claim 12, further comprising receiving from the user one or more modifications to the respective set of one or more field indicators for the one or more fields within the image responsive to presenting the image with the graphical indication of the location of the one or more fields within the image to the user. ### Claim 14 (depends on 1) The method of claim 1, wherein the image is a first image representing a first payment coupon, and further comprising: receiving a second image representing a second payment coupon subsequent to storing the respective set of one or more field indicators for the one or more fields within the image as the payment coupon metadata associated with the biller; determining the identity of the biller based at least in part on information associated with the second image, wherein the identity of the biller is the same for the first image and the second image; extracting data from the second image based on the payment coupon metadata associated with the biller; and performing at least one of: (a) processing a payment associated with the second payment coupon based at least in part on the extracted data from the second image; (b) adding the biller to a list of billers for the user associated with the second payment coupon; or (c) activating the biller as an electronic biller for the payer associated with the second payment coupon. ### Claim 15 (depends on 1) The method of claim 1, wherein the image is received over a network via a web-based application. ### Claim 16 (depends on 1) The method of claim 1, wherein the image is received from a mobile device. ### Claim 17 (depends on 1) The method of claim 1, further comprising performing at least one of: (a) processing a payment associated with the payment coupon based at least in part on the extracted data from the image; (b) adding the biller to a list of billers for a payer the user associated with the payment coupon; or (c) activating the biller as an electronic biller for the payer associated with the payment coupon. ### Claim 18 (depends on 1) The method of claim 1, wherein the image and the one or more field indicators are transmitted by one of: (a) the user associated with the payment coupon; (b) the biller; or (c) a service provider performing payment processing on behalf of one of the biller or the payer. ### Claim 19 A computer program product, comprising one or more non-transitory computer-readable media having instructions stored thereon for execution by one or more processors to perform the operations of: receiving an image representing a first instance of a payment coupon of a biller; requesting a respective set of one or more field indicators for each of one or more fields within the image, wherein requesting the respective set of one or more field indicators for each of one or more fields within the image further includes, displaying the image via a user interface, and enabling the user to indicate the respective set of one or more field indicators for the one or more fields within the image; and receiving the respective set of one or more field indicators for the one or more fields within the image for subsequent processing, wherein the one or more sets of the one or more field indicators comprise payment coupon metadata of either the first instance or a second instance of the payment coupon of the biller to facilitate extracting data from the image or a second image representing the second instance of the payment coupon. ### Claim 20 (depends on 19) The product of claim 19, wherein the respective set of one or more field indicators for the one or more fields within the image comprises at least one of: (a) an x and y coordinate pair indicating the approximate location of the respective field; (b) an x and y coordinate pair indicating the approximate center of the respective field; (c) an x and y coordinate pair indicating a starting point for the respective field; (d) an x and y coordinate pair indicating an ending point for the respective field; (e) an indication of a location of one or more corners of the respective field; (f) a horizontal dimension; (g) a vertical dimension; (h) dimensions of a rectangle; or (i) a distance from a predetermined location within the image. ### Claim 21 (depends on 19) The product of claim 19, wherein the instructions are further configured for execution by the one or more processors to perform the operations of displaying the image with a graphical indication of the location of the one or more fields within the image for confirmation or adjustment by the user. ### Claim 22 (depends on 19) The product of claim 19, wherein the instructions are further configured for execution by the one or more processors to perform the operations of extracting data from the image based at least in part on the respective set of one or more field indicators for the one or more fields within the image. ### Claim 23 (depends on 19) The product of claim 19, wherein the instructions are further configured for execution by the one or more processors to perform the operations of displaying extracted data to the user for confirmation or adjustment by the user, wherein the extracted data is extracted from the image based at least in part on the respective set of one or more field indicators for the one or more fields within the image. ### Claim 24 (depends on 19) The product of claim 19, wherein the computer program product is operable for execution by one of: (a) a mobile device; or (b) a computer. ### Claim 25 (depends on 19) The product of claim 19, wherein the computer program product is operable for execution by a service provider system on behalf of one of: (a) the user associated with the payment coupon; (b) the biller; or (c) a payment service provider system performing payment processing on behalf of one of the biller or the payer. ### Claim 26 (depends on 19) The product of claim 19, wherein the image comprises one of: (a) a scanned image of the payment coupon; or (b) a photograph of the payment coupon. ### Claim 27 (depends on 19) The product of claim 19, wherein the instructions are further configured for execution by the one or more processors to perform the operations of determining the identity of the biller from the image utilizing one of: (a) optical character recognition processing at a predetermined location on the image; or (b) the identity of the biller from the user. ### Claim 28 (depends on 27) The product of claim 27, wherein the instructions are further configured for execution by the one or more processors to perform the operations of storing at least part of the extracted data in association with at least one of: (a) the biller; or (b) the user associated with the payment coupon. ### Claim 29 (depends on 27) The product of claim 27, wherein the instructions are further configured for execution by the one or more processors to perform the operations of processing a payment associated with the payment coupon based at least in part on the extracted data. ### Claim 30 (depends on 19) The product of claim 19, wherein the instructions are further configured for execution by the one or more processors to perform the operations of receiving from the user one or more modifications to the respective set of one or more field indicators for the one or more fields within the image responsive to presenting the image with the graphical indication of the location of the one or more fields within the image to the user. ### Claim 31 A system, comprising: at least one memory comprising computer-executable instructions; at least one communications interface; and at least one processor in communication with the at least one communications interface and the at least one memory and configured to execute the computer-executable instructions to: receive, via the at least one communications interface, an image representing a payment coupon; determine an identity of a biller associated with the payment coupon from the image; determine, based on the identity of the biller, that no payment coupon metadata for obtaining one or more fields from the payment coupon is stored in association with the biller; request, via the at least one communications interface, responsive to determining that no payment coupon metadata is stored for the biller, a respective set of one or more field indicators representing at least an approximate size or an approximate location for each of the one or more fields within the image, wherein the request further includes, present the image to a user, and instruct the user to graphically indicate on the image at least the approximate size or the approximate location for each of the one or more fields; receive, via the at least one communications interface, the respective set of one or more field indicators for the one or more fields within the image; and store, in the memory, the respective set of one or more field indicators for the one or more fields within the image as at least a portion of the payment coupon metadata, wherein the payment coupon metadata is stored in association with the biller. ### Claim 32 (depends on 31) The system of claim 31, wherein the image comprises one of: (a) a scanned image of the payment coupon; or (b) a photograph of the payment coupon. ### Claim 33 (depends on 31) The system of claim 31, wherein, to determine the identity of the biller from the image, the at least one processor is configured to execute the computer-executable instructions to one of: (a) utilize optical character recognition processing at a predetermined location on the image; or (b) receive the identity of the biller from the user. ### Claim 34 (depends on 31) The system of claim 31, wherein the respective set of one or more field indicators for the one or more fields within the image comprises at least one of: (a) an x and y coordinate pair indicating the approximate location of the respective field; (b) an x and y coordinate pair indicating the approximate center of the respective field; (c) an x and y coordinate pair indicating a starting point for the respective field; (d) an x and y coordinate pair indicating an ending point for the respective field; (e) an indication of a location of one or more corners of the respective field; (f) a horizontal dimension; (g) a vertical dimension; (h) dimensions of a rectangle; or (i) a distance from a predetermined location within the image. ### Claim 35 (depends on 31) The system of claim 31, wherein the at least one processor is further configured to execute the computer-executable instructions to extract data from the image based at least in part on the respective set of one or more field indicators for the one or more fields within the image. ### Claim 36 (depends on 35) The system of claim 35, wherein the at least one processor is further configured to execute the computer-executable instructions to present the extracted data to a user for confirmation or modification. ### Claim 37 (depends on 35) The system of claim 35, wherein the at least one processor is further configured to execute computer-executable instructions to store at least part of the extracted data in association with at least one of: (a) the biller; or (b) the user associated with the payment coupon. ### Claim 38 (depends on 35) The system of claim 35, wherein the at least one processor is further configured to execute computer-executable instructions to process a payment associated with the payment coupon based at least in part on the extracted data. ### Claim 39 (depends on 31) The system of claim 31, wherein the at least one processor is further configured to execute the computer-executable instructions to receive from the user one or more modifications to the respective set of one or more field indicators for the one or more fields within the image responsive to presenting the image with the graphical indication of the location of the one or more fields within the image to the user.