# US 11,113,464 B2 · Synchronizing data-entry fields with corresponding image regions > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,113,464 B2 - Document ID: US11113464B2 - Status: Granted - Kind: B2 - Application number: 17/006,560 - Filed: 2020-08-28 - Published: 2020-12-17 - Granted: 2021-09-07 - Earliest claimed: 2017-09-27 - Assignees: Equifax Inc. - Applicants: Equifax Inc. - Inventors: Marcin Banaszak; Telmo Pestana; Niall Fallon; Georgia Klontza - Web page: https://patentgrep.com/patent/US11113464B2 ## CPC - G06F 40/174: Form filling; Merging - G06V 10/96: Management of image or video recognition tasks - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract According to certain implementations, a data-entry system synchronizes a region of an image with a data-entry field. For example, a data-entry interface may include data-entry fields. The data-entry interface may be updated to display an image of a document, such as a scanned handwritten form. The document image may include regions that are associated with respective data-entry fields. The data-entry system may detect a selection of a target data-entry field. Based on the detected selection, the data-entry system may determine an associated region of the document image. The associated region may correspond to the target data-entry field. The data-entry system may modify the displayed document image, and the modification may include a visual enhancement of the associated region. In some cases, the data-entry system determines the associated region corresponding to the target data-entry field based on metadata. ## Claims ### Claim 1 A method comprising: receiving an image of a document, the image including regions, wherein each region of the image displays a portion of information from the document as represented by the image; receiving metadata associated with the image; generating, based on the received metadata, a data-entry interface including data-entry fields and a displayed image that is based on the received image; detecting, on the image of the document, a calibration mark indicating a coordinate framework of the displayed image; detecting, by a processing device, a selection of a target data-entry field from the data-entry fields; determining, by the processing device and based on detecting the selection, an associated region from the regions, wherein the associated region corresponds to the target data-entry field; and modifying, by the processing device, the displayed image in the data-entry interface to include a visual enhancement of the associated region from the image of the document. ### Claim 2 (depends on 1) The method of claim 1, further comprising, subsequent to detecting the selection of the target data-entry field: receiving an input associated with the target data-entry field; and providing the received input to a data-entry record. ### Claim 3 (depends on 1) The method of claim 1, further comprising: receiving an input associated with one or more of: the target data-entry field or a control included on the data-entry interface; and in response to detecting the input, further modifying the displayed image to include an additional visual enhancement. ### Claim 4 (depends on 1) The method of claim 1, wherein a portion of the received metadata indicates one or more of: the associated region, or the visual enhancement of the associated region. ### Claim 5 (depends on 1) The method of claim 1, wherein modifying the displayed image in the data-entry interface further comprises: determining one or more of a relative location or a relative orientation of the displayed image with respect to the data-entry interface; and synchronizing the displayed image and the visual enhancement, wherein the synchronizing is based on the one or more of the relative location or the relative orientation. ### Claim 6 (depends on 1) The method of claim 1, wherein the received metadata includes a set of coordinates associated with the target data-entry field, the method further comprising determining a location of the visual enhancement based on the set of coordinates. ### Claim 7 (depends on 6) The method of claim 6, wherein the set of coordinates associated with the target data-entry field are determined with respect to the coordinate framework of the displayed image. ### Claim 8 A non-transitory computer-readable medium embodying program code, the program code comprising instructions which, when executed by a processor, cause the processor to perform operations including: receiving an image of a document, the image including regions, wherein each region of the image displays a portion of information from the document as represented by the image; receiving metadata associated with the image; generating, based on the received metadata, a data-entry interface including data-entry fields and a displayed image that is based on the received image; detecting, on the image of the document, a calibration mark indicating a coordinate framework of the displayed image; detecting a selection of a target data-entry field from the data-entry fields; determining, based on detecting the selection, an associated region from the regions, wherein the associated region corresponds to the target data-entry field; and modifying the displayed image in the data-entry interface to include a visual enhancement of the associated region from the image of the document. ### Claim 9 (depends on 8) The non-transitory computer-readable medium of claim 8, the operations further including, subsequent to detecting the selection of the target data-entry field: receiving an input associated with the target data-entry field; and providing the received input to a data-entry record. ### Claim 10 (depends on 8) The non-transitory computer-readable medium of claim 8, the operations further including: receiving an input associated with one or more of: the target data-entry field or a control included on the data-entry interface; and in response to detecting the input, further modifying the displayed image to include an additional visual enhancement. ### Claim 11 (depends on 8) The non-transitory computer-readable medium of claim 8, wherein a portion of the received metadata indicates one or more of: the associated region, or the visual enhancement of the associated region. ### Claim 12 (depends on 8) The non-transitory computer-readable medium of claim 8, wherein modifying the displayed image in the data-entry interface further comprises: determining one or more of a relative location or a relative orientation of the displayed image with respect to the data-entry interface; and synchronizing the displayed image and the visual enhancement, wherein the synchronizing is based on the one or more of the relative location or the relative orientation. ### Claim 13 (depends on 12) The non-transitory computer-readable medium of claim 12, wherein the received metadata includes a set of coordinates associated with the target data-entry field, the operations further including determining a location of the visual enhancement based on the set of coordinates. ### Claim 14 (depends on 13) The non-transitory computer-readable medium of claim 13, wherein the set of coordinates associated with the target data-entry field are determined with respect to the coordinate framework of the displayed image. ### Claim 15 A data-entry system comprising: a processor; a display device configured for being controlled by the processor: and a non-transitory computer-readable storage device comprising instructions that are executable by the processor for: receiving an image of a document, the image including regions, wherein each region of the image displays a portion of information from the document as represented by the image; receiving metadata associated with the image; generating, based on the received metadata, a data-entry interface including data-entry fields and a displayed image that is based on the received image; detecting, on the image of the document, a calibration mark indicating a coordinate framework of the displayed image; detecting a selection of a target data-entry field from the data-entry fields; determining, based on detecting the selection, an associated region from the regions, wherein the associated region corresponds to the target data-entry field; and modifying the displayed image in the data-entry interface to include a visual enhancement of the associated region from the image of the document. ### Claim 16 (depends on 15) The data-entry system of claim 15, the instructions further comprising, subsequent to detecting the selection of the target data-entry field: receiving an input associated with the target data-entry field; and providing the received input to a data-entry record. ### Claim 17 (depends on 15) The data-entry system of claim 15, the instructions further comprising: receiving an input associated with one or more of: the target data-entry field or a control included on the data-entry interface; and in response to detecting the input, further modifying the displayed image to include an additional visual enhancement. ### Claim 18 (depends on 15) The data-entry system of claim 15, wherein modifying the displayed image in the data-entry interface further comprises: determining one or more of a relative location or a relative orientation of the displayed image with respect to the data-entry interface; and synchronizing the displayed image and the visual enhancement, wherein the synchronizing is based on the one or more of the relative location or the relative orientation. ### Claim 19 (depends on 15) The data-entry system of claim 15, wherein the received metadata includes a set of coordinates associated with the target data-entry field, the instructions further comprising determining a location of the visual enhancement based on the set of coordinates. ### Claim 20 (depends on 19) The data-entry system of claim 19, wherein the set of coordinates associated with the target data-entry field are determined with respect to the coordinate framework of the displayed image.