# US 10,769,362 B2 · Method and apparatus for capturing and extracting content from documents on a mobile device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,769,362 B2 - Document ID: US10769362B2 - Status: Granted - Kind: B2 - Application number: 13/958,010 - Filed: 2013-08-02 - Published: 2015-02-05 - Granted: 2020-09-08 - Earliest claimed: 2013-08-02 - Assignees: Symbol Technologies, Inc. - Applicants: Symbol Technologies, Inc. - Inventors: Anu Kannan; Alan J. Epshteyn; Duanfeng He - Web page: https://patentgrep.com/patent/US10769362B2 ## CPC - G06V 30/412: Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables - G06F 40/186: Templates - G06V 10/245: {by locating a pattern; Special marks for positioning} - G06V 30/142: using hand-held instruments; Constructional details of the instruments - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A mobile device captures information from a document. The mobile device selects a template stored in a memory of the mobile device. The selected template describes data content of at least one document. The mobile device then captures an image of a document, determines that the image corresponds to one document described by the selected template by verifying that at least one first region in the image corresponds to a region of the document described by the selected template, identifies at least one region in the image that corresponds with a region in the document described by the selected template, and processes information in the identified region in the image. The mobile device then aggregates application specific information from the processed information and presents the aggregated application specific information to a user program operating on the mobile device. ## Claims ### Claim 1 A method, comprising: selecting, by a mobile device, a template stored in a memory of the mobile device, wherein the selected template describes a document type, the template including parameters associated with the document type, wherein each of the parameters provides information on how to process an associated region in the document type; capturing, on the mobile device, an image of a document; determining, by the mobile device, that the image corresponds to the document type described by the selected template by verifying that a first region in the image of the document is located at a region location in the document type described by the selected template; identifying, by the mobile device, a region in the image of the document; processing information in the identified region in the image of the document in accordance with an associated one of the parameters; validating, by the mobile device, that data content in the identified region representative of a first geographic location corresponds to a second geographic location of the mobile device at a time; aggregating, by the mobile device, application specific information from the processed information; and presenting, by the mobile device, the aggregated application specific information to a user program operating on one of the mobile device and a remote device connected with the mobile device. ### Claim 2 (depends on 1) The method of claim 1, wherein the first geographic location is a postal address, and the second geographic location is based on a locationing system of the mobile device. ### Claim 3 (depends on 1) The method of claim 1, wherein the aggregating comprises aggregating a predefined set of data, the predefined set of data being associated with one or more documents. ### Claim 4 (depends on 1) The method of claim 1, wherein the processing information in the identified region in the image of the document comprises at least one of converting checked marks or boxes to numerical values, processing a barcode, and sharpening image data. ### Claim 5 (depends on 1) The method of claim 1, further comprising qualifying regions in the image of the document that correspond with the document type described by the selected template based on fields in the selected template. ### Claim 6 (depends on 1) The method of claim 1, further comprising using the selected template to specify characteristics associated with the document identifying processing requirements for at least one portion the document. ### Claim 7 (depends on 1) The method of claim 1, wherein the processing information in the identified region in the image of the document comprises at least one of: decoding at least one barcode in the identified region, sharpening image data representative of the identified region, and converting a checked state of at least one check box in the identified region to a numerical value. ### Claim 8 (depends on 1) The method of claim 1, wherein the selecting comprises retrieving a template corresponding with the document type from a template builder configured to build and store templates corresponding with the document type. ### Claim 9 (depends on 1) The method of claim 1, wherein each region in the selected template comprises a predefined type of information and the aggregating, by the mobile device, comprises attaching a descriptive identifier to the aggregated application specific information. ### Claim 10 A mobile device comprising: an image capturing device configured to capture an image of a document; a memory configured to store templates at least one of which is associated with a document type; a processor configured to: select one of the templates stored in the memory, the selected template including parameters associated with the document type, wherein each of the parameters provides information on how to process an associated region in the document type; determine, subsequent to the image of the document being captured by the image capturing device, that the image corresponds to the document type described by the selected template by verifying that a first region in the image of the document corresponds to a region location in the document type described by the selected template; identify a region in the image of the document; process information in the identified region in the image of the document in accordance with an associated one of the parameters; validate that data content in the identified region representative of a first geographic location corresponds to a second geographic location of the mobile device at a time; aggregate application specific information from the processed information; and present the aggregated application specific information to a user program operating on one of the mobile device and a remote device connected with the mobile device. ### Claim 11 (depends on 10) The mobile device of claim 10, further being communicatively coupled to a template builder configured to create and store the templates, the processor being configured to retrieve the selected template from the template builder. ### Claim 12 (depends on 10) The mobile device of claim 10, wherein the processor further comprises at least one of an optical mark recognition processor, a barcode processor, and an image sharpening processor. ### Claim 13 (depends on 10) The mobile device of claim 10, wherein the processor is further configured to qualify regions in the document that correspond with a layout of the selected template based on fields in the selected template. ### Claim 14 (depends on 10) The mobile device of claim 10, wherein the processor is further configured to use the selected template to specify characteristics associated with the document and identify processing requirements for at least one portion of the document. ### Claim 15 (depends on 10) The mobile device of claim 10, wherein the processor is further configured to at least one of: decode at least one barcode in the identified region, sharpen a portion of the image corresponding to the identified region, and convert a checked state of at least one check box in the identified region to a numerical value. ### Claim 16 (depends on 10) The mobile device of claim 10, wherein each region in the selected template comprises a predefined type of information and the processor is further configured to attach a descriptive identifier to the aggregated application specific information. ### Claim 17 A processor in a mobile device, comprising: a template acquiring component figured to retrieve a template describing a document type, the template including parameters associated with the document type, wherein each parameter provides information on how to process an associated region in the document type; an image acquiring component configured to acquire an image of a document; a document matching interface configured to determine that the image of the document corresponds to the document type described by the selected template by verifying that a first region in the image corresponds to a region location in the document type described by the selected template; a segmentation component configured to: identify a region in the image of the document; and validate that data content in the identified region representative of a first geographic location corresponds to a second geographic location of the mobile device at a time; at least one post processor configured to process information in the identified region in the selected template in accordance with an associated one of the parameters; and an aggregation component configured to obtain the processed information from the at least one post processor, aggregate application specific information from the processed information, and present the aggregated application specific information to a user operating the mobile device. ### Claim 18 (depends on 17) The processor of claim 17, wherein the template matching interface is configured to retrieve the template from a template builder configured to create and store the template. ### Claim 19 (depends on 17) The processor of claim 17, wherein the at least one post processor includes at least one of an optical mark recognition processor, a barcode processor, and an image sharpening processor. ### Claim 20 (depends on 17) The processor of claim 17, further comprising a data processing engine configured to use the selected template to specify characteristics associated with the document and identify processing requirements for at least one portion the document. ### Claim 21 (depends on 17) The processor of claim 17, wherein the segmentation component is further configured to sharpen a portion of the image corresponding to the identified region.