# US 2014/0193038 A1 · Image processing apparatus, image processing method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0193038 A1 - Document ID: US20140193038A1 - Status: Published application - Kind: A1 - Application number: 14/235,830 - Filed: 2012-08-15 - Published: 2014-07-10 - Earliest claimed: 2011-10-03 - Assignees: Sony Corporation - Inventors: Shunichi Kasahara - Web page: https://patentgrep.com/patent/US20140193038A1 ## CPC - G06V 30/142: using hand-held instruments; Constructional details of the instruments - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06V 20/20: in augmented reality scenes - G06V 30/10: Character recognition - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An information processing system that acquires an image captured by an image pickup unit; acquires one or a plurality of templates each including one or a plurality of fields; compares the image to the one or plurality of templates; and outputs a result based on the comparison, the result indicating whether recognition of each of the one or plurality of fields of the one or plurality of templates was successful. ## Claims ### Claim 1 An information processing system comprising: one or more processing units that: acquire an image captured by an image pickup unit; acquire one or a plurality of templates each including one or a plurality of fields; compare the image to the one or plurality of templates; and output a result based on the comparison, the result indicating whether recognition of each of the one or plurality of fields of the one or plurality of templates was successful. ### Claim 2 (depends on 1) The information processing system of claim 1, wherein the image includes an object and the one or more processing units recognize a structure of the object. ### Claim 3 (depends on 2) The information processing system of claim 2, wherein the one or more processing units recognize a structure of the object by detecting one or more fields included in the object. ### Claim 4 (depends on 1) The information processing system of claim 1, wherein the one or more processing units extract edges from the image. ### Claim 5 (depends on 4) The information processing system of claim 4, wherein the one or more processing units compare the image to the one or plurality of templates by determining a degree of matching between the edges extracted from the image and frames of fields included in the one or plurality of templates. ### Claim 6 (depends on 4) The information processing system of claim 4, wherein the one or more processing units compare the image to the one or plurality of templates by determining a degree of matching between the edges extracted from the image and frames of fields included in the one or plurality of templates while changing a position of the one or plurality of templates. ### Claim 7 (depends on 4) The information processing system of claim 4, wherein the one or more processing units compare the image to the one or plurality of templates by determining a degree of matching between the edges extracted from the image and frames of fields included in the one or plurality of templates while changing a posture of the one or plurality of templates. ### Claim 8 (depends on 1) The information processing system of claim 1, wherein the one or more processing units recognize information associated with at least one field included in a matching template from the image. ### Claim 9 (depends on 8) The information processing system of claim 8, wherein the at least one field is a field selected based on recognizing the matching template. ### Claim 10 (depends on 1) The information processing system of claim 1, wherein the one or more processing units recognize information associated with at least one field included in a matching template from the image by performing optical character recognition (OCR) on a portion of the image associated with the at least one field. ### Claim 11 (depends on 1) The information processing system of claim 1, wherein the one or more processing units recognize information associated with at least one field included in a matching template from the image by matching portions of the image associated with the at least one field with stored image information. ### Claim 12 (depends on 1) The information processing system of claim 1, wherein the image associated with the at least one field is an image of a face, and the image of the face is matched with stored face image information. ### Claim 13 (depends on 8) The information processing system of claim 8, wherein the one or more processing units control a display to superimpose the recognized information on the image. ### Claim 14 (depends on 1) The information processing system of claim 1, wherein the one or more processing units generate assistance information for guiding a user of the image pickup unit to adjust the image pickup unit based on a result of the comparing. ### Claim 15 (depends on 14) The information processing system of claim 14, wherein the assistance information instructs the user to change an orientation of the image pickup unit. ### Claim 16 (depends on 14) The information processing system of claim 14, wherein the assistance information instructs the user to change at least one of a position and setting of the image pickup unit to change a size of the image captured by the image pickup unit. ### Claim 17 (depends on 1) The information processing system of claim 1, wherein the result that is output based on the comparison includes controlling a display to display one or a plurality of fields for which recognition was successful differently from one or a plurality of fields for which recognition was not successful. ### Claim 18 (depends on 1) The information processing system of claim 1, wherein the captured image and the one or plurality of templates correspond to a web page. ### Claim 19 (depends on 18) The information processing system of claim 18, wherein the one or more processing units recognize information associated with at least one field included in a matching template corresponding to the web page from the image. ### Claim 20 (depends on 19) The information processing system of claim 19, wherein the one or more processing units controls a process of accessing the web page based on the recognized information. ### Claim 21 (depends on 19) The information processing system of claim 19, wherein the recognized information corresponds to login information for the web page. ### Claim 22 (depends on 1) The information processing system of claim 1, wherein the information processing system is a mobile phone and the one or more processing units are a processor at the mobile phone. ### Claim 23 (depends on 1) The information processing system of claim 1, wherein the information processing system includes a client and a server. ### Claim 24 (depends on 23) The information processing system of claim 23, wherein the client includes the image pickup unit; and a first communication interface that sends the image to the server; and the server includes a second communication interface that receives the image from the client; at least one of the one or more processing units that acquires the one or a plurality of templates from a memory, compares the image to the one or plurality of templates, and controls the second communication interface to output the result based on the comparison to the client. ### Claim 25 An information processing method performed by an information processing system, the method comprising: acquiring an image captured by an image pickup unit; acquiring one or a plurality of templates each including one or a plurality of fields; comparing the image to the one or plurality of templates; and outputting a result based on the comparison, the result indicating whether recognition of each of the one or plurality of fields of the one or plurality of templates was successful. ### Claim 26 A non-transitory computer-readable medium including computer program instructions, which when executed by an information processing system, cause the information processing system to perform a method, the method comprising: acquiring an image captured by an image pickup unit; acquiring one or a plurality of templates each including one or a plurality of fields; comparing the image to the one or plurality of templates; and outputting a result based on the comparison, the result indicating whether recognition of each of the one or plurality of fields of the one or plurality of templates was successful.