Apparatus, method, program, and mobile terminal device with person image extracting and linking

A non-transitory computer readable medium having program code stored thereon, the program code being executable by a processor to:

• extract a face image of at least one face in a captured image;
• determine whether the extracted face image matches a face image stored in a memory for which contacts, where at least a subset of the contacts include respective face images, and corresponding personal information is also stored in the memory;
• if the extracted face image matches a face image stored in the memory section for which corresponding personal information is also stored in the memory, perform a linking process of linking the extracted face image with the personal information corresponding to the face image that was determined to match;
• cause a display section to display a modified version of the captured image in which a face image corresponding to the at least one face in the captured image from which the extracted face image was extracted is displayed in a first mode if the extracted face image has been linked with personal information by the linking process and is displayed in a second mode if the extracted face image has not been linked with personal information by the linking process;
• and
• when a face image is displayed in the second mode, enable a function whereby a user may select the face image that is displayed in the second mode then select to generate an email message and select a recipient from among the contacts stored in the memory section, whereupon automatically generate an email message that includes in an address field thereof an email address associated with the selected contact and that includes an image corresponding to the face image that is displayed in the second mode,
• wherein the first mode and the second mode respectively comprise distinct modifications of the face image corresponding to the one of the faces in the captured image from which the extracted face image was extracted.

An information processing apparatus, comprising:

• a face image extractor portion that extracts a face image of at least one person in a captured image;
• a matching image detector portion that detects from a memory a matching face image matching with the extracted face image, which has been extracted by the face image extractor portion, the memory containing or storing contacts, where at least a subset of the contacts include face images and information of respective users;
• a linking processing portion that, when a matching face image matching with the extracted face image, which has been extracted by the face image extractor portion, is detected by the matching image detector, performs a linking process to link the extracted face image and information corresponding to the extracted face image and stored in the memory;
• a linkage determining portion that, when displaying the captured image, determines whether a face image of an image of the person in the captured image and information corresponding to the face image and stored in the memory are linked together by the linking processing portion, wherein an image of a person determined by the linkage determining portion to be not linked by the linking process is displayed in the captured image in a display mode different from a display mode for the image of the person determined to be linked by the linking process,
• wherein the image of a person determined to be not linked by the linking process is displayed in the captured image in a first display mode, and the image of a person determined to be linked by the linking process is displayed in the captured image in a second display mode, with both the first display mode and the second display mode being distinct modifications of the captured image;
• wherein, when an image of a person is displayed in the first display mode, a function is enabled whereby a user may the image of a person that is displayed in the first mode then select to generate an email message and select a recipient from among the contacts stored in the memory section, whereupon the processing section automatically generates an email message that includes in an address field thereof an email address associated with the selected contact and that includes an image corresponding to the image of a person that is displayed in the first mode.

A method of processing an image, the method comprising:

• extracting a face image of at least one face in a captured image;
• determining whether the extracted face image matches a face image stored in a memory for which contacts, where at least a subset of the contacts include respective face images, and corresponding personal information is also stored in the memory;
• if the extracted face image matches a face image stored in the memory section for which corresponding personal information is also stored in the memory, performing a linking process of linking the extracted face image with the personal information corresponding to the face image that was determined to match;
• causing a display section to display a modified version of the captured image in which a face image corresponding to the at least one face in the captured image from which the extracted face image was extracted is displayed in a first mode if the extracted face image has been linked with personal information by the linking process and is displayed in a second mode if the extracted face image has not been linked with personal information by the linking process;
• and
• when a face image is displayed in the second mode, enable a function whereby a user may select the face image that is displayed in the second mode then select to generate an email message and select a recipient from among the contacts stored in the memory section, whereupon automatically generate an email message that includes in an address field thereof an email address associated with the selected contact and that includes an image corresponding to the face image that is displayed in the second mode,
• wherein the first mode and the second mode respectively comprise distinct modifications of the face image corresponding to the at least one of the faces in the captured image from which the extracted face image was extracted.