Information processing apparatus, information processing method, program, and electronic apparatus

An information processing method for an information processing apparatus that detects a change in distance from a user, the information processing apparatus including an irradiation means, an acquisition means, an object area extraction means, and a distance change detection means, the method comprising:

• irradiating, by the irradiation means, the user with light having a first wavelength and light having a second wavelength that is different from the first wavelength;
• acquiring, by the acquisition means, a first image and a second image, the first image being obtained by receiving reflected light of the light having the first wavelength with which the user is irradiated, the second image being obtained by receiving reflected light of the light having the second wavelength with which the user is irradiated;
• extracting, by the object area extraction means, an object area in which an object representing a predetermined skin portion of a body of the user is displayed, from a skin display area in a display image including the skin display area in which a skin of the user is displayed, based on the first and second images;
• and
• detecting, by the distance change detection means, a change in relative distance from the irradiation means to the object in accordance with a change of luminance values of pixels constituting the object area in the display image or a value calculated based on the luminance values.

A program for causing a computer that controls an information processing apparatus including an irradiation means for irradiating the user with light having a first wavelength and light having a second wavelength that is different from the first wavelength, to function as:

• an acquisition means for acquiring a first image and a second image, the first image being obtained by receiving reflected light of the light having the first wavelength with which the user is irradiated, the second image being obtained by receiving reflected light of the light having the second wavelength with which the user is irradiated;
• an object area extraction means for extracting an object area in which an object representing a predetermined skin portion of a body of the user is displayed, from a skin display area in a display image including the skin display area in which a skin of the user is displayed, based on the first and second images;
• and
• a distance change detection means for detecting a change in relative distance from the irradiation means to the object in accordance with a change of luminance values of pixels constituting the object area in the display image or a value calculated based on the luminance values.

An electronic apparatus, comprising:

• an irradiation means for irradiating the user with light having a first wavelength and light having a second wavelength that is different from the first wavelength;
• an acquisition means for acquiring a first image and a second image, the first image being obtained by receiving reflected light of the light having the first wavelength with which the user is irradiated, the second image being obtained by receiving reflected light of the light having the second wavelength with which the user is irradiated;
• an object area extraction means for extracting an object area in which an object representing a predetermined skin portion of a body of the user is displayed, from a skin display area in a display image including the skin display area in which a skin of the user is displayed, based on the first and second images;
• a distance change detection means for detecting a change in relative distance from the irradiation means to the object in accordance with a change of luminance values of pixels constituting the object area in the display image or a value calculated based on the luminance values;
• and
• an execution means for executing predetermined processing in response to the detection of the change in relative distance from the irradiation means to the object.

An information processing apparatus that extracts a shape of an object representing a predetermined skin portion of a body of a user from a captured image obtained by capturing an image of the user, the information processing apparatus comprising:

• an irradiation means for irradiating the user with light having a first wavelength and light having a second wavelength that is different from the first wavelength;
• an acquisition means for acquiring a first image and a second image, the first image being obtained by receiving reflected light of the light having the first wavelength with which the user is irradiated, the second image being obtained by receiving reflected light of the light having the second wavelength with which the user is irradiated;
• a difference value calculation means for calculating a difference value representing a difference in reflectance between the light having the first wavelength and the light having the second wavelength, for each of pixels constituting the first or second image;
• a skin area extraction means for extracting a skin area representing a skin of the user based on whether the difference value calculated for each of the pixels constituting the first or second image is equal to or larger than a predetermined threshold value;
• and
• a shape area extraction means for extracting a shape area representing the shape of the object in the skin area,
• wherein the shape area extraction means extracts the shape area based on distribution of luminance values of pixels constituting an area corresponding to the skin area in a display image in which the object and a portion of the user that corresponds to an area excluding the shape area in the skin area are displayed.

An information processing method for an information processing apparatus that extracts a shape of an object representing a predetermined skin portion of a body of a user from a captured image obtained by capturing an image of the user, the information processing apparatus including an irradiation means, an acquisition means, a difference value calculation means, a skin area extraction means, and a shape area extraction means, the method comprising:

• irradiating, by the irradiation means, the user with light having a first wavelength and light having a second wavelength that is different from the first wavelength;
• acquiring, by the acquisition means, a first image and a second image, the first image being obtained by receiving reflected light of the light having the first wavelength with which the user is irradiated, the second image being obtained by receiving reflected light of the light having the second wavelength with which the user is irradiated;
• calculating, by the difference value calculation means, a difference value representing a difference in reflectance between the light having the first wavelength and the light having the second wavelength, for each of pixels constituting the first or second image;
• extracting, by the skin area extraction means, a skin area representing a skin of the user based on whether the difference value calculated for each of the pixels constituting the first or second image is equal to or larger than a predetermined threshold value;
• and
• extracting, by the shape area extraction means, a shape area representing the shape of the object in the skin area,
• wherein the shape area extraction means extracts the shape area based on distribution of luminance values of pixels constituting an area corresponding to the skin area in a display image in which the object and a portion of the user that corresponds to an area excluding the shape area in the skin area are displayed.

A program causing a computer that controls an information processing apparatus that extracts a shape of an object representing a predetermined skin portion of a body of a user from a captured image obtained by capturing an image of the user, and that includes an irradiation means for irradiating the user with light having a first wavelength and light having a second wavelength that is different from the first wavelength, to function as:

• an acquisition means for acquiring a first image and a second image, the first image being obtained by receiving reflected light of the light having the first wavelength with which the user is irradiated, the second image being obtained by receiving reflected light of the light having the second wavelength with which the user is irradiated;
• a difference value calculation means for calculating a difference value representing a difference in reflectance between the light having the first wavelength and the light having the second wavelength, for each of pixels constituting the first or second image;
• a skin area extraction means for extracting a skin area representing a skin of the user based on whether the difference value calculated for each of the pixels constituting the first or second image is equal to or larger than a predetermined threshold value;
• and
• a shape area extraction means for extracting a shape area representing the shape of the object in the skin area,
• wherein the shape area extraction means extracts the shape area based on distribution of luminance values of pixels constituting an area corresponding to the skin area in a display image in which the object and a portion of the user that corresponds to an area excluding the shape area in the skin area are displayed.

An electronic apparatus that extracts a shape of an object representing a predetermined skin portion of a body of a user from a captured image obtained by capturing an image of the user, the electronic apparatus comprising:

• an irradiation means for irradiating the user with light having a first wavelength and light having a second wavelength that is different from the first wavelength;
• an acquisition means for acquiring a first image and a second image, the first image being obtained by receiving reflected light of the light having the first wavelength with which the user is irradiated, the second image being obtained by receiving reflected light of the light having the second wavelength with which the user is irradiated;
• a difference value calculation means for calculating a difference value representing a difference in reflectance between the light having the first wavelength and the light having the second wavelength, for each of pixels constituting the first or second image;
• a skin area extraction means for extracting a skin area representing a skin of the user based on whether the difference value calculated for each of the pixels constituting the first or second image is equal to or larger than a predetermined threshold value;
• a shape area extraction means for extracting a shape area representing the shape of the object in the skin area;
• and
• an execution means for executing processing that corresponds to the extracted shape area,
• wherein the shape area extraction means extracts the shape area based on distribution of luminance values of pixels constituting an area corresponding to the skin area in a display image in which the object and a portion of the user that corresponds to an area excluding the shape area in the skin area are displayed.