Enhancing images using known characteristics of image subjects
AssigneeApple Inc.
InventorsRussell Reid, Joshua Fagans, Tim Cherna
Life of this patent
Estimating the term…
Abstract
A method performed by one or more computers programmed to enhance images, the method including receiving an image and a face region associated with the image, sampling pixels from the face region, generating, based on the sampled pixels, a face-region evaluation, identifying a modification to the image based on the face-region evaluation, and modifying the image in accordance with the identified modification.
Claims24
A method performed by one or more computers programmed to enhance images, the method comprising:
- receiving an image and a face region associated with the image;
- sampling pixels from the face region;
- generating, based on the sampled pixels, a face-region evaluation, comprising:
- identifying a skin tone portion in the face region;
- and
- performing the face-region evaluation only on the skin tone portion,
- wherein the face-region evaluation comprises:
- converting the sampled pixels in the identified skin tone portion to a normalized red-green color space;
- and
- calculating a mean color of the converted pixels;
- identifying a modification to the image based on the face-region evaluation, wherein the modification comprises:
- projecting the mean color onto a point of a focus-to-focus centerline of a predetermined skin tone region having a shortest distance in red-green color space to the calculated mean color;
- and
- adjusting the image so that the sampled pixels in the skin tone portion have a new mean in red-green color space equal to the point;
- and
- modifying the image in accordance with the identified modification.
A computer program product, tangibly encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:
- receiving an image and coordinates defining a face region of the image;
- sampling pixels from the face region of the image;
- generating, based on the sampled pixels, a face-region evaluation, comprising:
- identifying a skin tone portion in the face region;
- and
- performing the face-region evaluation only on the skin tone portion, wherein the face-region evaluation comprises:
- converting the sampled pixels in the identified skin tone portion to normalized red-green color space;
- and
- calculating a mean color of the converted pixels;
- storing the face-region evaluation;
- identifying a modification to the image based on the face-region evaluation, wherein the modification comprises:
- projecting the mean color onto a point of a focus-to-focus centerline of a predetermined skin tone region having a shortest distance in red-green color space to the calculated mean color;
- and
- adjusting the image so that the sampled pixels in the skin tone portion have a new mean in red-green color space equal to the point;
- and
- modifying the image in accordance with the identified modification.
A system comprising:
- a display device for displaying an image enhancement application;
- an input device for receiving input from a user of the image enhancement application;
- memory;
- and
- data processing apparatus including one or more computers operable to interact with the display device, memory and the input device, and to perform operations comprising:
- executing the image enhancement application;
- receiving, in memory, an image and coordinates defining a face region of the image;
- sampling pixels from the face region of the image;
- generating, based on the sampled pixels, a face-region evaluation, comprising:
- identifying a skin tone portion in the face region;
- and
- performing the face-region evaluation only on the skin tone portion, wherein the face-region evaluation comprises:
- converting the sampled pixels in the identified skin tone portion to a normalized red-green color space;
- and
- calculating a mean color of the converted pixels;
- storing the face-region evaluation in memory;
- identifying a modification to the image based on the stored face-region evaluation, wherein the modification comprises:
- projecting the mean color onto a point of a focus-to-focus centerline of a predetermined skin tone region having a shortest distance in red-green color space to the calculated mean color;
- and
- adjusting the image so that the sampled pixels in the skin tone portion have a new mean in red-green color space equal to the point;
- and
- modifying, in memory, the image in accordance with the identified modification.
Dependencies are inferred from the claim text.