Line-of-sight detection apparatus and image capturing apparatus
AssigneeCanon Kabushiki Kaisha
InventorYuji Kaneda
Life of this patent
Estimating the term…
Abstract
A line-of-sight detection apparatus is configured to calculate a mean luminance value in an eye area of a face image, determine that an object is a person whose iris area is blue or green in a case in which the calculated mean luminance value is equal to or greater than a predetermined value, determine a correction parameter for correcting the eye area based on the determined color of the iris area, and generate a luminance image in which the eye area is corrected by using the determined correction parameter. Thus, the line-of-sight detection apparatus detects a line of sight with high accuracy regardless of the color of the iris area.
Claims12
A line-of-sight detection apparatus, comprising:
- an image sensor configured to obtain a face image;
- a memory;
- a processor in communication with the memory, configured to control:
- an area setting unit configured to set an eye area in the face image obtained by the obtaining unit;
- a determination unit configured to determine an eye type of the eye area set by the area setting unit;
- a correction unit configured to correct luminance of the eye area so that a luminance image of eyes has an identical luminance distribution regardless of color of an iris area in the eye area based on the eye type determined by the determination unit;
- a feature extraction unit configured to extract a feature of the eye area in which the luminance has been corrected;
- and
- a line-of-sight detection unit configured to detect a line of sight of a face in the face image, based on the feature of the eye area extracted by the feature extraction unit.
An image capturing apparatus, comprising:
- an image sensor configured to capture an image of an object to obtain a face image of the object;
- a memory;
- a processor in communication with the memory, configured to control:
- an area setting unit configured to set an eye area in the face image obtained by the obtaining unit;
- a determination unit configured to determine an eye type of the eye area set by the area setting unit;
- a correction unit configured to correct luminance of the eye area so that a luminance image of eyes has an identical luminance distribution regardless of color of an iris area in the eye area based on the eye type determined by the determination unit;
- a feature extraction unit configured to extract a feature of the eye area in which the luminance has been corrected;
- a line-of-sight detection unit configured to detect a line of sight of a face in the face image, based on the feature of the eye area extracted by the feature extraction unit;
- and
- a recording unit configured to record the face image in which the line of sight of the face has been detected by the line-of-sight detection unit, in a recording medium.
A line-of-sight detection method, comprising:
- obtaining a face image using an image sensor;
- setting, by a processor, an eye area in the face image obtained in the obtaining;
- determining, by the processor, an eye type of the eye area set in the setting of the eye area;
- correcting, by the processor, luminance of the eye area so that a luminance image of eves has an identical luminance distribution regardless of color of an iris area in the eve area based on the eye type determined in the determining;
- extracting, by the processor, a feature of the eye area in which the luminance has been corrected;
- and
- detecting, by the processor, a line of sight of a face in the face image based on the feature of the eye area extracted.
A method for controlling an image capturing apparatus, the method comprising:
- capturing, using an image sensor, an image of an object to obtain a face image of the object;
- setting, by a processor, an eye area in the obtained face image;
- determining, by the processor, an eye type of the set eye area;
- correcting, by the processor, luminance of the eye area so that a luminance image of eyes has an identical luminance distribution regardless of color of an iris area in the eve area based on the eye type determined in the determining;
- extracting, by the processor, a feature of the eye area in which the luminance has been corrected;
- and
- detecting, by the processor, a line of sight of a face in the face image based on the feature of the eye area extracted;
- and
- recording, by the processor, the face image in which the line of sight of the face has been detected, in a recording medium.
A non-transitory computer-readable storage medium that stores computer executable instructions for causing a computer to implement a method, the method comprising:
- obtaining a face image using an image sensor;
- setting, by a processor, an eye area in the face image obtained in the obtaining;
- determining, by the processor, an eye type of the eye area set in the setting of the eye area;
- correcting, by the processor, luminance of the eye area so that a luminance image of eyes has an identical luminance distribution regardless of color of an iris area in the eve area based on the eye type determined in the determining;
- extracting, by the processor, a feature of the eye area in which the luminance has been corrected;
- and
- detecting, by the processor, a line of sight of a face in the face image based on the feature of the eye area extracted.
A non-transitory computer-readable storage medium that stores computer executable instructions for causing a computer to implement a method, the method comprising:
- capturing, using an image sensor, an image of an object to obtain a face image of the object;
- setting, by a processor, an eye area in the obtained face image;
- determining an eye type of the set eye area;
- correcting, by the processor, luminance of the eye area so that a luminance image of eves has an identical luminance distribution regardless of color of an iris area in the eve area based on the eye type determined in the determining;
- extracting, by the processor, a feature of the eye area in which the luminance has been corrected;
- and detecting a line of sight of a face in the face image based on the feature of the eye area extracted;
- and recording the face image in which the line of sight of the face has been detected, in a recording medium.
Dependencies are inferred from the claim text.