Back to results
US 11,890,057 B2Granted
Gaze detection apparatus, gaze detection method, and gaze detection program
AssigneeJVCKENWOOD Corporation
InventorTakahiro Hayashi
Life of this patent
Estimating the term…
Abstract
A gaze detection apparatus performs a calibration operation including displaying a target image in multiple positions on a display screen sequentially, setting, in the display screen, corresponding areas corresponding to the target images displayed on the display screen sequentially, and calculating positional data of points of regard in display periods in which the respective target images are displayed; and determines, with respect to each of the target images, whether the positional data of the point of regard that is calculated in the calibration operation is present within the corresponding area.
Claims6
A gaze detection apparatus comprising:
- a display screen on which an image is displayed;
- a light source configured to apply detection light to at least one of eyeballs of a subject;
- an image data acquisition unit configured to acquire image data on the eyeball to which the detection light is applied;
- a position detector configured to detect, from the acquired image data, positional data of a pupil center representing a center of a pupil of the eyeball to which the detection light is applied and positional data of a corneal reflection center representing a center of corneal reflection;
- a point-of-regard detector configured to calculate, based on a position of the pupil center and a position of the corneal reflection center, positional data of a point of regard of the subject on a plane containing the display screen;
- and
- a controller configured to perform a calibration operation including displaying a target image in multiple positions on the display screen sequentially, setting, in the display screen, corresponding areas corresponding to the target images displayed on the display screen sequentially, and calculating positional data of the points of regard in display periods in which the respective target images are displayed;
- determine, with respect to each of the target images, whether the positional data of the point of regard that is calculated in the calibration operation is present within the corresponding area;
- when the number of valid target images that are the target images on each of which it is determined that the positional data of the point of regard is present within the corresponding area is at or above a threshold, output the positional data of the points of regard of the valid target images as calibration data;
- and, when the number of the valid target images is under the threshold, cause the calibration operation to be repeated.
7 more elements
A gaze detection method comprising:
- applying detection light to at least one of eyeballs of a subject;
- acquiring image data on the eyeball to which the detection light is applied;
- detecting, from the acquired image data, positional data of a pupil center representing a center of a pupil of the eyeball to which the detection light is applied and positional data of a corneal reflection center representing a center of corneal reflection;
- calculating, based on a position of the pupil center and a position of the corneal reflection center, positional data of a point of regard of the subject on a plane containing a display screen;
- and
- performing a calibration operation including displaying a target image in multiple positions on the display screen sequentially, setting, in the display screen, corresponding areas corresponding to the target images displayed on the display screen sequentially, and calculating positional data of the points of regard in display periods in which the respective target images are displayed;
- determining, with respect to each of the target images, whether the positional data of the point of regard that is calculated in the calibration operation is present within the corresponding area;
- when the number of valid target images that are the target images on each of which it is determined that the positional data of the point of regard is present within the corresponding area is at or above a threshold, outputting the positional data of the points of regard of the valid target images as calibration data;
- and, when the number of the valid target images is under the threshold, causing the calibration operation to be repeated.
6 more elements
A non-transitory computer readable recording medium storing therein a gaze detection program that causes a computer to execute a process including:
- applying detection light to at least one of eyeballs of a subject;
- acquiring image data on the eyeball to which the detection light is applied;
- detecting, from the acquired image data, positional data of a pupil center representing a center of a pupil of the eyeball to which the detection light is applied and positional data of a corneal reflection center representing a center of corneal reflection;
- calculating, based on a position of the pupil center and a position of the corneal reflection center, positional data of a point of regard of the subject on a plane containing a display screen;
- and
- performing a calibration operation including displaying a target image in multiple positions on the display screen sequentially, setting, in the display screen, corresponding areas corresponding to the target images displayed on the display screen sequentially, and calculating positional data of the points of regard in display periods in which the respective target images are displayed;
- determining, with respect to each of the target images, whether the positional data of the point of regard that is calculated in the calibration operation is present within the corresponding area;
- when the number of valid target images that are the target images on each of which it is determined that the positional data of the point of regard is present within the corresponding area is at or above a threshold, outputting the positional data of the points of regard of the valid target images as calibration data;
- and, when the number of the valid target images is under the threshold, causing the calibration operation to be repeated.
6 more elements
Dependencies are inferred from the claim text.