Detection device detecting gaze point of user, control method therefor, and storage medium storing control program therefor
AssigneeCanon Kabushiki Kaisha
InventorSaki Nakamichi
Life of this patent
Estimating the term…
Abstract
A detection device capable of detecting an actual pupil center with high accuracy even in an off-axis sight line detection. The detection device includes an obtainment unit configured to obtain an image of an eyeball of a user, a memory device that stores a set of instructions, and at least one processor that executes the set of instructions to: detect a position of a pupil center of the eyeball from an image obtained by the obtainment unit, detect a direction of a sight line based on the position of the pupil center, and detect a gaze point of the user based on the position of the pupil center and an angle formed between an optical axis of the obtainment unit and the direction of the sight line.
Claims10
A detection device comprising:
- an obtainment unit including a sight-line detection optical system and a sight line sensor, located on a lower side relative to a direction of a sight line of a user viewing a display;
- a memory device that stores a set of instructions;
- and
- at least one processor that executes the set of instructions to:
- obtain an image of an eyeball of the user by the obtainment unit;
- detect a position of an apparent pupil center of the eyeball from the image;
- detect the direction of the sight line of the user based on the position of the apparent pupil center;
- calculate a position of an actual pupil center of the eyeball of the user based on an incident vector of a light ray entering the position of the actual pupil center from a cornea of the eyeball, calculated using Snell's law, and on an angle between an optical axis of the sight-line detection optical system and the detected direction of the sight line;
- and
- calculate a correction value of the calculated position of the actual pupil center based on a pupil diameter of the eyeball and the angle between the optical axis of the sight-line detection optical system and the detected direction of the sight line.
A control method for a detection device equipped with an obtainment unit, the obtainment unit including a sight-line detection optical system and a sight line sensor, located on a lower side relative to a direction of a sight line of a user viewing a display, the control method comprising:
- obtaining an image of an eyeball of a user by the obtainment unit;
- detecting a position of an apparent pupil center of the eyeball from the image;
- detecting the direction of the sight line of the user based on the position of the apparent pupil center;
- calculating a position of an actual pupil center of the eyeball of the user based on an incident vector of a light ray entering the position of the actual pupil center from a cornea of the eyeball, calculated using Snell's law, and on an angle between an optical axis of the sight-line detection optical system and the detected direction of the sight line;
- and
- calculating a correction value of the calculated position of the actual pupil center based on a pupil diameter of the eyeball and the angle between the optical axis of the sight-line detection optical system and the detected direction of the sight line.
A non-transitory computer-readable storage medium storing a control program causing a computer to execute a control method for a detection device equipped with an obtainment unit, the obtainment unit including a sight-line detection optical system and a sight line sensor, located on a lower side relative to a direction of a sight line of a user viewing a display, the control method comprising:
- obtaining an image of an eyeball of a user by the obtainment unit;
- detecting a position of an apparent pupil center of the eyeball from the image;
- detecting the direction of the sight line of the user based on the position of the apparent pupil center;
- calculating a position of an actual pupil center of the eyeball of the user based on an incident vector of a light ray entering the position of the actual pupil center from a cornea of the eyeball, calculated using Snell's law, and on an angle between an optical axis of the sight-line detection optical system and the detected direction of the sight line;
- and
- calculating a correction value of the calculated position of the actual pupil center based on a pupil diameter of the eyeball and the angle between the optical axis of the sight-line detection optical system and the detected direction of the sight line.
Dependencies are inferred from the claim text.