Back to results
US 12,733,852 B2Granted
Method and apparatus for analyzing eye movement
AssigneesIndustry Academic Cooperation Foundation, Hallym University, Neuroears Co., Ltd.
InventorsSung Kwang Hong, Eun-Cheon Lim, Changje Cho
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to an eye movement analysis method performed in an eye movement analysis apparatus, the eye movement analysis method including: receiving a facial image; obtaining an eye image that corresponds to a part of an eye that determines a midpoint position of the eye in the facial image; analyzing movement of the eye based on movement of the midpoint position in the facial image; and visually displaying a direction of the movement of the eye.
Claims10
An eye movement analysis method performed in an eye movement analysis apparatus, the eye movement analysis method comprising:
- (a) receiving a facial image;
- (b) determining a midpoint position of an eye in the facial image and obtaining an eye image that corresponds to the eye;
- (c) analyzing movement of the eye based on movement of the midpoint position in the eye image;
- and
- (d) visually displaying a direction of the movement of the eye, wherein step (c) includes:
- detecting blinking of the eye in the eye image using an artificial intelligence model and classifying the blinking of the eye into an open state, a closing state, and a closed state;
- extracting images classified as the open state and the closing state, among classifications of the blinking of the eye, from the eye image;
- predicting a midpoint position of the closing state, among the classifications of the blinking of the eye, in the eye image by restoring a part of the eye that is covered by an eyelid;
- interpolating a midpoint position of the closed state, among the classifications of the blinking of the eye, in the eye image based on a midpoint position of the closing state prior to the closed state and a midpoint position of the open state after the closed state;
- detecting an eye movement consisting of a slow component and a quick component among vertical, horizontal, and rotary movements of the eye from the extracted image;
- and
- detecting an eye movement consisting of only the slow component or an eye movement consisting of only the quick component among the vertical, horizontal, and rotary movements of the eye from the extracted image, and
- the rotary movement is defined as a movement in which the vertical and horizontal movements of the eye simultaneously occur in the extracted image.
10 more elements
An eye movement analysis apparatus comprising:
- a facial image receiver configured to receive a facial image;
- an eye image obtainer configured to obtain an eye image that corresponds to a part of an eye that determines a midpoint position of the eye in the facial image;
- an eye movement analyzer configured to analyze movement of the eye based on movement of the midpoint position in the eye image;
- and
- an analysis result outputter configured to visually display a direction of the movement of the eye, wherein
- the eye movement analyzer is further configured to:
- detect blinking of the eye in the eye image using an artificial intelligence model and classifying the blinking of the eye into an open state, a closing state, and a closed state;
- extract images classified as the open state and the closing state, among classifications of the blinking of the eye, from the eye image;
- predict a midpoint position of the closing state, among the classifications of the blinking of the eye, in the eye image by restoring a part of the eye that is covered by an eyelid;
- interpolate a midpoint position of the closed state, among the classifications of the blinking of the eye, in the eye image based on a midpoint position of the closing state prior to the closed state and a midpoint position of the open state after the closed state;
- detect an eye movement consisting of a slow component and a quick component among vertical, horizontal, and rotary movements of the eye from the extracted image;
- and
- detect an eye movement consisting of only the slow component or an eye movement consisting of only the quick component among the vertical, horizontal, and rotary movements of the eye from the extracted image, and
- the rotary movement is defined as a movement in which the vertical and horizontal movements of the eye simultaneously occur in the extracted image.
11 more elements
Dependencies are inferred from the claim text.