Terminal device and line of sight detection method
AssigneeFujitsu Limited
InventorsShanshan Yu, Satoshi Nakashima
Life of this patent
Estimating the term…
Abstract
A terminal device includes, a processor; and a memory which stores a plurality of instructions, which when executed by the processor, cause the processor to execute, obtaining information that indicates a state of an imaging unit when photographing a subject; determining whether an image photographed by the imaging unit includes blurriness due to shaking of the imaging unit based on the obtained information; and using an image determined as not including blurriness in the determining to detect a line of sight of the photographed subject.
Claims10
A terminal device comprising:
- a processor;
- and
- a memory which stores a plurality of instructions, which when executed by the processor, cause the processor to execute,
- obtaining information that indicates each state of an imaging unit in each timing of photographing a subject;
- determining whether each image photographed by the imaging unit includes blurriness based on the obtained information;
- detecting a region including an eye in a first image and detecting a line of sight of the photographed subject in the detected region when the first image is determined as not including blurriness;
- when a second image photographed after the first image is determined as including blurriness, detecting a region including an eye in the second image based on a first corresponding region in an image taken before the second image, the first corresponding region corresponding to the detected region in the first image;
- and
- when a third image photographed after the first image is determined as not including blurriness, detecting a region including an eye in the third image based on a second corresponding region in an image taken before the third image and detecting a line of sight of the photographed subject in the detected region based on the detected region in the third image, the second corresponding region corresponding to the detected region in the first image.
A line of sight detection method comprising:
- obtaining information that indicates each state of an imaging unit in each timing of photographing a subject;
- determining, by a computer processor, whether each image photographed by the imaging unit includes blurriness based on the obtained information;
- detecting a region including an eye in a first image and detecting a line of sight of the photographed subject in the detected region when the first image is determined as not including blurriness;
- when a second image photographed after the first image is determined as including blurriness, detecting a region including an eye in the second image based on a first corresponding region in an image taken before the second image, the first corresponding region corresponding to the detected region in the first image;
- and
- when a third image photographed after the first image is determined as not including blurriness, detecting a region including an eye in the third image based on a second corresponding region in an image taken before the third image and detecting a line of sight of the photographed subject in the detected region based on the detected region in the third image, the second corresponding region corresponding to the detected region in the first image.
A non-transitory computer-readable storage medium storing a line of sight detection program that causes a computer to execute a process comprising:
- obtaining information that indicates each state of an imaging unit in each timing of photographing a subject;
- determining whether each image photographed by the imaging unit includes blurriness based on the obtained information;
- detecting a region including an eye in a first image and detecting a line of sight of the photographed subject in the detected region when the first image is determined as not including blurriness;
- when a second image photographed after the first image is determined as including blurriness, detecting a region including an eye in the second image based on a first corresponding region in an image taken before the second image, the first corresponding region corresponding to the detected region in the first image;
- and
- when a third image photographed after the first image is determined as not including blurriness, detecting a region including an eye in the third image based on a second corresponding region in an image taken before the third image and detecting a line of sight of the photographed subject in the detected region based on the detected region in the third image, the second corresponding region corresponding to the detected region in the first image.
Dependencies are inferred from the claim text.