Back to results
US 9,961,258 B2Granted
Illumination system synchronized with image sensor
AssigneeFacebook, Inc.
InventorsMartin Henrik Tall, Sebastian Sztuk, Javier San Agustin Lopez, Rasmus Dahl
Life of this patent
Estimating the term…
Abstract
Eye tracking technology may be used in a wide range of lighting conditions and with many different and varying light levels. In some embodiments, an eye tracking device may employ active illumination (e.g., in the form of infrared light-emitting diodes (LEDs)). However, employing active illumination may reduce the battery life of the device. Under some circumstances (e.g., in a dark environment), the light intensity may be excessive and could be reduced, thereby reducing energy consumption and extending the battery life of the device. An algorithm may be used to adjust the duration of light in eye tracking systems that employ active illumination.
Claims16
A method comprising:
- identifying a region of interest of an image to be captured by a camera comprising a rolling shutter image sensor, the image captured by sequentially exposing lines of the image sensor starting with a first line of the image sensor, the region of interest beginning at a beginning line of the image sensor and ending at an ending line of the image sensor and corresponding to a region of the image depicting an eye;
- determining a delay period between a time at which the first line of the image sensor begins exposure and a time at which the ending line begins exposure;
- capturing a filtered infrared image by the camera, wherein capturing the filtered infrared image comprises:
- detecting a signal by a processor of a machine, the signal indicating a time at which the first line of the image sensor begins exposure, and
- responsive to the delay period elapsing from the detection of the signal, activating an infrared light source, and wherein the camera further comprises an infrared pass filter that passes light having wavelengths in a range between 800 nm and 900 nm and attenuates light having wavelengths outside the range;
- detecting one or more eye features in the region of interest of the filtered infrared image;
- and
- determining a point of regard based on the one or more eye features, the point of regard identifying a position on a display at which the eye is looking.
5 more elements
A system comprising:
- a memory that stores instructions;
- an infrared light source;
- and
- one or more processors, configured by the instructions to perform operations comprising:
- identifying a region of interest of an image to be captured by a camera comprising a rolling shutter image sensor, the image captured by sequentially exposing lines of the image sensor starting with a first line of the image sensor, the region of interest beginning at a beginning line of the image sensor and ending at an ending line of the image sensor and corresponding to a region of the image depicting an eye,
- determining a delay period between a time at which the first line begins exposure and a time at which the ending line of the image sensor begins exposure,
- capturing a filtered infrared image by the camera, wherein capturing the filtered infrared image comprises:
- detecting a signal indicating a time at which the first line of the image sensor begins exposure, and
- responsive to the delay period elapsing from the detection of the signal, activating the infrared light source, and wherein the camera further comprises an infrared pass filter that passes light having wavelengths in a range between 800 nm and 900 nm and attenuates light having wavelengths outside the range;
- detecting one or more eye features in the region of interest of the filtered infrared image;
- and
- determining a point of regard based on the one or more eye features, the point of regard identifying a position on a display at which the eye is looking.
9 more elements
A non-transitory machine-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
- identifying a region of interest of an image to be captured by a camera comprising a rolling shutter image sensor, the image captured by sequentially exposing lines of the image sensor starting with a first line of the image sensor, the region of interest beginning at a beginning line of the image sensor and ending at an ending line of the image sensor and corresponding to a region of the image depicting an eye;
- determining a delay period between a time at which the first line of the image sensor begins exposure and a time at which the ending line begins exposure;
- capturing a filtered infrared image by the camera, wherein capturing the filtered infrared image comprises:
- detecting a signal by a processor of a machine, the signal indicating a time at which the first line of the image sensor begins exposure, and
- responsive to the delay period elapsing from the detection of the signal, activating an infrared light source, and wherein the camera further comprises an infrared pass filter that passes light having wavelengths in a range between 800 nm and 900 nm and attenuates light having wavelengths outside the range;
- detecting one or more eye features in the region of interest of the filtered infrared image;
- and
- determining a point of regard based on the one or more eye features, the point of regard identifying a position on a display at which the eye is looking.
5 more elements
Dependencies are inferred from the claim text.