Face tracking for controlling imaging parameters
AssigneeTessera Technologies Ireland Limited
InventorsPeter Corcoran, Eran Steinberg, Petronel Bigioi
Life of this patent
Estimating the term…
Abstract
A method of tracking faces in an image stream with a digital image acquisition device includes receiving images from an image stream including faces, calculating corresponding integral images, and applying different subsets of face detection rectangles to the integral images to provide sets of candidate regions. The different subsets include candidate face regions of different sizes and/or locations within the images. The different candidate face regions from different images of the image stream are each tracked.
Claims57
A method of acquiring an improved image based on tracking a face in a preview image stream with a digital image acquisition device, comprising programming a processor to perform the following:
- determining an initial location or size, or both, of a face in a first preview image of a preview image stream;
- determining a subsequent location or size, or both, for the same face in a subsequent preview image;
- based on the initial and subsequent locations or sizes, or combinations thereof, predicting a region of a third preview image which has just been acquired within which region the same face is expected to occur again;
- and
- analyzing one or more characteristics of said region of said third preview image;
- based on the analyzing of the one or more characteristics of said region, adjusting one or more acquisition parameters of a main acquired image.
A method of tracking faces in a preview image stream with a digital image acquisition device, comprising programming a processor to perform the following:
- receiving digital images from a preview image stream including faces;
- calculating corresponding integral images for the digital images;
- applying different subsets of face detection windows to different subsets of the integral images to provide different sets of candidate face regions of different sizes or locations or both within the digital images;
- and
- tracking each of the different candidate face regions within further images of the image stream or a main target image with which said preview image stream is utilized, or both.
A digital image acquisition device, comprising a lens, an image sensor, a processor, and a processor-readable memory having digital code embedded therein for programming the processor to perform a method of tracking faces in an image stream acquired by the device, wherein the method comprises:
- determining an initial location or size, or both, of a face in a first preview image of a preview image stream;
- determining a subsequent location or size, or both, for the same face in a subsequent preview image;
- based on the initial and subsequent locations or sizes, or combinations thereof, predicting a region of a third preview image which has just been acquired within which region the same face is expected to occur again;
- and
- analyzing one or more characteristics of said region of said third preview image;
- based on the analyzing of the one or more characteristics of said region, adjusting one or more acquisition parameters of a main acquired image.
A digital image acquisition device, comprising a lens, an image sensor, a processor, and a processor-readable memory having digital code embedded therein for programming the processor to perform a method of tracking faces in a preview image stream acquired by the device, wherein the method comprises:
- receiving digital images from a preview image stream including faces;
- calculating corresponding integral images for the digital images;
- applying different subsets of face detection windows to different subsets of the integral images to provide different sets of candidate face regions of different sizes or locations or both within the digital images;
- and
- tracking each of the different candidate face regions within further images of the image stream or a main target image with which the preview image stream is utilized, or both.
One or more non-transitory computer-readable storage devices having computer-readable code embedded therein for programming one or more processors to perform a method of tracking faces in an image stream acquired with a digital image acquisition device, wherein the method comprises:
- determining an initial location or size, or both, of a face in a first preview image of a preview image stream;
- determining a subsequent location or size, or both, for the same face in a subsequent preview image;
- based on the initial and subsequent locations or sizes, or combinations thereof, predicting a region of a third preview image which has just been acquired within which region the same face is expected to occur again;
- and
- analyzing one or more characteristics of said region of said third preview image;
- based on the analyzing of the one or more characteristics of said region, adjusting one or more acquisition parameters of a main acquired image.
One or more non-transitory computer-readable storage devices having computer-readable code embedded therein for programming one or more processors to perform a method of tracking faces in an image stream acquired with a digital image acquisition device, wherein the method comprises:
- receiving a first image from an image stream including one or more face regions;
- calculating a corresponding first integral image for at least a portion of the first image or a sub-sampled version or a combination thereof;
- applying a first subset of face detection windows to the first integral image to provide a first set of candidate face regions each having a given size and a respective location;
- receiving a second image from the image stream including the one or more face regions, the second image comprising substantially a same scene as the first image;
- calculating a corresponding second integral image for at least a portion of the second image or a sub-sampled version or a combination thereof;
- applying a second subset of face detection windows to the second integral image to provide a second set of candidate face regions each having a given size and a respective location, the second subset comprising different face detection windows than the first subset, and the first and second subsets comprise candidate face regions of different sizes or locations or both;
- and
- tracking within further images said candidate face regions of different sizes or locations, or both, of said first and second images from said image stream.
One or more non-transitory computer-readable storage devices having computer-readable code embedded therein for programming one or more processors to perform a method of tracking faces in a preview image stream acquired with a digital image acquisition device, wherein the method comprises:
- receiving digital images from a preview image stream including one or more faces;
- calculating corresponding integral images for the digital images;
- applying different subsets of face detection windows to different subsets of the integral images to provide different sets of candidate face regions of different sizes or locations or both within the digital images;
- and
- tracking each of the different candidate face regions within further images of the image stream or a main target image with which the preview image stream is utilized, or both.
Dependencies are inferred from the claim text.