# US 8,279,301 B2 · Red-eye filter method and apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,279,301 B2
- Document ID: US8279301B2
- Status: Granted
- Kind: B2
- Application number: 13/026,303
- Filed: 2011-02-14
- Published: 2011-06-09
- Granted: 2012-10-02
- Earliest claimed: 1997-10-09
- Assignees: DigitalOptics Corporation Europe Limited
- Inventors: Eran Steinberg; Yury Prilutsky; Peter Corcoran; Petronel Bigioi; Michael J. DeLuca
- Web page: https://patentgrep.com/patent/US8279301B2

## CPC

- H04N 1/62: Retouching, i.e. modification of isolated colours only or in isolated picture areas only
- G06T 5/94: based on local image properties, e.g. for local contrast enhancement
- G06T 7/90: Determination of colour characteristics
- G06V 40/162: {using pixel segmentation or colour matching}
- G06V 40/165: {using facial parts and geometric relationships}
- G06V 40/193: {Preprocessing; Feature extraction}
- H04N 1/6086: {by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature}
- H04N 1/624: {Red-eye correction (control of camera based on recognised facial parts H04N23/611)}
- H04N 9/70: for colour killing
- H04N 23/63: by using electronic viewfinders
- H04N 23/74: by influencing the scene brightness using illuminating means
- G06T 2207/10024: Color image
- G06T 2207/30201: Face
- G06T 2207/30216: Redeye defect
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A digital image acquisition system having no photographic film, such as a digital camera, has a flash unit for providing illumination during image capture and a red-eye filter for detecting a region within a captured image indicative of a red-eye phenomenon, the detection being based upon a comparison of the captured image and a reference image of nominally the same scene taken without flash. In the embodiment the reference image is a preview image of lower pixel resolution than the captured image, the filter matching the pixel resolutions of the captured and reference images by up-sampling the preview image and/or sub-sampling the captured image. The filter also aligns at least portions of the captured image and reference image prior to comparison to allow for, e.g. movement in the subject.

## Claims

### Claim 1

A portable digital camera device having no photographic film, comprising:
(a) an integral flash for providing illumination during image acquisition;
(b) a digital image capturing apparatus including one or more image sensors for capturing a main image including a region of interest including a face, and for acquiring one or more reference images at least approximately of said same scene as the main image including said region of interest;
(c) a focusing means is configured to determine distance from the focusing means to the face and to focus the face on one or more image sensor;
(d) one or more filters for aligning the one or more reference images with the main image, and for estimating camera or object movement, or both, in one or more intervals between capture of the main and reference images;
(e) a dedicated hardware subsystem which is provided reference image data directly from at least one of the one or more image sensors;
(f) a main system memory which receives raw image data and metadata as implemented by the dedicated hardware subsystem; and
(g) wherein the main system memory is configured to receive metadata that comprises one or more camera or object movement estimates associated with the main image.

### Claim 2 (depends on 1)

The portable digital camera device of claim 1, wherein the one or more reference images comprise a relatively low resolution compared with the main image.

### Claim 3 (depends on 2)

The portable digital camera device of claim 2, further comprising a subsampling module, and wherein the one or more relatively low resolution reference images comprise a subsample resolution representation of the main image.

### Claim 4 (depends on 3)

The portable digital camera device of claim 3, wherein the subsampling module is configured for changing a degree of subsampling.

### Claim 5 (depends on 4)

The portable digital camera device of claim 4, wherein said changing the degree of said subsampling is determined empirically.

### Claim 6 (depends on 4)

The portable digital camera device of claim 4, wherein said changing the degree of said subsampling is determined based on a size of said image.

### Claim 7 (depends on 4)

The portable digital camera device of claim 4, wherein said changing the degree of said subsampling is determined based on a region size.

### Claim 8 (depends on 4)

The portable digital camera device of claim 4, wherein said changing the degree of said subsampling is determined based on a complexity of calculation for said filter.

### Claim 9 (depends on 3)

The portable digital camera device of claim 3, wherein said subsample resolution representation is determined using spline interpolation.

### Claim 10 (depends on 3)

The portable digital camera device of claim 3, wherein said subsample resolution representation is determined using bi-cubic interpolation.

### Claim 11 (depends on 1)

The portable digital camera of claim 1, wherein one or more reference images comprise at least one precapture image.

### Claim 12 (depends on 11)

The portable digital camera of claim 11, wherein the precapture image is captured just before the main image is captured.

### Claim 13 (depends on 1)

The portable digital camera of claim 1, further comprising one or more further filters for correcting exposure, focus or composition of the main image, or combinations thereof, based on analysis of the reference image.

### Claim 14

A method of correcting an image defect within a digital image, comprising:
using a processor;
acquiring a main image and one or more reference images of at least approximately the same scene as the main image with the main image sensor;
identifying a region of interest including a face within at least one of the one or more reference images;
determining the distance between a focusing means and the face;
focusing the face on the main image sensor;
aligning the at least one reference image with the main image;
estimating camera or object movement, or both, in one or more intervals between capture of the main and reference images;
providing reference image data directly from the at least one sensor to a dedicated hardware subsystem;
receiving raw image data at a main image memory, along with metadata as implemented by the dedicated hardware subsystem; and
wherein the metadata comprises one or more camera of object movement estimates associated with the main image.

### Claim 15 (depends on 14)

The method of claim 14, wherein the one or more reference images comprise a relatively low resolution compared with the main image.

### Claim 16 (depends on 15)

The method of claim 15, wherein the one or more relatively low resolution reference images comprise a subsample resolution representation of the main image.

### Claim 17 (depends on 16)

The method of claim 16, further comprising changing a degree of subsampling of said subsample resolution representation.

### Claim 18 (depends on 17)

The method of claim 17, further comprising determining the degree of said subsampling is empirically.

### Claim 19 (depends on 17)

The method of claim 17, further comprising determining the degree of said subsampling based on a size of said image.

### Claim 20 (depends on 17)

The method of claim 17, further comprising determining the degree of said subsampling based on a region size.

### Claim 21 (depends on 17)

The method of claim 17, further comprising determining the degree of said subsampling based on a complexity of calculation for said filter.

### Claim 22 (depends on 16)

The method of claim 16, further comprising determining said subsample resolution representation using spline interpolation.

### Claim 23 (depends on 16)

The method of claim 16, further comprising determining said subsample resolution representation using bi-cubic interpolation.

### Claim 24 (depends on 15)

The method of claim 15, further comprising capturing the one or more relatively low resolution reference images before capturing the main image.

### Claim 25 (depends on 14)

The method of claim 14, further comprising correcting exposure, focus or composition of the main image, or combinations thereof, based on analysis of the at least one reference imager.

### Claim 26

One or more digital storage media having code embodied therein for programming one or more processors of a portable digital camera that includes at least one image sensor to perform a method of correcting an image defect within a digital image, wherein the method comprises:
acquiring a main image and one or more reference images of at least approximately the same scene as the main image with the main image sensor;
identifying a region of interest including a face within at least one of the one or more reference images;
determining the distance between a focusing means and the face;
focusing the face on the main image sensor;
aligning the at least one reference image with the main image; estimating camera or object movement, or both, in one or more intervals between capture of the main and reference images;
providing reference image data directly from the at least one sensor to a dedicated hardware subsystem;
receiving raw image data at a main image memory, along with metadata as implemented by the dedicated hardware subsystem; and
wherein the metadata comprises one or more camera of object movement estimates associated with the main image.

### Claim 27 (depends on 26)

The one or more storage media of claim 26, wherein the one or more reference images comprise a relatively low resolution compared with the main image.

### Claim 28 (depends on 27)

The one or more storage media of claim 27, wherein the one or more relatively low resolution reference images comprise a subsample resolution representation of the main image.

### Claim 29 (depends on 28)

The one or more storage media of claim 28, wherein the method further comprises changing a degree of subsampling of said subsample resolution representation.

### Claim 30 (depends on 29)

The one or more storage media of claim 29, wherein the method further comprises determining the degree of said subsampling is empirically.

### Claim 31 (depends on 29)

The one or more storage media of claim 29, wherein the method further comprises determining the degree of said subsampling based on a size of said image.

### Claim 32 (depends on 29)

The one or more storage media of claim 29, wherein the method further comprises determining the degree of said subsampling based on a region size.

### Claim 33 (depends on 29)

The one or more storage media of claim 29, wherein the method further comprises determining the degree of said subsampling based on a complexity of calculation for said filter.

### Claim 34 (depends on 28)

The one or more storage media of claim 28, wherein the method further comprises determining said subsample resolution representation using spline interpolation.

### Claim 35 (depends on 28)

The one or more storage media of claim 28, wherein the method further comprises determining said subsample resolution representation using bi-cubic interpolation.

### Claim 36 (depends on 27)

The one or more storage media of claim 27, wherein the method further comprises capturing the one or more relatively low resolution reference images before capturing the main image.

### Claim 37 (depends on 26)

The one or more storage media of claim 26, wherein the method further comprises correcting exposure, focus or composition of the main image, or combinations thereof, based on analysis of the at least one reference imager.
