# US 2001/0022853 A1 · Image processing method, image processing device, recording medium, and transmission medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0022853 A1
- Document ID: US20010022853A1
- Status: Published application
- Kind: A1
- Application number: 09/742,213
- Filed: 2000-12-22
- Published: 2001-09-20
- Earliest claimed: 1999-12-24
- Assignees: Fuji Photo Film Co., Ltd.
- Inventors: Naoki Takaoka
- Web page: https://patentgrep.com/patent/US20010022853A1

## CPC

- G06T 5/77: Retouching; Inpainting; Scratch removal
- G06T 7/90: Determination of colour characteristics
- H04N 1/62: Retouching, i.e. modification of isolated colours only or in isolated picture areas only
- H04N 1/624: {Red-eye correction (control of camera based on recognised facial parts H04N23/611)}
- G06T 2207/10024: Color image
- G06T 2207/30216: Redeye defect
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing method and image processing device extracting, from an image, a pupil region in which unsatisfactory color tone has arisen on the image; determining a target value of a characteristic amount of the pupil, on the basis of a characteristic amount of a region including a majority of the image, a characteristic amount of a region in a vicinity of the pupil region, and a characteristic amount of the pupil; and correcting a value of each pixel within the pupil region, such that the characteristic amount of the pupil region in which unsatisfactory color tone has arisen is substantially equal to the target value, are provided in order that unsatisfactory color tone of a pupil region within an image can be corrected such that the image can be finished with a natural feel.

## Claims

### Claim 1

An image processing method comprising the steps of:
extracting, from an image, a pupil region which corresponds to a pupil of a person and in which unsatisfactory color tone has arisen on the image;
determining a target value of a characteristic amount of the pupil region in which unsatisfactory color tone has arisen, on the basis of a characteristic amount of a region including a majority of the image, a characteristic amount of a region in a vicinity of the pupil region in which unsatisfactory color tone has arisen, and a characteristic amount of the pupil region in which unsatisfactory color tone has arisen; and
correcting a value of each pixel within the pupil region in which unsatisfactory color tone has arisen, such that the characteristic amount of the pupil region in which unsatisfactory color tone has arisen is substantially equal to the target value.

### Claim 2 (depends on 1)

The image processing method of claim 1, wherein as the characteristic amount of the region including the majority of the image, the characteristic amount of the region in the vicinity of the pupil region in which unsatisfactory color tone has arisen, and the characteristic amount of the pupil region in which unsatisfactory color tone has arisen, at least one of an average value of brightness, an average value of saturation, an average value of hue, and a value corresponding to a minimum value of brightness is used, and as the target value of the characteristic amount of the pupil region in which unsatisfactory color tone has arisen, a target value of the average value of brightness, a target value of the average value of saturation, and a target value of the average value of hue are determined.

### Claim 3 (depends on 2)

The image processing method of claim 2, wherein the target value of the average value of brightness of the pupil region in which unsatisfactory color tone has arisen is determined so as to be less than or equal to the average value of brightness in the region including the majority of the image, and so as to be less than or equal to the value corresponding to the minimum value of brightness of the region in the vicinity of the pupil region in which unsatisfactory color tone has arisen, and so as to be greater than or equal to the value corresponding to the minimum value of brightness of the region including the majority of the image.

### Claim 4 (depends on 2)

The image processing method of claim 2, wherein the target value of the average value of the saturation of the pupil region in which unsatisfactory color tone has arisen is determined so as to be less than or equal to the average value of saturation of the region in the vicinity of the pupil region in which unsatisfactory color tone has arisen and such that the saturation is not zero.

### Claim 5 (depends on 2)

The image processing method according to claim 2, wherein the target value of the average value of the hue of the pupil region in which unsatisfactory color tone has arisen is determined so as to be substantially equal to the average value of hue of the region in the vicinity of the pupil region in which unsatisfactory color tone has arisen.

### Claim 6

An image processing method comprising the steps of:
extracting, from an image, a pupil region which corresponds to a pupil of a person and in which unsatisfactory color tone has arisen on the image;
in a case in which a pair of pupil regions corresponding to a pair of pupils of the person exist in the image and unsatisfactory color tone has arisen in at least one pupil region of the pair of pupil regions, determining a target value of a characteristic amount of the pupil region in which unsatisfactory color tone has arisen such that characteristic amounts of the pair of pupil regions become substantially a same value; and
correcting a value of each pixel in the pupil region in which unsatisfactory color tone has arisen, such that the characteristic amount of the pupil region in which unsatisfactory color tone has arisen is substantially equal to the determined target value.

### Claim 7

An image processing device comprising:
an extracting device for extracting, from an image, a pupil region which corresponds to a pupil of a person and in which unsatisfactory color tone has arisen on the image;
a first determining device for determining a target value of a characteristic amount of the pupil region in which unsatisfactory color tone has arisen, on the basis of a characteristic amount of a region including a majority of the image, a characteristic amount of a region in a vicinity of the pupil region in which unsatisfactory color tone has arisen, and a characteristic amount of the pupil region in which unsatisfactory color tone has arisen; and
a correcting device for correcting a value of each pixel in the pupil region in which unsatisfactory color tone has arisen, such that the characteristic amount of the pupil region in which unsatisfactory color tone has arisen is substantially equal to the target value.

### Claim 8

An image processing device comprising:
an extracting device for extracting, from an image, a pupil region which corresponds to a pupil of a person and in which unsatisfactory color tone has arisen on the image;
a second determining device for, in a case in which a pair of pupil regions corresponding to a pair of pupils of the person exist in the image and unsatisfactory color tone has arisen in at least one pupil region of the pair of pupil regions, determining a target value of a characteristic amount of the pupil region in which unsatisfactory color tone has arisen such that characteristic amounts of the pair of pupil regions become substantially a same value; and
a correcting device for correcting a value of each pixel in the pupil region in which unsatisfactory color tone has arisen, such that the characteristic amount of the pupil region in which unsatisfactory color tone has arisen is substantially equal to the target value.

### Claim 9

A recording medium on which is recorded a program for executing, at a computer, a processing comprising:
a first step of extracting, from an image, a pupil region which corresponds to a pupil of a person and in which unsatisfactory color tone has arisen on the image;
a second step of determining a target value of a characteristic amount of the pupil region in which unsatisfactory color tone has arisen, on the basis of a characteristic amount of a region including a majority of the image, a characteristic amount of a region in a vicinity of the pupil region in which unsatisfactory color tone has arisen, and a characteristic amount of the pupil region in which unsatisfactory color tone has arisen; and
a third step of correcting a value of each pixel within the pupil region in which the unsatisfactory color tone has arisen, such that the characteristic amount of the pupil region in which the unsatisfactory color tone has arisen is substantially equal to the target value.

### Claim 10

A recording medium on which is recorded a program for executing, at a computer, a processing comprising:
a first step of extracting, from an image, a pupil region which corresponds to a pupil of a person and in which unsatisfactory color tone has arisen on the image;
a second step of, in a case in which a pair of pupil regions corresponding to a pair of pupils of the person exist in the image and unsatisfactory color tone has arisen in at least one pupil region of the pair of pupil regions, determining a target value of a characteristic amount for the pupil region in which the unsatisfactory color tone has arisen such that characteristic amounts of the pair of pupil regions become substantially a same value; and
a third step of correcting a value of each pixel in the pupil region in which unsatisfactory color tone has arisen, such that the characteristic amount of the pupil region in which unsatisfactory color tone has arisen is substantially equal to the target value.

### Claim 11

A transmission medium for transmitting a program for executing, at a computer, a processing comprising:
a first step of extracting, from an image, a pupil region which corresponds to a pupil of a person and in which unsatisfactory color tone has arisen on the image;
a second step of determining a target value of a characteristic amount of the pupil region in which unsatisfactory color tone has arisen, on the basis of a characteristic amount of a region including a majority of the image, a characteristic amount of a region in a vicinity of the pupil region in which unsatisfactory color tone has arisen, and a characteristic amount of the pupil region in which unsatisfactory color tone has arisen; and
a third step of correcting a value of each pixel within the pupil region in which unsatisfactory color tone has arisen, such that the characteristic amount of the pupil region in which unsatisfactory color tone has arisen is substantially equal to the target value.

### Claim 12

A transmission medium for transmitting a program for executing, at a computer, a processing comprising:
a first step of extracting, from an image, a pupil region which corresponds to a pupil of a person and in which unsatisfactory color tone has arisen on the image;
a second step of, in a case in which a pair of pupil regions corresponding to a pair of pupils of the person exist in the image and unsatisfactory color tone has arisen in at least one pupil region of the pair of pupil regions, determining a target value of a characteristic amount for the pupil region in which the unsatisfactory color tone has arisen such that characteristic amounts of the pair of pupil regions become substantially a same value; and
a third step of correcting a value of each pixel in the pupil region in which unsatisfactory color tone has arisen, such that the characteristic amount of the pupil region in which unsatisfactory color tone has arisen is substantially equal to the determined target value.

### Claim 13 (depends on 4)

The image processing method of claim 4, wherein the target value of the average value of the saturation of the pupil region in which unsatisfactory color tone has arisen is determined so as to a half of the average value of saturation of the region in the vicinity of the pupil region in which unsatisfactory color tone has arisen.
