# US 2012/0249825 A1 · Image editing apparatus, method for controlling image editing apparatus, and recording medium storing image editing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249825 A1
- Document ID: US20120249825A1
- Status: Published application
- Kind: A1
- Application number: 13/493,025
- Filed: 2012-06-11
- Published: 2012-10-04
- Earliest claimed: 2007-05-24
- Assignees: Olympus Imaging Corp.
- Inventors: Atsushi Maruyama; Satoshi Miyazaki; Masaomi Tomizawa; Takeshi Suzuki; Osamu Nonaka
- Web page: https://patentgrep.com/patent/US20120249825A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G06V 40/175: {Static expression}
- G06V 40/19: Sensors therefor
- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/63: by using electronic viewfinders
- H04N 23/673: {based on contrast or high frequency components of image signals, e.g. hill climbing method}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image editing apparatus includes an image input unit including an image pickup circuit which takes a picture of a subject to obtain an image of a subject. A face detection circuit detects an image of a face of the subject from the image obtained from the image input unit. A face expression detection circuit detects at least any one of direction and expression of the face of the subject, based on the image of the face detected by the face detection circuit. A pupil detection circuit detects images of pupils of the subject, based on the image of the face detected by the face detection circuit. A catch-light composition circuit composes different catch-lights on the images of the pupils detected by the pupil detection circuit, according to any one of the direction and expression of the face detected by the face expression detection circuit.

## Claims

### Claim 1

An image editing apparatus comprising:
an image input unit including an image pickup circuit which takes a picture of a subject to obtain an image of a subject;
a face detection circuit which detects an image of a face of the subject from the image obtained from the image input unit;
a face expression detection circuit which detects at least any one of direction and expression of the face of the subject, based on the image of the face detected by the face detection circuit;
a pupil detection circuit which detects images of pupils of the subject, based on the image of the face detected by the face detection circuit; and
a catch-light composition circuit which composes different catch-lights on the images of the pupils detected by the pupil detection circuit, according to any one of the direction and expression of the face detected by the face expression detection circuit.

### Claim 2 (depends on 1)

The image editing apparatus according to claim 1, wherein the catch-lights are different in at least any one of shapes, sizes, colors and composing positions, according to any one of the direction and expression of the face.

### Claim 3 (depends on 2)

The image editing apparatus according to claim 2, wherein the pupil detection circuit detects catch-lights in the images of the pupils, and the catch-light composition circuit eliminates the catch-lights in the images of the pupils from the images of the pupils.

### Claim 4 (depends on 3)

The image editing apparatus according to claim 3, wherein the catch-light composition circuit composes the catch-lights after reducing the sizes to fit within the pupils.

### Claim 5 (depends on 4)

The image editing apparatus according to claim 4, wherein the catch-light composition circuit composes the catch-lights in the upper parts of the images of the pupils when the face has wide opened eyes, and composes the catch-lights in the lower parts of the images of the pupils when the face has staring eyes.

### Claim 6 (depends on 1)

The image editing apparatus according to claim 1, further comprising an eye detection circuit which detects a direction of the eyes of the subject, based on the image of the face detected by the face detection circuit,
wherein the catch-light composition circuit composes different catch-lights according to at least any one of the direction and expression of the face detected by the face expression detection circuit, and the direction of the eyes detected by the eye detection circuit.

### Claim 7 (depends on 6)

The image editing apparatus according to claim 6, wherein the catch-lights are different in any one of shapes, sizes, colors and composing positions, according to any one of the direction and expression of the face, and the direction of the eyes.

### Claim 8 (depends on 7)

The image editing apparatus according to claim 7, wherein the pupil detection circuit detects catch-lights in the images of the pupils, and the catch-light composition circuit eliminates the catch-lights in the images of the pupils from the images of the pupils.

### Claim 9 (depends on 8)

The image editing apparatus according to claim 8, wherein the catch-light composition circuit composes the catch-lights after reducing the sizes to fit within the pupils.

### Claim 10 (depends on 9)

The image editing apparatus according to claim 9, wherein the catch-light composition circuit composes the catch-lights in the upper parts of the images of the pupils when the face has wide opened eyes, and composes the catch-lights in the lower parts of the images of the pupils when the face has staring eyes.

### Claim 11

A method of controlling an apparatus for editing an image obtained by taking a picture of a subject, comprising:
detecting an image of a face of the subject from the obtained image;
detecting at least any one of the direction and expression of the face of the subject, based on the detected image of the face;
detecting images of the pupils of the subject, based on the detected image of the face; and
composing different catch-lights on the detected images of the pupils, according to any one of the detected direction and expression of the face.

### Claim 12 (depends on 11)

The controlling method according to claim 11, wherein the catch-lights are different in at least any one of shapes, sizes, colors and composing positions, according to any one of the direction and expression of the face.

### Claim 13 (depends on 12)

The control method according to claim 12, wherein the detecting the images of the pupils includes detecting catch-lights in the images of the pupils, and
the composing catch-lights includes eliminating the catch-lights in the images of the pupils from the images of the pupils.

### Claim 14 (depends on 13)

The control method according to claim 13, wherein the composing catch-lights includes composing the catch-lights after reducing the sizes to fit within the pupils.

### Claim 15 (depends on 14)

The control method according to claim 14, wherein the composing catch-lights composes the catch-lights in the upper parts of the images of the pupils when the face has wide opened eyes, and composes the catch-lights in the lower parts of the images of the pupils when the face has staring eyes.

### Claim 16

A method of controlling an apparatus for editing an image obtained by taking a picture of a subject, comprising:
detecting an image of a face of the subject from the obtained image;
detecting at least any one of the direction and expression of the face of the subject, based on the detected image of the face;
detecting a direction of the eyes of the subject, based on the detected image of the face;
detecting images of the pupils of the subject, based on the detected image of the face; and
composing catch-lights on the detected images of the pupils, according to any one of the detected direction and expression of the face, and the direction of the eyes.

### Claim 17 (depends on 16)

The controlling method according to claim 16, wherein the catch-lights are different in at least any one of shapes, sizes, colors and composing positions, according to any one of the direction and expression of the face, and the direction of the eyes.

### Claim 18

A computer readable recording medium recording a program for editing an image obtained by taking a picture of a subject, the program enabling the computer to perform the following:
a function of detecting an image of a face of the subject from the obtained image;
a function of detecting images of the pupils of the subject, based on the detected image of the face; and
a function of composing different catch-lights on the detected images of the pupils, according to any one of the detected direction and expression of the face.

### Claim 19 (depends on 18)

The recording medium according to claim 18, wherein the catch-lights are different in at least any one of shapes, sizes, colors and composing positions, according to any one of the direction and expression of the face.

### Claim 20 (depends on 18)

The recording medium according to claim 18, wherein the program enables the computer to perform the following:
a function of detecting a direction of the eyes of the subject, based on the detected image of the face; and
a function of composing different catch-lights according to at least any one of the detected direction and expression of the face, and the direction of the eyes.

### Claim 21 (depends on 18)

The recording medium according to claim 18, wherein the catch-lights are different in at least any one of shapes, sizes, colors and composing positions, according to any one of the direction and expression of the face, and the direction of the eyes.

### Claim 22

An image editing apparatus comprising:
an image input unit including an image pickup circuit which takes a picture of a subject to obtain an image of a subject;
a detection circuit which detects an image of a face of the subject from the image obtained from the image input unit; detects at least any one of direction and expression of the face of the subject, based on the detected image of the face; and detects images of the pupils of the subject, based on the detected image of the face; and
a catch-light composition unit which composes different catch-lights on the detected images of the pupils, according to any one of the direction and expression of the detected face.

### Claim 23 (depends on 22)

The image editing apparatus according to claim 22, wherein the catch-light are different in at least any one of shapes, sizes, colors and composing positions, according to any one of the direction and expression of the face.

### Claim 24 (depends on 22)

The image editing apparatus according to claim 22, further comprising an eye detection unit which detects a direction of the eyes of the subject based on the image of the face detected by the detection unit,
wherein the catch-light composition unit composes different catch-lights according to at least any one of the direction and expression of the face detected by the face expression detection unit, and the direction of the eyes detected by the eye detection unit.

### Claim 25 (depends on 24)

The image editing apparatus according to claim 24, wherein the catch-light are different in at least any one of shapes, sizes, colors and composing positions, according to any one of the direction and expression of the face, and the direction of the eyes.
