# US 2019/0174073 A1 · Image processing apparatus that generates moving image using shooting image, image pickup apparatus, image processing method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0174073 A1
- Document ID: US20190174073A1
- Status: Published application
- Kind: A1
- Application number: 16/205,402
- Filed: 2018-11-30
- Published: 2019-06-06
- Earliest claimed: 2017-12-05
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Kenji Onuki
- Web page: https://patentgrep.com/patent/US20190174073A1

## CPC

- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- H04N 9/646: {for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters}
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/95: Computational photography systems, e.g. light-field imaging systems
- H04N 25/705: Pixels for depth measurement, e.g. RGBZ
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing apparatus which is capable of obtaining a moving image having a special effect suitable for a scene while suppressing a load of a user. In the image processing apparatus, an acquisition unit acquires a first image generated by shooting, a division unit divides the first image into two or more regions according to a distribution of a distance of each subject, at the time of shooting, included in the first image, a detection unit detects one of the divided regions as a high brightness region where high brightness pixels exist, a first generation unit performs correction of the first image with different correction intensities with respect to the high brightness pixels and surrounding pixels thereof in the high brightness region to generate a plurality of second images, and a second generation unit generates a moving image using the generated second images.

## Claims

### Claim 1

An image processing apparatus, comprising:
an acquisition unit configured to acquire a first image generated by shooting;
a division unit configured to divide the first image into two or more regions according to a distribution of a distance of each subject, at the time of shooting, included in the first image;
a detection unit configured to detect one of the divided regions as a high brightness region where high brightness pixels exist;
a first generation unit configured to perform correction of the first image with different correction intensities with respect to the high brightness pixels and surrounding pixels thereof in the high brightness region to generate a plurality of second images; and
a second generation unit configured to generate a moving image using the generated second images.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the first generation unit corrects at least one of a contrast, a brightness, a color, and a chroma of the first image as the correction.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, wherein the detection unit detects, as the high brightness region, a region where a ratio of the number of high brightness pixels to the total number of pixels of one of the divided regions is a predetermined ratio or more.

### Claim 4 (depends on 3)

The image processing apparatus according to claim 3, wherein the first generation unit decreases the correction intensity when a distance from the high brightness pixel increases.

### Claim 5 (depends on 4)

The image processing apparatus according to claim 4, wherein the first generation unit monotonously changes the correction intensity according to the distance from the high brightness pixel.

### Claim 6 (depends on 5)

The image processing apparatus according to claim 5, wherein a value of an inclination of the monotonous change is controlled to a different value between the second images.

### Claim 7 (depends on 1)

The image processing apparatus according to claim 1, further comprising a determination unit configured to determine a shooting scene in the first image,
wherein setting of which of a contrast, a brightness, a color, and a chroma of the first image is corrected and setting of the correction intensity for each of the second images are performed according to the determined shooting scene.

### Claim 8 (depends on 7)

The image processing apparatus according to claim 7, wherein the shooting scene is determined on the basis of at least one of information of a brightness and a hue.

### Claim 9 (depends on 1)

The image processing apparatus according to claim 1, wherein the acquisition unit acquires at least two or more multi-viewpoint image groups having different viewpoints as the first image, and the second generation unit selects or combines the multi-viewpoint image groups on which the correction has been performed by the first generation unit to generate the moving image.

### Claim 10 (depends on 1)

The image processing apparatus according to claim 1, wherein the high brightness pixels are pixels having a predetermined brightness value or more.

### Claim 11 (depends on 1)

The image processing apparatus according to claim 1, wherein the first image is displayed in a state in which the detected region is visually recognized and information showing that the correction by the first generation unit is performed on the detected region is transmitted.

### Claim 12

An image pickup apparatus, comprising:
an image processing apparatus, including
an acquisition unit configured to acquire a first image generated by shooting,
a division unit configured to divide the first image into two or more regions according to a distribution of a distance of each subject at the time of shooting, included in the first image,
a detection unit configured to detect one of the divided regions as a high brightness region where high brightness pixels exist,
a first generation unit configured to perform correction of the first image with different correction intensities with respect to the high brightness pixels and surrounding pixels thereof in the high brightness region to generate a plurality of second images, and
a second generation unit configured to generate a moving image using the generated second images; and
an image pickup unit configured to generate the first image.

### Claim 13

An image processing method executed by an image processing apparatus, the method comprising:
an acquisition step of acquiring a first image generated by shooting;
a division step of dividing the first image into two or more regions according to a distribution of a distance of each subject, at the time of shooting, included in the first image;
a detection step of detecting one of the divided regions as a high brightness region where high brightness pixels exist;
a first generation step of performing correction of the first image with different correction intensities with respect to the high brightness pixels and surrounding pixels thereof in the high brightness region to generate a plurality of second images; and
a second generation step of generating a moving image using the generated second images.

### Claim 14

A computer-readable non-transitory storage medium storing a program for causing a computer to perform an image processing method,
the image processing method comprising:
an acquisition step of acquiring a first image generated by shooting;
a division step of dividing the first image into two or more regions according to a distribution of a distance of each subject, at the time of shooting, included in the first image;
a detection step of detecting one of the divided regions as a high brightness region where high brightness pixels exist;
a first generation step of performing correction of the first image with different correction intensities with respect to the high brightness pixels and surrounding pixels thereof in the high brightness region to generate a plurality of second images; and
a second generation step of generating a moving image using the generated second images.
