# US 2019/0098275 A1 · Image processing apparatus, image processing method, and non-transitory computer readable recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0098275 A1
- Document ID: US20190098275A1
- Status: Published application
- Kind: A1
- Application number: 16/138,592
- Filed: 2018-09-21
- Published: 2019-03-28
- Earliest claimed: 2017-09-27
- Assignees: Casio Computer Co., Ltd.
- Applicants: Casio Computer Co., Ltd.
- Inventors: Takeshi TSUKAGOSHI
- Web page: https://patentgrep.com/patent/US20190098275A1

## CPC

- H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control
- G06T 1/0007: {Image acquisition}
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- H04N 23/84: for processing colour signals
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus has a memory which stores a program and a processor which executes the program stored in the memory to acquire a plurality of picked-up images picked up by a plurality of image pickup systems, calculate a white balance of each of the plurality of acquired picked-up images, set a white balance of a joint of the plurality of picked-up images, individually calculate interpolated values between the calculated white balances and the set white balance of the joint by an interpolation function, individually and continuously vary the white balances in the plurality of picked-up images based on the calculated interpolated values to correct the white balances, individually adjust the plurality of picked-up images based on the calculated white balance of each of the plurality of picked-up images, the white balance of the joint, and the corrected white balances, and synthesize the plurality of adjusted picked-up images to generate a wide angle image.

## Claims

### Claim 1

An image processing apparatus comprising:
a memory which stores a program; and
a processor which executes the program stored in the memory to:
acquire a plurality of picked-up images picked up by a plurality of image pickup systems,
calculate a white balance of each of the plurality of acquired picked-up images,
set a white balance of a joint of the plurality of picked-up images,
individually calculate interpolated values between the calculated white balances and the set white balance of the joint by an interpolation function,
individually and continuously vary the white balances in the plurality of picked-up images based on the calculated interpolated values to correct the white balances,
individually adjust the plurality of picked-up images based on the calculated white balance of each of the plurality of picked-up images, the white balance of the joint, and the corrected white balances, and
synthesize the plurality of adjusted picked-up images to generate a wide angle image.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the wide angle image is a celestial sphere image.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, wherein the white balance of the joint is a value between the calculated white balances.

### Claim 4 (depends on 1)

The image processing apparatus according to claim 1, wherein the processer corrects the calculated white balance for at least one picked-up image among the plurality of acquired picked-up images.

### Claim 5 (depends on 1)

The image processing apparatus according to claim 1, wherein the processor continuously varies the white balance in the at least one picked-up image among the plurality of picked-up images from a predetermined position of the image to an image end based on the calculated interpolated value.

### Claim 6 (depends on 1)

The image processing apparatus according to claim 1, wherein the interpolation function includes alignment interpolation or spline interpolation.

### Claim 7 (depends on 1)

The image processing apparatus according to claim 1, wherein the processor individually calculates exposure values in the plurality of picked-up images,
sets exposure values of the joints of the plurality of picked-up images,
individually calculating exposure interpolated values between the calculated exposure values and the set exposure value by the interpolation function, and
individually and continuously varies the calculated exposure values based on the calculated exposure interpolated values.

### Claim 8

An image processing method executed by a processor of an image processing apparatus by executing a program stored in a memory of the image processing apparatus, and the method comprising:
acquiring a plurality of picked-up images picked up by a plurality of image pickup systems,
individually calculating a white balance of each of the plurality of acquired picked-up images,
setting a white balance of a joint of the plurality of picked-up images,
individually calculating interpolated values between the calculated white balances and the set white balance of the joint by an interpolation function,
individually correcting the white balances by continuously varying the white balances in the plurality of picked-up images based on the calculated interpolated value,
individually adjusting the plurality of picked-up images based on the corrected white balances, and
synthesizing the plurality of adjusted picked-up images to generate a wide angle image,
wherein the adjusting the images further executes adjustment of the plurality of picked-up images based on the calculated white balance of each of the plurality of picked-up images, the white balance of the joint, and the corrected white balances.

### Claim 9 (depends on 8)

The image processing method according to claim 8, wherein the white balance of the joint is a value between the calculated white balances.

### Claim 10 (depends on 8)

The image processing method according to claim 8, wherein the correcting the white balance further executes correction of the calculated white balance for at least one picked-up image among the plurality of acquired picked-up images.

### Claim 11 (depends on 8)

The image processing method according to claim 8, wherein the correcting the white balance further executes correction by continuously varying the white balance in the at least one picked-up image among the plurality of picked-up images from a predetermined position of the image to an image end based on the calculated the interpolated value.

### Claim 12 (depends on 8)

The image processing method according to claim 8, wherein the interpolation function includes alignment interpolation or spline interpolation.

### Claim 13 (depends on 8)

The image processing method according to claim 8, further comprising:
individually calculating exposure values in the plurality of picked-up images,
wherein the correcting the white balance further comprises
setting an exposure value of the joint of the plurality of picked-up images, and
individually calculating exposure interpolated values between the calculated exposure values and the set exposure value of the joint by the interpolation function, and
the correcting the white balance further executes individual and continuous variation of the calculated exposure values based on the calculated exposure interpolated values.

### Claim 14

A non-transitory computer readable recording medium storing a computer-readable program that is executable by a computer to perform functions comprising:
acquiring a plurality of picked-up images picked up by a plurality of image pickup systems,
calculating a white balance of each of the plurality of acquired picked-up images,
setting a white balance of a joint of the plurality of picked-up images,
individually calculating interpolated values between the calculated white balances and the set white balance of the joint by an interpolation function,
individually and continuously varying the white balances in the plurality of picked-up images based on the calculated interpolated values to correct the white balances,
individually adjusting the plurality of picked-up images based on the calculated white balance of each of the plurality of picked-up images, the white balance of the joint, and the corrected white balances, and
synthesizing the plurality of adjusted picked-up images to generate a wide angle image.

### Claim 15 (depends on 14)

The non-transitory recording medium according to claim 14, wherein the white balance of the joint is a value between the calculated white balances.

### Claim 16 (depends on 14)

The non-transitory recording medium according to claim 14, wherein
the calculated white balance is corrected for at least one picked-up image among the plurality of acquired picked-up image.

### Claim 17 (depends on 14)

The non-transitory recording medium according to claim 14, wherein the white balance in the at least one picked-up image among the plurality of picked-up images is continuously varied from a predetermined position of the image to an image end based on the calculated interpolated value.

### Claim 18 (depends on 14)

The non-transitory recording medium according to claim 14, wherein the interpolation function includes alignment interpolation or spline interpolation.

### Claim 19 (depends on 14)

The non-transitory computer readable recording medium according to claim 14, further comprising:
individually calculating exposure values in the plurality of picked-up images, wherein an exposure value of a joint of the plurality of picked-up images is set,
exposure interpolated values between the calculated exposure values and the set exposure value are individually calculated by the interpolation function, and
the calculated exposure values are individually and continuously varied based on the calculated exposure interpolated values.
