# US 2015/0103172 A1 · Image processing apparatus and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0103172 A1
- Document ID: US20150103172A1
- Status: Published application
- Kind: A1
- Application number: 14/458,326
- Filed: 2014-08-13
- Published: 2015-04-16
- Earliest claimed: 2013-10-11
- Assignees: Fujitsu Limited
- Applicants: Fujitsu Limited
- Inventors: Seiya Shimizu
- Web page: https://patentgrep.com/patent/US20150103172A1

## CPC

- B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- B60R 2300/105: using multiple cameras
- B60R 2300/202: displaying a blind spot scene on the vehicle part responsible for the blind spot
- B60R 2300/303: using joined images, e.g. multiple camera images
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus includes a first field-of-view converting unit configured to convert an image of a first camera, which is equipped in a vehicle and arranged to include a portion of a vehicle body in an image capturing range, into an image having an arbitrary field-of-view within a field-of-view of the first camera; a second field-of-view converting unit configured to convert a blind spot image, which is an image of a second camera capturing an image of a peripheral environment acting as a blind spot by the first camera, into the blind spot image having the same field-of-view as the field-of-view of the image obtained after the conversion by the first converting unit; and a compositing unit configured to compose a region corresponding to the blind spot image obtained by the second converting unit to the region of the vehicle body of the image obtained by the first converting unit.

## Claims

### Claim 1

An image processing apparatus comprising:
a first field-of-view converting unit configured to convert an image of a first camera, which is equipped in a vehicle and arranged to include a portion of a vehicle body in an image capturing range, into an image having an arbitrary field of view within a field of view of the first camera;
a second field-of-view converting unit configured to convert a blind spot image, which is an image of a second camera capturing an image of a peripheral environment acting as a blind spot by a region of the vehicle body of the image captured by the first camera, into the blind spot image having the same field of view as the field of view of the image obtained after the field-of-view conversion by the first field-of-view converting unit; and
a compositing unit configured to compose a region corresponding to the blind spot image obtained by the conversion by the second field-of-view converting unit to the region of the vehicle body of the image obtained after the field-of-view conversion by the first field-of-view converting unit.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, further comprising:
a storage unit configured to store a mask image of the vehicle body indicating the region of the vehicle body among images captured by the first camera; and
a vehicle body mask image converting unit configured to convert the mask image of the vehicle body stored in the storage unit to have the same field of view as the field of view of the image obtained after the field-of-view conversion by the first field of view converting unit,
wherein the compositing unit specifies a composite region based on the mask image of the vehicle body obtained after the field-of-view conversion by the vehicle body mask image converting unit.

### Claim 3 (depends on 2)

The image processing apparatus of claim 2, further comprising a generating unit configured to generate the vehicle body mask image.

### Claim 4 (depends on 3)

The image processing apparatus according to claim 3, wherein the generating unit generates the mask image of the vehicle body by converting the mask image of the vehicle body created under a reference arrangement condition in accordance with arrangement conditions of the first camera.

### Claim 5 (depends on 3)

The image processing apparatus according to claim 3, wherein the generating unit generates the mask image of the vehicle body based on vehicle shape data modeled after a shape of the vehicle and an arrangement parameter indicating the arrangement conditions of the first camera.

### Claim 6 (depends on 1)

The image processing apparatus according to claim 1, further comprising a variable unit configured to vary the arbitrary field of view.

### Claim 7 (depends on 1)

The image processing apparatus according to claim 1, wherein the compositing unit composes the regions in such a manner that a contour of the vehicle body is left.

### Claim 8 (depends on 1)

The image processing apparatus according to claim 1, further comprising a display unit configured to display a result of the composition by the compositing unit on a display screen.

### Claim 9

An image processing method comprising:
converting an image of a first camera, which is equipped in a vehicle and arranged to include a portion of a vehicle body in an image capturing range, into an image having an arbitrary field of view within a field of view of the first camera;
converting a blind spot image, which is an image of a second camera capturing an image of a peripheral environment acting as a blind spot by a region of the vehicle body of the image captured by the first camera, into the blind spot image having the same field of view as the field of view of the image obtained after the converting of the image of the first camera; and
compositing a region corresponding to the blind spot image obtained by the converting of the blind spot image to the region of the vehicle body of the image obtained after the converting of the image of the first camera.

### Claim 10

A non-transitory computer-readable recording medium storing a program that, when executed, causes a computer of an image processing apparatus to perform an image processing method, the method comprising:
converting an image of a first camera, which is equipped in a vehicle and arranged to include a portion of a vehicle body in an image capturing range, into an image having an arbitrary field of view within a field of view of the first camera;
converting a blind spot image, which is an image of a second camera capturing an image of a peripheral environment acting as a blind spot by a region of the vehicle body of the image captured by the first camera, into the blind spot image having the same field of view as the field of view of the image obtained after the converting of the image of the first camera; and
compositing a region corresponding to the blind spot image obtained by the converting of the blind spot image to the region of the vehicle body of the image obtained after the converting of the image of the first camera.
