# US 2021/0064873 A1 · Image capturing apparatus, monitoring system, image processing apparatus, image capturing method, and non-transitory computer readable recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0064873 A1
- Document ID: US20210064873A1
- Status: Published application
- Kind: A1
- Application number: 17/064,794
- Filed: 2020-10-07
- Published: 2021-03-04
- Earliest claimed: 2013-12-13
- Assignees: Panasonic Intellectual Property Management Co., Ltd.
- Applicants: Panasonic Intellectual Property Management Co., Ltd.
- Inventors: Kunio NOBORI; Satoshi SATO; Takeo AZUMA
- Web page: https://patentgrep.com/patent/US20210064873A1

## CPC

- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06T 7/596: {from three or more stereo images}
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 2207/10012: Stereo images
- G06T 2207/10052: Images from lightfield camera
- G06T 2207/30261: Obstacle
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- Y10S 901/01: Mobile robot
- Y10S 901/47: Optical
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

There is provided an image capturing apparatus that captures a plurality of images, calculates a three-dimensional position from the plurality of images, and outputs the plurality of images and information about the three-dimensional position. The image capturing apparatus includes an image capturing unit, a camera parameter storage unit, a position calculation unit, a position selection unit, and an image complementing unit. The image capturing unit outputs the plurality of images using at least three cameras. The camera parameter storage unit stores in advance camera parameters including occlusion information. The position calculation unit calculates three dimensional positions of a plurality of points. The position selection unit selects a piece of position information relating to a subject area that does not have an occlusion, and outputs selected position information. The image complementing unit generates a complementary image, and outputs the complementary image and the selected position information.

## Claims

### Claim at position 1

1-14. (canceled)

### Claim 15

An apparatus, comprising:
a first camera that has a first lens and outputs a first image;
a second camera that has a second lens and outputs a second image;
a third camera that has a third lens and outputs a third image; and
a base on which the first camera, the second camera, and the third camera are mounted, wherein
a processor outputs a fourth image based on the first image, the second image, and the third image,
a first optical axis of the first lens and a second optical axis of the second lens are parallel,
the first optical axis of the first lens and a third optical axis of the third lens are parallel, and
a distance between the first optical axis and the second optical axis is smaller than a sum of a first diameter of the first lens and a second diameter of the second lens.

### Claim 16 (depends on 15)

The apparatus according to claim 15, wherein
a module including the first camera, the second camera, the third camera, and the base is configured to be mounted on a vehicle.

### Claim 17 (depends on 16)

The apparatus according to claim 16, wherein
the first image has a occluded area caused by a part of the module,
the fourth image includes a fifth image generated using the second image and the third image, and
the fifth image corresponds to an image to be shown in the occluded area without the occlusion.

### Claim 18

A method, comprising:
outputting, by a first camera that has a first lens, a first image;
outputting, by a second camera that has a second lens, a second image; and
outputting, by a third camera that has a third lens, a third image, the first camera, the second camera, and the third camera being mounted on a base, wherein
a processor outputs a fourth image based on the first image, the second image, and the third image,
a first optical axis of the first lens and a second optical axis of the second lens are parallel,
the first optical axis of the first lens and a third optical axis of the third lens are parallel, and
a distance between the first optical axis and the second optical axis is smaller than a sum of a first diameter of the first lens and a second diameter of the second lens.

### Claim 19 (depends on 18)

The method according to claim 18, wherein
a module including the first camera, the second camera, the third camera, and the base is configured to be mounted on a vehicle.

### Claim 20 (depends on 19)

The method according to claim 19, wherein
the first image has a occluded area caused by a part of the module,
the fourth image includes a fifth image generated using the second image and the third image, and
the fifth image corresponds to an image to be shown in the occluded area without the occlusion.
