# US 2017/0251149 A1 · Method of determining whole-scene image by using multiple image-capturing devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0251149 A1
- Document ID: US20170251149A1
- Status: Published application
- Kind: A1
- Application number: 15/054,102
- Filed: 2016-02-25
- Published: 2017-08-31
- Earliest claimed: 2016-02-25
- Assignees: National Applied Research Laboratories
- Applicants: National Applied Research Laboratories
- Inventors: CHI-HUNG HUANG; YUNG-HSIANG CHEN; WEI-CHUNG WANG
- Web page: https://patentgrep.com/patent/US20170251149A1

## CPC

- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/246: Calibration of cameras
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention discloses a method of determining a whole-scene image by using multiple image-capturing devices, and the method has two main features including non-contact formation digital image method and the parallax elimination process for captured images. The former feature uses a concyclic fitting calculation to easily determine the locations and orientations of the image-capturing devices, so as to achieve the objective of assisting in capturing the whole-scene image. The latter feature can effectively improve the image quality, so as to effectively solve the problems in conventional technology.

## Claims

### Claim 1

A method of determining a whole-scene image by using multiple image-capturing devices, comprising:
(a) arbitrarily selecting a first image-capturing device, a second image-capturing device and a third image-capturing device located in a whole-scene space;
(b) determining a first base line, a second base line and a third base line on a basis of the second image-capturing device;
(c) calculating coordinates of the first image-capturing device, the second image-capturing device and third image-capturing device;
(d) performing a fitting calculation for a co-circle according to the coordinates;
(e) calculating a cyclic point and a radius of the co-circle, and a first angle θ1 and a second angle θ2;
(f) when a number of the image-capturing devices exceeds three, selecting the at least one of the first, second and third image-capturing devices, and two image-capturing devices comprising one image-capturing device other than the first, second and third image-capturing devices, and defining the selected three image-capturing devices as the first, second and third image-capturing devices in the step (a) and then performing the step (a) through step (h) according to the selected three image-capturing devices;
(g) calculating a con-cyclic plane of the co-circle, and arranging the first, the second and the third image-capturing devices according to the con-cyclic plane;
(h) analyzing images captured by the first, the second and the third image-capturing devices to determine whether an image calibration is required;
(i) according to the con-cyclic plane, evaluating a correlation between a single circle and the con-cyclic plane joined with each other, so as to obtain a physical quantity analysis result of the whole-scene after analysis of a correlation evaluation report; and
(j) determining the whole-scene image according to the physical quantity analysis result.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the physical quantity analysis result comprises a displacement field and a stress field obtained from calculation according to an image correlation.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the step (h) further comprises:
(h1) analyzing the images captured by the first, the second, and the third image-capturing devices to determine whether it is necessary to perform the image calibration because of a vertical parallax or a horizontal parallax existing between different image-capturing devices;
wherein the step (i) further comprises:
(i1) if it is necessary to perform the image calibration, a parallax elimination process is performed on the images captured.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the parallax elimination process comprises a rectification process and a 3D matching process which are in cooperation with each other.

### Claim 5

A method of determining a whole-scene image by using multiple image-capturing devices, comprising:
(a) arbitrarily selecting a first image-capturing device, a second image-capturing device and a third image-capturing device located in a whole-scene space;
(b) determining a first base line, a second base line and a third base line on a basis of the second image-capturing device;
(c) calculating coordinates of the first image-capturing device, the second image-capturing device and third image-capturing device;
(d) performing a fitting calculation for a co-circle according to the coordinates;
(e) calculating a cyclic point and a radius of the co-circle, and a first angle θ1 and a second angle θ2;
(f) when a number of the image-capturing devices exceeds three, selecting the at least one of the first, second and third image-capturing devices, and two image-capturing devices comprising one image-capturing device other than the first, second and third image-capturing devices, and defining the selected three image-capturing devices as the first, second and third image-capturing devices in the step (a) and then performing the step (a) through step (h) according to the selected three image-capturing devices;
(g) calculating a con-cyclic plane of the co-circle, and arranging the first, the second and the third image-capturing devices according to the con-cyclic plane;
(h) evaluating a correlation between a single circle and a con-cyclic plane which are jointed with each other, so as to obtain a physical quantity analysis result of the global scene after analysis of a correlation evaluation report; and
(i) determining the whole-scene image according to the physical quantity analysis result.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the physical quantity analysis result comprises a displacement field and a stress field obtained from calculation according to an image correlation.

### Claim 7 (depends on 5)

The method according to claim 5, wherein the step (g) further comprises:
(g1) analyzing the images captured by the first, the second, and the third image-capturing devices to determine whether it is necessary to perform image calibration because of a vertical parallax or a horizontal parallax existing between different image-capturing devices;
wherein the step (h) further comprises:
(h1) if it is necessary to perform the image calibration, a parallax elimination process is performed on the captured images.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the parallax elimination process comprises a rectification process and a 3D matching process which are in cooperation with each other.
