# US 2020/0267372 A1 · Apparatus, apparatus control method, and recording medium, for synchronizing a plurality of imaging devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0267372 A1
- Document ID: US20200267372A1
- Status: Published application
- Kind: A1
- Application number: 16/786,839
- Filed: 2020-02-10
- Published: 2020-08-20
- Earliest claimed: 2019-02-18
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Akihito Taketani
- Web page: https://patentgrep.com/patent/US20200267372A1

## CPC

- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- G03B 35/08: by simultaneous recording
- H04N 5/04: Synchronising (for television systems using pulse code modulation H04N7/56)
- H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597)
- H04N 13/296: Synchronisation thereof; Control thereof
- H04N 23/61: based on recognised objects
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N 25/531: by controlling rolling shutters in CMOS SSIS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)

## Abstract

A synchronization control apparatus includes a control unit configured to control a plurality of imaging devices that capture an image, and a determination unit configured to determine a target region from which an image is acquired from each of the plurality of imaging devices, and to determine a synchronization signal corresponding to the target region in each of the plurality of imaging devices, wherein the determination unit determines the synchronization signal and the target region in each of the plurality of imaging devices so as to temporally synchronize images acquired from the plurality of imaging devices

## Claims

### Claim 1

An apparatus that controls a plurality of imaging devices each configured to capture an image each of the plurality of imaging devices being a rolling shutter type image sensor, the apparatus comprising:
a region determination unit configured to determine, in each of the plurality of imaging devices, a target region from which an image is acquired; and
a signal determination unit configured to determine a synchronization signal corresponding to the determined target region,
wherein the synchronization signal corresponds to a timing of starting image capturing in the target region in each of the plurality of imaging devices, the timing being determined so as to temporally synchronize a plurality of images acquired from the plurality of imaging devices.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the target region is a partial region of an effective region in each of the plurality of imaging devices.

### Claim 3 (depends on 1)

The apparatus according to claim 1, wherein the signal determination unit determines a single synchronization signal indicating a timing of inputting the synchronization signal to the plurality of imaging devices.

### Claim 4 (depends on 1)

The apparatus according to claim 1, wherein the signal determination unit determines a plurality of synchronization signals to be input to the plurality of imaging devices at shifted timings.

### Claim 5 (depends on 4)

The apparatus according to claim 4, further comprising a ranging unit configured to detect a distance from each of the plurality of imaging devices to an object,
wherein the signal determination unit adjusts the plurality of synchronization signals based on the distance.

### Claim 6 (depends on 5)

The apparatus according to claim 5, wherein the signal determination unit acquires a setting value corresponding to the distance for each of the plurality of imaging devices and adjusts the plurality of synchronization signals to shift the timing of starting image capturing in the target region based on the setting value.

### Claim 7 (depends on 5)

The apparatus according to claim 5, wherein the signal determination unit adjusts, in a case where the distance detected by the ranging unit indicates that the object is located at a position closer to each of the plurality of imaging devices than a certain reference point, the plurality of synchronization signals based on the distance.

### Claim 8 (depends on 3)

The apparatus according to claim 3, further comprising a ranging unit configured to detect a distance from each of the plurality of imaging devices to an object,
wherein the region determination unit adjusts the target region in each of the plurality of imaging devices based on the distance.

### Claim 9 (depends on 8)

The apparatus according to claim 8,
wherein the plurality of imaging devices is disposed so as to overlap each other image capturing regions of the plurality of imaging devices in at least a partial region of an entire effective region of each of the plurality of imaging devices, and
wherein the region determination unit changes, based on the distance, a region determined to be the target region in a region in which the image capturing regions of the plurality of imaging devices overlap each other, for each of the plurality of imaging devices.

### Claim 10 (depends on 8)

The apparatus according to claim 8, wherein the signal determination unit adjusts, in a case where the distance detected by the ranging unit indicates that the object is located at a position closer to each of the plurality of imaging devices than a certain reference point, the target region based on the distance.

### Claim 11 (depends on 1)

The apparatus according to claim 1,
wherein the plurality of imaging devices is disposed so as to overlap each other image capturing regions of the plurality of imaging devices in at least a partial region of an entire effective region of each of the plurality of imaging devices, and
wherein the region determination unit determines, as the target region, a region in which the image capturing regions of the plurality of imaging devices overlap each other.

### Claim 12 (depends on 1)

The apparatus according to claim 1,
wherein the signal determination unit determines a synchronization position in each of the plurality of imaging devices to synchronize timings of starting image capturing in the determined target regions in the plurality of imaging devices, and
wherein the synchronization signal is a signal for starting scanning from a pixel corresponding to the synchronization position in each of the plurality of imaging devices.

### Claim 13 (depends on 1)

The apparatus according to claim 1, wherein the region determination unit determines the target region in each of the plurality of imaging devices based on preliminarily set information.

### Claim 14 (depends on 13)

The apparatus according to claim 13, wherein the preliminarily set information includes information about a mechanical structure and an assembly error of each of the plurality of imaging devices.

### Claim 15 (depends on 13)

The apparatus according to claim 13, wherein the signal determination unit determines the synchronization signal based on the preliminarily set information.

### Claim 16 (depends on 1)

The apparatus according to claim 1, further comprising a displacement amount detection unit configured to detect a displacement amount of a plurality of images captured by the plurality of imaging devices,
wherein the region determination unit determines the target region in each of the plurality of imaging devices based on the displacement amount.

### Claim 17 (depends on 16)

The apparatus according to claim 16, wherein the signal determination unit determines the synchronization signal for each of the plurality of imaging devices based on the displacement amount.

### Claim 18 (depends on 1)

The apparatus according to claim 1, wherein the plurality of imaging devices is included in a head-mounted display to perform stereoscopic image capturing.

### Claim 19

A control method for an apparatus that controls a plurality of imaging devices each configured to capture an image, each of the plurality of imaging devices being a rolling shutter type image sensor, the control method comprising:
determining, in each of the plurality of imaging devices, a target region from which an image is acquired; and
determining a synchronization signal corresponding to the determined target region in each of the plurality of imaging devices,
wherein the synchronization signal corresponds to a timing of starting image capturing in the target region in each of the plurality of imaging devices, the timing being determined in such a manner that a plurality of images acquired from the plurality of imaging devices is temporally synchronized.

### Claim 20

A non-transitory computer-readable recording medium storing a program that causes a computer to function as an apparatus that controls a plurality of imaging devices each configured to capture an image, each of the plurality of imaging devices being a rolling shutter type image sensor, the apparatus comprising:
a region determination unit configured to determine, in each of the plurality of imaging devices, a target region from which an image is acquired; and
a signal determination unit configured to determine a synchronization signal corresponding to the determined target region,
wherein the synchronization signal corresponds to a timing of starting image capturing in the target region in each of the plurality of imaging devices, the timing being determined so as to temporally synchronize a plurality of images acquired from the plurality of imaging devices.
