# US 11,451,697 B2 · Camera system, controller thereof, automobile, and deserializer circuit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,451,697 B2
- Document ID: US11451697B2
- Status: Granted
- Kind: B2
- Application number: 17/117,740
- Filed: 2020-12-10
- Published: 2021-04-01
- Granted: 2022-09-20
- Earliest claimed: 2018-06-12
- Assignees: Rohm Co., Ltd.
- Applicants: Rohm Co., Ltd.
- Inventors: Kenya Nakamura
- Web page: https://patentgrep.com/patent/US11451697B2

## CPC

- H04N 5/067: Arrangements or circuits at the transmitter end
- H04N 23/60: Control of cameras or camera modules
- H04N 5/04: Synchronising (for television systems using pulse code modulation H04N7/56)
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 21/242: Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)}
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/665: {involving internal camera communication with the image sensor, e.g. synchronising or multiplexing SSIS control signals}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A controller controls multiple camera modules, and processes video images captured by the multiple camera modules. The controller is configured: (i) to output a frame synchronization signal FSYNC to each of the multiple camera modules; (ii) to receive frame data and a transmission synchronization signal SYNC that is synchronized with the frame data; (iii) to process the multiple items of frame data thus received; and (iv) to acquire a time difference between the corresponding frame synchronization signal and the corresponding transmission synchronization signal for each camera module, so as to adjust the timing of the frame synchronization signal according to the time difference.

## Claims

### Claim 1

A camera system comprising:
a plurality of camera modules, each of which is structured to capture image in response to an assertion of a corresponding frame synchronization signal, to transmit frame data including the captured image and to transmit a transmission synchronization signal which is asserted in synchronization with the transmission of the frame data; and
a controller structured to control the plurality of camera modules, and to process images captured by the plurality of camera modules,
wherein the controller is structured:
(i) to supply a plurality of frame synchronization signals to the plurality of camera modules respectively, wherein the controller asserts each frame synchronization signal at an image capture timing at which the corresponding one of the plurality of camera modules should capture the image;
(ii) to receive the frame data and a plurality of transmission synchronization signals from the plurality of camera modules respectively;
(iii) to process the plurality of items of frame data thus received; and
(iv) for each camera module, to acquire a time difference between an assertion of a corresponding one of the plurality of frame synchronization signals and an assertion of a corresponding one of the plurality of transmission synchronization signals, so as to adjust the timing of the corresponding one of the plurality of frame synchronization signals according to the corresponding time difference.

### Claim 2 (depends on 1)

The camera system according to claim 1, wherein the controller comprises:
a plurality of receivers each structured to receive a corresponding frame data and a corresponding one of the plurality of transmission synchronization signals;
an image processing unit structured to process a plurality of items of frame data received by the plurality of receivers;
a synchronization signal generating unit structured to generate the plurality of frame synchronization signals;
a plurality of delay measurement units each structured to acquire a time difference between a corresponding one of the plurality of frame synchronization signals and a corresponding one of the plurality of transmission synchronization signals; and
a plurality of transmitters structured to transmit the plurality of frame synchronization signals to the plurality of camera modules respectively,
and wherein the plurality of frame synchronization signals have a timing relation that is adjustable based on time differences measured by the plurality of delay measurement units.

### Claim 3 (depends on 2)

The camera system according to claim 2, wherein the receiver, the transmitter, and the delay measurement unit that correspond to the same camera module are integrated on a single deserializer circuit.

### Claim 4 (depends on 3)

The camera system according to claim 3, wherein the camera module comprises:
an image sensor; and
a serializer circuit structured to enable bidirectional communication with the deserializer circuit that forms a pair with the serializer circuit.

### Claim 5 (depends on 1)

The camera system according to claim 1, wherein the camera module transmits RAW data to the controller,
wherein, upon detecting an occurrence of a transmission error in a subpixel of “G”, the controller refers to a value of a subpixel of “G” in an immediately previous line,
and wherein, upon detecting an occurrence of a transmission error in a subpixel of “R” or “B”, the controller refers to a value of a subpixel of “R” or “B” in a two-lines-previous line.

### Claim 6 (depends on 1)

An automobile comprising the camera system according to claim 1.

### Claim 7

A controller structured to control a plurality of camera modules, each of which is structured to capture image in response to an assertion of a corresponding frame synchronization signal, to transmit frame data including the captured image and to transmit a transmission synchronization signal which is asserted in synchronization with the transmission of the frame data, and to process video images captured by the plurality of camera modules, wherein the controller comprises:
a plurality of receivers each structured to receive the frame data and a transmission synchronization signal that is synchronized with the frame data from a corresponding one of the plurality of camera modules, wherein the transmission synchronization signal is a timing signal;
an image processing unit structured to process a plurality of items of frame data received by the plurality of receivers;
a synchronization signal generating unit structured to generate a plurality of frame synchronization signals that correspond to the plurality of camera modules, wherein the plurality of frame synchronization signals are timing signals, and the controller asserts each frame synchronization signal at an image capture timing at which the corresponding one of the plurality of camera modules should capture the image;
a plurality of delay measurement units each structured to acquire a time difference between an assertion of a corresponding one of the plurality of frame synchronization signals and an assertion of a corresponding transmission synchronization signal; and
a plurality of transmitters structured to transmit the plurality of frame synchronization signals to the plurality of camera modules respectively,
and wherein the plurality of frame synchronization signals have a timing relation that is adjustable based on time differences measured by the plurality of delay measurement units.

### Claim 8 (depends on 7)

The controller according to claim 7, wherein the receiver, the transmitter, and the delay measurement unit that correspond to the same camera module are integrated on a single deserializer circuit.