# US 2019/0098287 A1 · Camera calibration system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0098287 A1
- Document ID: US20190098287A1
- Status: Published application
- Kind: A1
- Application number: 16/205,109
- Filed: 2018-11-29
- Published: 2019-03-28
- Earliest claimed: 2016-04-06
- Assignees: Facebook, Inc.
- Applicants: Facebook, Inc.
- Inventors: Brian Keith Cabral; Albert Parra Pozo; Forrest Samuel Briggs; Joyce Hsu
- Web page: https://patentgrep.com/patent/US20190098287A1

## CPC

- H04N 13/246: Calibration of cameras
- G06T 7/85: {Stereo camera calibration}
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/332: Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N 17/002: {for television cameras}
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A camera calibration system jointly calibrates multiple cameras in a camera rig system. The camera calibration system obtains configuration information about the multiple cameras in the camera rig system, such as position and orientation for each camera relative to other cameras. The camera calibration system estimates calibration parameters (e.g., rotation and translation) for the multiple cameras based on the obtained configuration information. The camera calibration system receives 2D images of a test object captured by the multiple cameras and obtains known information about the test object such as location, size, texture and detailed information of visually distinguishable points of the test object. The camera calibration system then generates a 3D model of the test object based on the received 2D images and the estimated calibration parameters. The generated 3D model is evaluated in comparison with the actual test object to determine a calibration error. The calibration parameters for the cameras are updated to reduce the calibration error for the multiple cameras.

## Claims

### Claim 1

A method for calibrating a camera rig system, the method comprising:
receiving configuration information about a plurality of cameras in the camera rig system, the plurality of cameras sharing an overlapped part in their respective fields of view in which a test object is located; and
for each adjacent pair of cameras of the plurality of cameras:
identifying calibration parameters for the pair of cameras;
receiving a plurality of images of the test object captured by the pair of cameras, the test object having known calibration measures;
creating a 3D model of the test object based on the identified calibration parameters and the received plurality of images;
calculating a calibration error that reflects differences between calibration measures of the created 3D model of the test object and the known calibration measures of the test object; and
modifying the calibration parameters for the pair of cameras to reduce the calibration error.

### Claim 2 (depends on 1)

The method of claim 1, wherein the configuration information includes, for each camera among the plurality of cameras, position and orientation relative to the other cameras among the plurality of cameras.

### Claim 3 (depends on 1)

The method of claim 1, wherein the calibration measures of the test object include at least one of the following: location, size, texture, shape and detailed information of visually distinguishable points on the test object.

### Claim 4 (depends on 1)

The method of claim 1, wherein the calibration parameters include rotation and translation information for each camera of the pair of cameras.

### Claim 5 (depends on 1)

The method of claim 1, wherein the camera rig system includes a plurality of cameras and a plurality of known objects, wherein each known object is viewed by at least two cameras and each camera views at least two known objects.

### Claim 6 (depends on 1)

The method of claim 1, further comprising performing additional iterations of calibration until the calibration error is below a calibration error threshold.

### Claim 7 (depends on 1)

The method of claim 1, wherein the camera rig system includes a plurality of peripheral cameras, at least one top axis camera, and at least one bottom axis camera.

### Claim 8 (depends on 7)

The method of claim 7, wherein the at least one top axis camera and at least one bottom axis camera are vertically offset relative to the plurality of peripheral cameras to limit overlap between fields of view.

### Claim 9

A non-transitory computer-readable storage medium storing computer program instructions for calibrating a camera rig system, the computer program instructions when executed by a computer processor causes the processor to perform steps of:
receiving configuration information about a plurality of cameras in the camera rig system, the plurality of cameras sharing an overlapped part in their respective fields of view in which a test object is located; and
for each adjacent pair of cameras of the plurality of cameras:
identifying calibration parameters for the pair of cameras;
receiving a plurality of images of the test object captured by the pair of cameras, the test object having known calibration measures;
creating a 3D model of the test object based on the identified calibration parameters and the received plurality of images;
calculating a calibration error that reflects differences between calibration measures of the created 3D model of the test object and the known calibration measures of the test object; and
modifying the calibration parameters for the pair of cameras to reduce the calibration error.

### Claim 10 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the configuration information includes, for each camera among the plurality of cameras, position and orientation relative to the other cameras among the plurality of cameras.

### Claim 11 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the calibration measures of the test object include at least one of the following: location, size, texture, shape and detailed information of visually distinguishable points on the test object.

### Claim 12 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the calibration parameters include rotation and translation information for each camera of the pair of cameras.

### Claim 13 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the camera rig system includes a plurality of cameras and a plurality of known objects, wherein each known object is viewed by at least two cameras and each camera views at least two known objects.

### Claim 14 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, further comprising performing additional iterations of calibration until the calibration error is below a calibration error threshold.

### Claim 15 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the camera rig system includes a plurality of peripheral cameras, at least one top axis camera, and at least one bottom axis camera.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the at least one top axis camera and at least one bottom axis camera are vertically offset relative to the plurality of peripheral cameras to limit overlap between fields of view.
