# US 2021/0243422 A1 · Data processing apparatus, data processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243422 A1
- Document ID: US20210243422A1
- Status: Published application
- Kind: A1
- Application number: 17/051,967
- Filed: 2019-04-25
- Published: 2021-08-05
- Earliest claimed: 2018-05-09
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: KENGO HAYASAKA; KATSUHISA ITO
- Web page: https://patentgrep.com/patent/US20210243422A1

## CPC

- H04N 13/246: Calibration of cameras
- H04N 17/002: {for television cameras}
- G06T 7/85: {Stereo camera calibration}
- H04N 13/225: using parallax barriers
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
- H04N 17/00: Diagnosis, testing or measuring for television systems or their details
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/67: Focus control based on electronic image sensor signals
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/957: Light-field or plenoptic cameras or camera modules
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present technology relates to a data processing apparatus, a data processing method, and a program that are capable of generating calibration data for performing appropriate image processing. The data processing apparatus performs interpolation to generate calibration data for a predetermined focus position by using calibration data for a plurality of focus positions. The calibration data for the plurality of focus positions is generated from a calibration image captured at the plurality of focus positions. The calibration image is obtained by capturing an image of a known object in the plurality of focus positions with a multi-lens camera that captures an image from two or more viewpoints. The present technology is applicable, for example, to a multi-lens camera that captures an image from two or more viewpoints.

## Claims

### Claim 1

A data processing apparatus comprising:
an interpolation section that performs interpolation to generate calibration data for a predetermined focus position by using calibration data for a plurality of focus positions, the calibration data for the plurality of focus positions being generated from a calibration image captured at the plurality of focus positions, the calibration image being obtained by capturing an image of a known object in the plurality of focus positions with a multi-lens camera that captures an image from two or more viewpoints.

### Claim 2 (depends on 1)

The data processing apparatus according to claim 1, wherein the interpolation section performs interpolation to generate calibration data for a focus position of the multi-lens camera that is employed when an image of a predetermined object is captured by the multi-lens camera.

### Claim 3 (depends on 1)

The data processing apparatus according to claim 1, wherein the calibration data includes information regarding positional displacement between a position where the known object is imaged within the calibration image and a true position where the known object should be imaged within the calibration image.

### Claim 4 (depends on 3)

The data processing apparatus according to claim 3, wherein the information regarding the positional displacement indicates a difference between the positional displacement of the calibration image captured from a standard viewpoint and the positional displacement of the calibration image captured from a viewpoint other than the standard viewpoint, the standard viewpoint being one of the two or more viewpoints of the multi-lens camera.

### Claim 5 (depends on 1)

The data processing apparatus according to claim 1, wherein the interpolation section performs interpolation to generate calibration data for a combination of a predetermined focus position and a predetermined zoom magnification by using calibration data for a combination of a plurality of different focus positions and a plurality of different zoom magnifications, the calibration data for the combination of the plurality of different focus positions and the plurality of different zoom magnifications being generated from a calibration image that is obtained by allowing the multi-lens camera to capture an image of the known object in the plurality of different focus positions at the plurality of different zoom magnifications.

### Claim 6 (depends on 1)

The data processing apparatus according to claim 1, further comprising:
a parallax information generation section that generates parallax information regarding parallax from a captured image by using the calibration data, the captured image being captured from two or more viewpoints by allowing the multi-lens camera to capture an image of a predetermined object.

### Claim 7

A data processing method comprising:
performing interpolation to generate calibration data for a predetermined focus position by using calibration data for a plurality of focus positions, the calibration data for the plurality of focus positions being generated from a calibration image captured at the plurality of focus positions, the calibration image being obtained by capturing an image of a known object in the plurality of focus positions with a multi-lens camera that captures an image from two or more viewpoints.

### Claim 8

A program causing a computer to function as:
an interpolation section that performs interpolation to generate calibration data for a predetermined focus position by using calibration data for a plurality of focus positions, the calibration data for the plurality of focus positions being generated from a calibration image captured at the plurality of focus positions, the calibration image being obtained by capturing an image of a known object in the plurality of focus positions with a multi-lens camera that captures an image from two or more viewpoints.

### Claim 9

A data processing method comprising:
generating calibration data for a plurality of focus positions from a calibration image captured at a plurality of focus positions, the calibration image being obtained by capturing an image of a known object in the plurality of focus positions with a multi-lens camera that captures an image from two or more viewpoints.
