# US 2017/0287167 A1 · Camera and camera calibration method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0287167 A1
- Document ID: US20170287167A1
- Status: Published application
- Kind: A1
- Application number: 15/474,940
- Filed: 2017-03-30
- Published: 2017-10-05
- Earliest claimed: 2016-03-30
- Assignees: Korea Advanced Institute of Science and Technology
- Applicants: Korea Advanced Institute of Science and Technology
- Inventors: In So KWEON; Hyowon HA; Yunsu BOK; Kyungdon JOO; Jiyoung JUNG
- Web page: https://patentgrep.com/patent/US20170287167A1

## CPC

- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- H04N 17/002: {for television cameras}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed is a camera calibration method of a calibration apparatus, including: receiving plural pattern image information photographed by a camera; setting points where edges of patterns of the plural pattern image information overlap with each other as a plurality of primary features; and calibrating the camera by using the plurality of primary features, in which the plural pattern image information includes first vertical pattern image information, second vertical pattern image information complementary to the first vertical pattern image information, first horizontal pattern image information, and second horizontal pattern image information complementary to the first horizontal pattern image information.

## Claims

### Claim 1

A camera calibration method of a calibration apparatus, comprising:
receiving plural pattern image information photographed by a camera;
setting points where edges of patterns of the plural pattern image information overlap with each other as a plurality of primary features; and
calibrating the camera by using the plurality of primary features,
wherein the plural pattern image information includes first vertical pattern image information, second vertical pattern image information complimentary to the first vertical pattern image information, first horizontal pattern image information, and second horizontal pattern image information complementary to the first horizontal pattern image information.

### Claim 2 (depends on 1)

The camera calibration method of claim 1, wherein:
the plural pattern image information further includes monochromatic pattern image information,
the method further comprising removing monochromatic pattern image information from the first vertical pattern image information, the second vertical pattern image information, the first horizontal pattern image information, and the second horizontal pattern image information.

### Claim 3 (depends on 2)

The camera calibration method of claim 2, further comprising:
generating plural pattern correction image information including first vertical pattern correction image information, second vertical pattern correction image information, first horizontal pattern correction image information, and second horizontal pattern correction image information by Gaussian-blurring the first vertical pattern image information, the second vertical pattern image information, the first horizontal pattern image information, and the second horizontal pattern image information.

### Claim 4 (depends on 3)

The camera calibration method of claim 3, wherein:
the setting of the points as the plurality of primary features includes,
generating vertical skeleton information by using the points where the edges of the patterns of the first vertical pattern correction image information and the second vertical pattern correction image information overlap with each other,
generating horizontal skeleton information by using the points where the edges of the patterns of the first horizontal pattern correction image information and the second horizontal pattern correction image information overlap with each other, and
setting points where the vertical skeleton information and the horizontal skeleton information overlap with each other as the plurality of primary features.

### Claim 5 (depends on 4)

The camera calibration method of claim 4, wherein:
the calibrating of the camera by using the plurality of primary features includes,
acquiring a plurality of first vertical pattern brightness profiles and a plurality of second vertical pattern brightness profiles in a plurality of vertical pattern gradient directions based on the plurality of primary features in each of the first vertical pattern correction image information and the second vertical pattern correction image information,
acquiring a plurality of first horizontal pattern brightness profiles and a plurality of second horizontal pattern brightness profiles in a plurality of horizontal pattern gradient directions based on the plurality of primary features in each of the first horizontal pattern correction image information and the second horizontal pattern correction image information,
acquiring a plurality of secondary features corresponding to the plurality of primary features by using the plurality of first vertical pattern brightness profiles, the plurality of second vertical pattern brightness profiles, the plurality of first horizontal pattern brightness profiles, and the plurality of second horizontal pattern brightness profiles, and
calibrating the camera by using the plurality of secondary features.

### Claim 6 (depends on 5)

The camera calibration method of claim 5, wherein:
the acquiring of the plurality of secondary features corresponding to the plurality of primary features includes,
acquiring a standard deviation of a plurality of anticipated Gaussian blur kernels corresponding to the plurality of secondary features.

### Claim 7 (depends on 5)

The camera calibration method of claim 5, wherein:
the acquiring of the plurality of secondary features corresponding to the plurality of primary features includes,
acquiring a plurality of vertical pattern single profiles by summing up the plurality of first vertical pattern brightness profiles and the plurality of second vertical pattern brightness profiles corresponding thereto,
acquiring a plurality of first vertical pattern anticipated brightness profiles and a plurality of second vertical pattern anticipated brightness profiles by separating the plurality of vertical pattern single profiles so that the brightness profiles minimally overlap with each other based on the plurality of primary features,
acquiring a plurality of horizontal pattern single profiles by summing up the plurality of first horizontal pattern brightness profiles and the plurality of second horizontal pattern brightness profiles corresponding thereto,
acquiring a plurality of first horizontal pattern anticipated brightness profiles and a plurality of second horizontal pattern anticipated brightness profiles by separating the plurality of horizontal pattern single profiles so that the brightness profiles minimally overlap with each other based on the plurality of primary features, and
acquiring the plurality of secondary features which allows values acquired by convoluting a plurality of anticipated Gaussian blur kernels with the plurality of first vertical pattern anticipated brightness profiles, the plurality of second vertical pattern anticipated brightness profiles, the plurality of first horizontal pattern anticipated brightness profiles, and the plurality of second horizontal pattern anticipated brightness profiles to have minimum differences from the plurality of first vertical pattern brightness profiles, the plurality of second vertical pattern brightness profiles, the plurality of first horizontal pattern brightness profiles, and the plurality of second horizontal pattern brightness profiles, with respect to the plurality of respective primary features.

### Claim 8 (depends on 5)

The camera calibration method of claim 5, wherein:
the calibrating of the camera by using the plurality of secondary features includes,
calculating a refraction correction vector to which a refractive index of a front panel of a display apparatus is reflected, and
acquiring parameters of the camera by using the refraction correction vector and the plurality of secondary features.

### Claim 9 (depends on 8)

The camera calibration method of claim 8, wherein:
the acquiring of the parameters of the camera further includes
acquiring the thickness of the front panel.

### Claim 10 (depends on 1)

The camera calibration method of claim 1, wherein:
the first vertical pattern image information is the vertical stripe pattern in which the first and second colors are alternated and the second vertical pattern image information is the vertical stripe pattern in which the second and first colors are alternated, which is complimentary to the first vertical pattern image information, and
the first horizontal pattern image information is the horizontal stripe pattern in which the first and second colors are alternated and the second horizontal pattern image information is the horizontal stripe pattern in which the second and first colors are alternated, which is complimentary to the first horizontal pattern image information.
