# US 2017/0372491 A1 · Computer-Implemented Method Of Calibrating A Camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0372491 A1
- Document ID: US20170372491A1
- Status: Published application
- Kind: A1
- Application number: 15/601,619
- Filed: 2017-05-22
- Published: 2017-12-28
- Earliest claimed: 2016-06-28
- Assignees: Dassault Systemes
- Applicants: Dassault Systemes
- Inventors: Fivos Doganis
- Web page: https://patentgrep.com/patent/US20170372491A1

## CPC

- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 7/13: Edge detection
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- H04N 5/44504: {Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits}
- H04N 17/002: {for television cameras}
- H04N 23/63: by using electronic viewfinders
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30208: Marker matrix
- G06T 2207/30244: Camera pose
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A computer-implemented method of calibrating a camera, comprises the steps of: a. acquiring a video stream from said camera (CAM), and displaying it on a screen (DY); b. displaying on the screen, superimposed to the video stream, a representation of a target area (102); c. detecting a calibration pattern (100) in the video stream and periodically check whether it fits within the calibration area; d. when the calibration pattern is found to fit within the calibration area, extracting an image thereof from the video stream; said steps a. to d. being iterated a plurality of times using respective target areas corresponding to different positions of a physical support (101) carrying the calibration pattern; and then e. estimating intrinsic calibration parameters of the camera by processing said images. A computer program product, computer-readable data-storage medium and computer system for carrying out such a method.

## Claims

### Claim 1

A computer-implemented method of calibrating a camera, comprising the steps of:
a. acquiring a video stream from said camera (CAM), and displaying it on a screen (DY);
b. displaying on the screen, superimposed to the video stream, a representation of a target area (102);
c. detecting a calibration pattern (100) in the video stream and periodically check whether it fits within the target area;
d. when the calibration pattern is found to fit within the target area, extracting an image thereof from the video stream and storing it;
said steps a. to d. being iterated a plurality of times using respective target areas, different from each other, each target area corresponding to the outline of the calibration pattern as seen by the camera when a physical support (101) carrying it takes a respective position within a field of view of the camera; and then
e. estimating intrinsic calibration parameters of the camera by processing the stored images.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein said step c. comprises checking whether the calibration pattern fills at least a predetermined fraction of the target area.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein said step c. comprises detecting at least one edge (202) of the calibration pattern and checking its parallelism with a corresponding edge (201) of the target area.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein said step c. comprises detecting at least two edges of the calibration pattern, measuring an angle between said edges and comparing it with an angle between two corresponding edges of the target area.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein said step c. comprises detecting at least one corner (206) of the calibration pattern and checking its proximity to a corresponding corner (205) of the target area.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising a step c′ of displaying on the screen at least one graphical pattern (203, 204) indicating at least one of:
a distance between a point of the calibration pattern and a corresponding point of the target area;
a direction of a translation required to make a point of the calibration pattern coincide with a corresponding point of the target area; and
a correspondence between geometrical elements of the calibration pattern and of the target area.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1 wherein steps a. to d. are iterated a number of times comprised between 10 and 20, using respective target areas corresponding to different positions of said physical support.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1 wherein at least a majority of said positions of the physical support are neither perpendicular nor parallel to an optical axis of the camera.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1 wherein said calibration pattern is a planar pattern.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1 wherein said step e. is carried out using Zhang's algorithm.

### Claim 11

A computer program product, stored on a computer-readable data-storage medium (M1, M2, M3, M4), comprising:
an interface to a camera, the interface formed of computer-executable instructions that cause a computer system interfaced to the camera (CAM) to:
a. acquire a video stream from said camera (CAM), and display it on a display screen;
b. display on the screen, superimposed to the video stream, a representation of a target area;
c. detect a calibration pattern in the video stream and periodically check whether it fits within the target area;
d. when the calibration pattern is found to fit within the target area, extract an image thereof from the video stream and store it;
said steps a. to d. being iterated a plurality of times using respective target areas, different from each other, each target area corresponding to the outline of the calibration pattern as seen by the camera when a physical support carrying it takes a respective position within a field of view of the camera; and then
e. estimate intrinsic calibration parameters of the camera by processing the stored images.

### Claim 12

A computer-readable data-storage medium (M1, M2, M3, M4) comprising:
computer-executable instructions embodying camera calibration including computer-executable instructions that cause a computer system interfaced to a camera to:
a. acquire a video stream from said camera (CAM), and display it on a display screen;
b. display on the screen, superimposed to the video stream, a representation of a target area;
c. detect a calibration pattern in the video stream and periodically check whether it fits within the target area;
d. when the calibration pattern is found to fit within the target area, extract an image thereof from the video stream and store it in memory;
said steps a. to d. being iterated a plurality of times using respective target areas, different from each other, each target area corresponding to the outline of the calibration pattern as seen by the camera when a physical support carrying it takes a respective position within a field of view of the camera; and then
e. estimate intrinsic calibration parameters of the camera by processing the stored images.

### Claim 13

A computer system comprising:
a processor (P) coupled to a memory (M1, M2, M3, M4);
a display screen (DY); and
a camera (CAM),
the memory storing computer-executable instructions that cause the computer system to calibrate the camera by:
a. acquiring a video stream from said camera (CAM), and displaying it on a display screen;
b. displaying on the screen, superimposed to the video stream, a representation of a target area;
c. detecting a calibration pattern in the video stream and periodically check whether it fits within the target area;
d. when the calibration pattern is found to fit within the target area, extracting an image thereof from the video stream and storing it;
said steps a. to d. being iterated a plurality of times using respective target areas, different from each other, each target area corresponding to the outline of the calibration pattern as seen by the camera when a physical support carrying it takes a respective position within a field of view of the camera; and then
e. estimating intrinsic calibration parameters of the camera by processing the stored images.

### Claim 14 (depends on 13)

A computer system of claim 13 wherein said detecting comprises checking whether the calibration pattern fills at least a predetermined fraction of the target area.

### Claim 15 (depends on 13)

A computer system of claim 13 wherein said detecting comprises detecting at least one edge of the calibration pattern and checking its parallelism with a corresponding edge of the target area.

### Claim 16 (depends on 13)

A computer system of claim 13 wherein said detecting comprises detecting at least two edges of the calibration pattern, measuring an angle between said edges and comparing it with an angle between two corresponding edges of the target area.

### Claim 17 (depends on 13)

A computer system of claim 13 wherein said detecting comprises detecting at least one corner of the calibration pattern and checking its proximity to a corresponding corner of the target area.

### Claim 18 (depends on 13)

A computer system of claim 13 further comprising a step c′ of displaying on the screen at least one graphical pattern indicating at least one of:
a distance between a point of the calibration pattern and a corresponding point of the target area;
a direction of a translation required to make a point of the calibration pattern coincide with a corresponding point of the target area; and
a correspondence between geometrical elements of the calibration pattern and of the target area.

### Claim 19 (depends on 13)

A computer system of claim 13 wherein said calibration pattern is a planar pattern.

### Claim 20 (depends on 13)

A computer system of claim 13 wherein said estimating is carried out using Zhang's algorithm.
