# US 2019/0379806 A1 · Characterizing optical characteristics of optical elements

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0379806 A1
- Document ID: US20190379806A1
- Status: Published application
- Kind: A1
- Application number: 16/005,590
- Filed: 2018-06-11
- Published: 2019-12-12
- Earliest claimed: 2018-06-11
- Assignees: Pony AI Inc.
- Applicants: Pony.ai, Inc.
- Inventors: Yubo Zhang; Xiang Yu; Tiancheng Lou; Jun Peng; Kai Chen; Yiming Liu; Sinan Xiao; Tianyi Li; Yin Zhong; Hao Song
- Web page: https://patentgrep.com/patent/US20190379806A1

## CPC

- H04N 17/002: {for television cameras}
- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- G06T 7/557: from light fields, e.g. from plenoptic cameras
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- H04N 23/58: Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
- H04N 23/60: Control of cameras or camera modules
- H04N 23/63: by using electronic viewfinders
- G06T 2207/30108: Industrial image inspection
- G06T 2207/30244: Camera pose
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems, methods, and non-transitory computer readable media may be configured to characterize optical characteristics of optical elements. An optical element mount may be configured to carry an optical element. A calibration display may be configured to display a calibration object. The calibration object may include a known visual pattern. Multiple images of the calibration object may be obtained. The multiple images may be acquired using the optical element carried by the optical element mount. The multiple images may include different perspectives of the calibration object. Optical characteristics of the optical element may be characterized based on the known visual pattern and the different perspectives of the calibration object.

## Claims

### Claim 1

A system comprising:
an optical element mount configured to carry an optical element;
a calibration display configured to display a calibration object, the calibration object including a known visual pattern;
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, cause the system to perform:
obtaining multiple images of the calibration object captured using the optical element carried by the optical element mount, wherein the multiple images include different perspectives of the calibration object; and
characterizing optical characteristics of the optical element based on the known visual pattern and the different perspectives of the calibration object.

### Claim 2 (depends on 1)

The system of claim 1, wherein the optical element includes a lens, and the optical characteristics include a curvature of the lens and imperfections in the curvature of the lens.

### Claim 3 (depends on 1)

The system of claim 1, further comprising an image sensor mount configured to carry an image sensor, wherein the instructions, when executed by the one or more processors, further cause the system to perform calibrating the image sensor based on the optical characteristics of the optical element, wherein the calibration of the image sensor compensates for distortion of light traveling through the optical element due to the optical characteristics of the optical element.

### Claim 4 (depends on 3)

The system of claim 3, wherein at least one of the optical element mount and the image sensor mount is movable with respect to the other.

### Claim 5 (depends on 3)

The system of claim 3, wherein the multiple images including the different perspectives of the calibration object are captured based on movement of the optical element mount with respect to the calibration object.

### Claim 6 (depends on 5)

The system of claim 5, wherein the multiple images are captured based on:
movement of the optical element mount into different poses;
detection of whether the calibration object is visible to the image sensor at the different poses based on recognition of the known visual pattern;
detection of whether the optical element mount is stable at the different poses; and
acquisition of the multiple images based on the calibration object being visible to the image sensor and the optical element being stable at the different poses.

### Claim 7 (depends on 6)

The system of claim 6, wherein the multiple images are classified based on similarity of the different poses.

### Claim 8 (depends on 1)

The system of claim 1, wherein the calibration display includes a light field display, and the multiple images including the different perspectives of the calibration object are acquired based on changes in angles or depths of the calibration object displayed by the light field display.

### Claim 9 (depends on 1)

The system of claim 1, wherein the optical characteristics of the optical element that are characterized are limited to a portion of the optical element.

### Claim 10

A method implemented by a computing system including one or more processors and storage media storing machine-readable instructions, wherein the method is performed using the one or more processors, the method comprising:
obtaining multiple images of the calibration object acquired using an optical element carried by an optical element mount, wherein the multiple images include different perspectives of a calibration object displayed by a calibration display, the calibration object including a known visual pattern; and
characterizing optical characteristics of the optical element based on the known visual pattern and the different perspectives of the calibration object.

### Claim 11 (depends on 10)

The method of claim 10, wherein the optical element includes a lens, and the optical characteristics include a curvature of the lens and imperfections in the curvature of the lens.

### Claim 12 (depends on 10)

The method of claim 10, further comprising calibrating an image sensor based on the optical characteristics of the optical element, the image sensor carried by an image sensor mount, wherein the calibration of the image sensor compensates for distortion of light traveling through the optical element due to the optical characteristics of the optical element.

### Claim 13 (depends on 12)

The method of claim 12, wherein at least one of the optical element mount and the image sensor mount is movable with respect to the other.

### Claim 14 (depends on 12)

The method of claim 12, wherein the multiple images including the different perspectives of the calibration object are acquired based on movement of the optical element mount with respect to the calibration object.

### Claim 15 (depends on 14)

The method of claim 14, wherein the multiple images are acquired based on:
movement of the optical element mount into different poses;
detection of whether the calibration object is visible to the image sensor at the different poses based on recognition of the known visual pattern;
detection of whether the optical element mount is stable at the different poses; and
acquisition of the multiple images based on the calibration object being visible to the image sensor and the optical element being stable at the different poses.

### Claim 16 (depends on 15)

The method of claim 15, wherein the multiple images are classified based on similarity of the different poses.

### Claim 17 (depends on 10)

The method of claim 10, wherein the calibration display includes a light field display, and the multiple images including the different perspectives of the calibration object are acquired based on changes in angles or depths of the calibration object displayed by the light field display.

### Claim 18 (depends on 10)

The method of claim 10, wherein the optical characteristics of the optical element that are characterized are limited to a portion of the optical element.

### Claim 19

A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to perform:
obtaining multiple images of the calibration object acquired using an optical element carried by an optical element mount, wherein the multiple images include different perspectives of a calibration object displayed by a calibration display, the calibration object including a known visual pattern; and
characterizing optical characteristics of the optical element based on the known visual pattern and the different perspectives of the calibration object.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein:
an image sensor mount is configured to carry an image sensor;
at least one of the optical element mount and the image sensor mount is movable with respect to the other; and
the instructions, when executed, further cause the one or more processors to perform calibrating the image sensor based on the optical characteristics of the optical element, wherein the calibration of the image sensor compensates for distortion of light traveling through the optical element due to the optical characteristics of the optical element.
