# US 2025/0085530 A1 · Method for obtaining installation tolerance for installing fisheye-lens camera on vehicle over simulated platform for online optimizing extrinsic parameters of fisheye-lens cameras applied to surround-view stitching

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0085530 A1
- Document ID: US20250085530A1
- Status: Published application
- Kind: A1
- Application number: 18/826,529
- Filed: 2024-09-06
- Published: 2025-03-13
- Earliest claimed: 2023-09-07
- Assignees: VIA Technologies, Inc.
- Applicants: Via Technologies, Inc.
- Inventors: Fan DONG; Chao-Chin CHANG; Ziyang SONG
- Web page: https://patentgrep.com/patent/US20250085530A1

## CPC

- G02B 27/0012: {Optical design, e.g. procedures, algorithms, optimisation routines}
- G01M 11/0257: {by analyzing the image formed by the object to be tested}
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 5/80: Geometric correction
- G06T 7/33: using feature-based methods
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 2200/32: involving image mosaicing
- G06T 2207/10012: Stereo images
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30256: Lane; Road marking
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G01M: TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method and system is provided in a simulation platform for optimizing the extrinsic parameters of fisheye-lens cameras installed on a vehicle. A simulated vehicle is established according to vehicular characteristics of associated actual vehicle over the simulated platform, thereby a lot of simulated checkerboard calibration plates are placed surrounding the simulated vehicle. A lot of simulated fisheye-lens cameras are generated and mounted on the simulated vehicle based on intrinsic parameters associated with actual fisheye lenses, and fisheye images are derived by using the simulated fisheye-lens cameras, respectively. The initially extrinsic parameters of each of the simulated fisheye-lens cameras are calculated over the simulated platform by using the first characteristic points of its own first fisheye image. Those initially extrinsic parameters may be used to optimize stitching images of the vehicle-surrounding-view systems, or be used to calculate installation tolerances when disposing fisheye-lens cameras physically.

## Claims

### Claim 1

A method of obtaining an installation tolerance for installing a fisheye-lens camera on a vehicle over a simulated platform for online optimizing extrinsic parameters of fisheye-lens cameras in stitching surround-view images, the method comprising:
generating a reference extrinsic parameter for one of plurality of simulated fisheye-lens cameras mounted on a simulated vehicle;
generating a third fisheye image;
generating a third stitching image by using the third fisheye image and a fisheye image generated by a fisheye-lens camera adjacent with the one of plurality of simulated fisheye-lens cameras generating the third fisheye image; and
outputting an offset as an installation tolerance if an error of the overlap regions of the third stitching image is larger than a stitching-error threshold.

### Claim 2 (depends on 1)

The method of claim 1, further comprising the step of increasing the offset an increment to generate an updated reference extrinsic parameters when the error of the overlap regions of the third stitching image is smaller than the stitching-error threshold.

### Claim 3 (depends on 2)

The method of claim 2, wherein the increment is a predetermined position offset or a rotation offset.

### Claim 4 (depends on 2)

The method of claim 2, wherein the increment is a random position offset or a random rotation offset.

### Claim 5 (depends on 2)

The method of claim 2, further comprising:
generating an update third fisheye image according to the updated reference extrinsic parameters;
generating a third stitching image by using the updated third fisheye image and a fisheye image generated by a fisheye-lens camera adjacent with the one of plurality of simulated fisheye-lens cameras generating the updated third fisheye image; and
determining if the errors of the overlap regions of the updated third stitching image is larger than the stitching-error threshold.

### Claim 6 (depends on 1)

The method of claim 1, wherein a thickness of a protective housing for a fisheye-lens camera associated with one of the simulated fisheye-lens cameras is smaller than the installation tolerance.

### Claim 7 (depends on 1)

The method of claim 1, wherein the reference extrinsic parameters is generated by introducing the offset into initial extrinsic parameters or optimized extrinsic parameters of the simulated fisheye-lens cameras.
