# US 2025/0085192 A1 · Method for online obtaining an initially extrinsic parameter of fisheye-lens cameras applied to surround-view stitching > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0085192 A1 - Document ID: US20250085192A1 - Status: Published application - Kind: A1 - Application number: 18/826,500 - Filed: 2024-09-06 - Published: 2025-03-13 - Earliest claimed: 2023-09-07 - Assignees: VIA Technologies, Inc. - Applicants: Via Technologies, Inc. - Inventors: Fan DONG; Chao-Chin CHANG - Web page: https://patentgrep.com/patent/US20250085192A1 ## CPC - G02B 27/0012: {Optical design, e.g. procedures, algorithms, optimisation routines} - G01M 11/0257: {by analyzing the image formed by the object to be tested} - G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images - G06T 5/80: Geometric correction - G06T 7/33: using feature-based methods - G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration - G06T 2200/32: involving image mosaicing - G06T 2207/10012: Stereo images - G06T 2207/20221: Image fusion; Image merging - G06T 2207/30256: Lane; Road marking - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G01M: TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method and system is provided in a simulation platform for optimizing the extrinsic parameters of fisheye-lens cameras installed on a vehicle. A simulated vehicle is established according to vehicular characteristics of associated actual vehicle over the simulated platform, thereby a lot of simulated checkerboard calibration plates are placed surrounding the simulated vehicle. A lot of simulated fisheye-lens cameras are generated and mounted on the simulated vehicle based on intrinsic parameters associated with actual fisheye lenses, and fisheye images are derived by using the simulated fisheye-lens cameras, respectively. The initially extrinsic parameters of each of the simulated fisheye-lens cameras are calculated over the simulated platform by using the first characteristic points of its own first fisheye image. Those initially extrinsic parameters may be used to optimize stitching images of the vehicle-surrounding-view systems, or be used to calculate installation tolerances when disposing fisheye-lens cameras physically. ## Claims ### Claim 1 A method for online obtaining an initially extrinsic parameter of fisheye-lens cameras being disposed on a vehicle over a simulation platform, the method comprising: establishing a simulated vehicle in the simulation platform according to vehicular characteristics associated with an actual vehicle; establishing a simulated fisheye-lens camera in the simulation platform according to an intrinsic parameter associated with a fisheye lens of an actual fisheye-lens camera; and disposing the simulated fisheye-lens camera on the simulated vehicle; obtaining a characteristic point from a first fisheye image generated from the simulated fisheye-lens camera; and calculating the initially extrinsic parameter by means of a first characteristic point. ### Claim 2 (depends on 1) The method of claim 1, wherein the simulated platform automatically places a plurality of predetermined simulated calibration plates surrounding the simulated vehicle when a first shortcut key is activated. ### Claim 3 (depends on 1) The method of claim 1, wherein when a second shortcut key is activated, the simulated platform automatically disposes the simulated fisheye-lens camera on the simulated vehicle and the simulated fisheye-lens camera automatically generates first fisheye image. ### Claim 4 (depends on 3) The method of claim 3, wherein the simulated platform automatically stores the first fisheye images after the first fisheye images are generated. ### Claim 5 (depends on 1) The method of claim 1, further comprising the step of disposing plurality of simulated calibration plates surrounding the simulated vehicle. ### Claim 6 (depends on 5) The method of claim 5, wherein the characteristic point is an interior vertex point of one of the simulated calibration plates. ### Claim 7 (depends on 6) The method of claim 6, further comprising: obtaining a position of the interior vertex point in a world coordinate system by using a calibration-plate-corner detection algorithm; and generating the initial extrinsic parameters according to the position of the interior vertex point in the world coordinate system. ### Claim 8 (depends on 1) The method of claim 1, wherein the simulated platform automatically aligns camera coordinate systems with a world coordinate system after the initial extrinsic parameters of the simulated fisheye-lens cameras are generated. ### Claim 9 (depends on 8) The method of claim 8, wherein the simulated platform adjusts a transform matrix and a rotation matrix associated with the initial extrinsic parameters to align the camera coordinate systems with the world coordinate system. ### Claim 10 (depends on 1) The method as claimed in claim 1, wherein the initial extrinsic parameters are related to a position and rotation angle of the simulated fisheye-lens camera. ### Claim 11 (depends on 1) The method as claimed in claim 1, wherein the initial extrinsic parameters are applied to an application of object detection and recognition, 3D reconstruction, augmented reality (AR), machine vision and navigation, motion capture and pose estimation, or simultaneous localization and mapping (SLAM).