US 12,770,295 B2Granted

Sensor calibration

AssigneeNVIDIA Corporation

InventorsHsin Miao, Sergei Lupashin, Ayon Sen, Yue Wu, Gang Pan, Art Tevs, Minwoo Park

Life of this patent

Estimating the term…

Loading patent…

Abstract

In various examples, epipolar constraint-based cross-camera calibration validation is disclosed. For a pair of cameras that have partially overlapping fields of view, a shared region of their overlapping fields of view may be extracted and used as the basis to perform an epipolar constraint-guided feature descriptor matching process. A camera calibration metric may be computed based on the degree to which a feature descriptor appearing at a pixel of the first image aligns as expected in the second image with an epipolar line associated with the pixel of the first image, where the epipolar line is computed using extrinsic camera calibration parameters associated with the pair of cameras. Epipolar matching may be performed for a plurality of feature points and an aggregate validation score computed based on measuring the computed deviations for each feature. A sensitivity analysis may be applied to better assess the usefulness of the validation score.

Claims20

Dependent claims

One or more processors comprising processing circuitry to:

detect a shared region appearing in one or more pairs of image frames from at least one pair of cameras having at least partially overlapping fields of view;
extract at least one pair of cross-camera view images comprising the shared region from the one or more pairs of image frames from at least one pair of cameras having at least partially overlapping fields of view;
associate at least one feature point of a feature detected from a first view image of the at least one pair of cross-camera view images with at least one matching feature point from a second view image of the at least one pair of cross-camera view images;
compute for the second view image at least one epipolar line based at least on a location of the at least one feature point within the first view image;
determine a calibration validation score for the at least one pair of cameras based at least on a deviation between a location of the at least one matching feature point and the at least one epipolar line;
and
generate an indication of whether a current calibration between the at least one pair of cameras is valid for continued use based at least on a determination of whether the calibration validation score satisfies a validation criteria.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/609,302Filed 19 Mar 2024
Published: US 2025/0299365 A125 Sep 2025
Granted: 20 Oct 2026
Term ends: Not estimatedThe source records don’t support an estimate.

Classification5 codes

G06T 7/80
Image analysis: analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
G06V 10/44
Extraction of image or video features: local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops,…
G06V 10/751
Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g.…:…
G06T
Image data processing or generation, in general

Family

US 2025/0299365 A1Pre-grant publication · published 25 Sep 2025
US 12,770,295 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key