US 2025/0164639 A1 · SENSING SYSTEM AND CALIBRATION METHOD FOR POINT CLOUD AND IMAGE

Abstract

The invention proposes a sensing system for point clouds and images. The system includes a point cloud sensor, an image sensor, and a computing module. The point cloud sensor captures point cloud information of a target object. The image sensor captures a two-dimensional image of the target object. The computing module extracts three-dimensional feature points from the point cloud information and two-dimensional feature points from the two-dimensional image, and calculates multiple coefficients in a transformation matrix based on coordinates of the three-dimensional feature points and coordinates of the two-dimensional feature points. The computing module also performs a coordinate transformation process on the point cloud information or the two-dimensional image according to the transformation matrix.

Claims17

Dependent claims

A point cloud and image sensing system, comprising:

a point cloud sensor configured to capture point cloud information of a target object;
an image sensor configured to capture a two-dimensional image of the target object;
and
a computing module communicatively connected to the point cloud sensor and the image sensor, wherein the computing module is configured to extract a plurality of three-dimensional feature points from the point cloud information, and extract a plurality of two-dimensional feature points from the two-dimensional image, and calculate a plurality of coefficients in a transformation matrix based on a plurality of coordinates of the three-dimensional feature points and a plurality of coordinates of the two-dimensional feature points;
wherein the computing module performs a coordinate transformation process on the point cloud information or the two-dimensional image according to the transformation matrix.

2 more elements

A calibration method for point cloud and image, executed by a computer system, wherein the calibration method comprises:

capturing point cloud information of a target object through a point cloud sensor;
capturing a two-dimensional image of the target object through an image sensor;
extracting a plurality of three-dimensional feature points from the point cloud information, and extracting a plurality of two-dimensional feature points from the two-dimensional image;
calculating a plurality of coefficients in a transformation matrix based on a plurality of coordinates of the three-dimensional feature points and a plurality of coordinates of the two-dimensional feature points;
and
performing a coordinate transformation process on the point cloud information or the two-dimensional image according to the transformation matrix.

3 more elements

Dependencies are inferred from the claim text.

Sensing system and calibration method for point cloud and image

Life of this patent

Sensing system and calibration method for point cloud and image

Life of this patent

Abstract

Claims17