US 2023/0419660 A1Published application

System and method for remote labelling of hyperspectral data

AssigneeSharper Shape Oy

InventorsJaro Uljanovs, Rami Piiroinen, Hyeong-Jin Kim

Life of this patent

Estimating the term…

Loading patent…

Abstract

A system for remote labelling of hyperspectral data, the system including: visible-light camera(s), hyperspectral camera(s), Light Detection and Ranging (LiDAR) scanner for capturing LiDAR data, geolocation device for generating geolocation data, and processor(s) configured to: control hyperspectral camera(s) to capture hyperspectral image(s) of first location in real-world environment; control visible-light camera(s) to capture visible-light image(s) of first location; georeference hyperspectral image(s) and visible-light image(s) using at least LiDAR data and geolocation data; align hyperspectral image(s) and visible-light image(s) with respect to each other in pixel-wise manner; and label pixels of hyperspectral image(s) to generate labelled hyperspectral image(s), by using corresponding pixels of visible-light image(s) as ground truth material.

Claims15

Dependent claims

A system for remote labelling of hyperspectral data, the system comprising:

at least one visible-light camera arranged on an aerial vehicle that is employed for surveying a real-world environment;
at least one hyperspectral camera arranged on the aerial vehicle;
a Light Detection and Ranging (LiDAR) scanner arranged on the aerial vehicle, wherein the LiDAR scanner, in operation, captures LiDAR data of the real-world environment;
a geolocation device that, in operation, generates geolocation data of the aerial vehicle;
and
at least one processor configured to:
control the at least one hyperspectral camera to capture at least one hyperspectral image of a first location in the real-world environment;
control the at least one visible-light camera to capture at least one visible-light image of the first location;
georeference the at least one hyperspectral image and the at least one visible-light image using at least the LiDAR data and the geolocation data;
align the at least one hyperspectral image and the at least one visible-light image with respect to each other in a pixel-wise manner;
and
label pixels of the at least one hyperspectral image to generate at least one labelled hyperspectral image, by using corresponding pixels of the at least one visible-light image as ground truth material.

9 more elements

A method for remote labelling of hyperspectral data, the method comprising:

controlling at least one hyperspectral camera to capture at least one hyperspectral image of a first location in a real-world environment;
controlling at least one visible-light camera to capture at least one visible-light image of the first location;
georeferencing the at least one hyperspectral image and the at least one visible-light image using at least Light Detection and Ranging (LiDAR) data captured by a LiDAR scanner and geolocation data generated by a geolocation device;
aligning the at least one hyperspectral image and the at least one visible-light image with respect to each other in a pixel-wise manner;
and
labelling pixels of the at least one hyperspectral image for generating at least one labelled hyperspectral image, by using corresponding pixels of the at least one visible-light image as ground truth material.

3 more elements

Dependencies are inferred from the claim text.