US 2023/0410323 A1 · MOVEMENT PREDICTION WITH INFRARED IMAGING

Abstract

An environment is captured with a set of sensors to generate a thermal image from an infrared sensor and a visual image from a visual light camera. The thermal image is used to predict movement of objects detected in the environment. The thermal image may be combined with the visual image as a channel of data with the visual image as an input to a prediction model that predicts object movement. Alternatively, the visual image may be used as a guide to identify relevant portions of the thermal image. Objects may be detected and segmented in the visual image and the corresponding portions of the thermal image are segmented and used to predict thermal characteristics for the object. The thermal characteristics may then be used for object movement prediction.

Claims18

Dependent claims

A method comprising:

receiving sensor data for an environment of an autonomous vehicle including a visual image of the environment and a thermal image of the environment;
identifying a set of objects in the environment based on the sensor data;
and
determining a movement prediction of an object in the set of objects based at least in part on a portion of the thermal image including the object.

1 more element

Dependencies are inferred from the claim text.

Movement prediction with infrared imaging

Life of this patent

Movement prediction with infrared imaging

Life of this patent

Abstract

Claims18