US 11,706,377 B2 · Visual, depth and micro-vibration data extraction using a unified imaging device

Abstract

A unified imaging device used for detecting and classifying objects in a scene including motion and micro-vibrations by receiving a plurality of images of the scene captured by an imaging sensor of the unified imaging device comprising a light source adapted to project on the scene a predefined structured light pattern constructed of a plurality of diffused light elements, classifying object(s) present in the scene by visually analyzing the image(s), extracting depth data of the object(s) by analyzing position of diffused light element(s) reflected from the object(s), identifying micro-vibration(s) of the object(s) by analyzing a change in a speckle pattern of the reflected diffused light element(s) in at least some consecutive images and outputting the classification, the depth data and data of the one or more micro-vibrations which are derived from the analyses of images captured by the imaging sensor and are hence inherently registered in a common coordinate system.

Claims20

Dependent claims

A unified imaging device comprising:

a light source adapted to project a predefined structured light pattern constructed of a plurality of diffused light elements onto a scene;
an imaging sensor that captures a plurality of images of the scene;
a processor that:
classifies at least one object present in the scene by visually analyzing at least one of the plurality of images;
extracts depth data of the at least one object by analyzing a position of at least one of the plurality of diffused light elements reflected from the at least one object;
and
identifies at least one micro-vibration of the at least one object by analyzing a change in a speckle pattern of at least one of the plurality of reflected diffused light elements in at least some consecutive images of the plurality of images, wherein the change in the speckle pattern is identified by applying a speckle pattern translation to the speckle pattern with respect to at least one adjacent point in the speckle pattern, and wherein an angular velocity is indicative of the at least one micro-vibration.

4 more elements

Dependencies are inferred from the claim text.

Visual, depth and micro-vibration data extraction using a unified imaging device

Life of this patent

Visual, depth and micro-vibration data extraction using a unified imaging device

Life of this patent

Abstract

Claims20