US 12,755,542 B2Granted

Artificial intelligence enabled distance event detection using image analysis

AssigneeMicron Technology, Inc.

InventorsYen-Ee New, Yih Fen Tan

Life of this patent

Estimating the term…

Loading patent…

Abstract

In some implementations, an image processing system may obtain, from one or more cameras, a stream of image frames. The image processing system may detect, using an object detection model, one or more objects depicted in one or more image frames included in the stream of image frames. The image processing system may generate one or more modified images, of the one or more image frames, including indications of detected objects depicted in the one or more image frames. The image processing system may calculate distances between one or more pairs of objects detected in the one or more modified images, the distances being calculated using the indications and a uniform view. The image processing system may detect one or more events based on one or more distances satisfying a threshold. The image processing system may provide a user interface for display that indicates the one or more events.

Claims25

Dependent claims

A system, comprising:

an ingestion component including:
one or more cameras configured to capture image frames;
and
a first one or more computing components configured to:
obtain image frames from the one or more cameras,
wherein each computing component, from the first one or more computing components, is associated with a respective camera from the one or more cameras;
an inferencing component including:
a second one or more computing components configured to:
obtain the image frames from the ingestion component;
and
provide the image frames to a graphics processing component for object detection processing;
and
the graphics processing component comprising a graphics processing unit (GPU) separate from the one or more second computing components, the graphics processing component configured to:
detect objects in the image frames using an artificial intelligence object detection model;
and
provide modified image frames that include an indication of detected objects depicted in the modified image frames;
a post-processing component including:
a third one or more computing components configured to:
obtain the modified image frames;
compute, for a modified image frame that includes indications of two or more objects, a vertical pixel distance between a first reference point of a first bounding box associated with a first object, of the two or more objects, and a second reference point of a second bounding box associated with a second object of the two or more objects;
compute a horizontal pixel distance between the first reference point and the second reference point;
modify, using a distance ratio, the vertical pixel distance to a vertical distance and the horizontal pixel distance to a horizontal distance;
compute one or more distances based on the vertical distance and the horizontal distance;
and
detect a violation based on a distance, from the one or more distances, satisfying a threshold.

22 more elements

A method, comprising:

obtaining, by an image processing system and from one or more cameras, a stream of image frames;
obtaining, by an inferencing component of the image processing system, one or more image frames included in the stream of image frames, wherein the inferencing component comprising one or more computing components;
detecting, by a graphics processing component of the image processing system and using an object detection model, one or more objects depicted in the one or more image frames, wherein the graphics processing unit comprises a graphics processing unit (GPU) separate from the one or more computing components;
generating, by the image processing system, one or more modified images of the one or more image frames, the one or more modified images including indications of detected objects depicted in the one or more image frames;
processing, by the image processing system, the one or more modified images to transform a perspective of the one or more modified images to a uniform view;
calculating, by the image processing system, distances between one or more pairs of objects detected in the one or more modified images, wherein calculating the distances between the one or more pairs of objects comprises:
calculating, for a pair of objects from the one or more pairs of objects, a first pixel distance between a first indication of a first object depicted in a modified image and a second indication of a second object depicted in the modified image;
calculating a second pixel distance between the first indication and the second indication;
modifying, using a ratio value, the first pixel distance to a first actual distance and the second pixel distance to a second actual distance;
and
calculating a distance between the first object and the second object based on the first actual distance and the second actual distance;
detecting, by the image processing system, one or more events based on one or more distances, from the distances, satisfying a threshold;
and
providing, by the image processing system, a user interface for display that indicates the one or more events detected based on the stream of image frames.

11 more elements

An apparatus, comprising:

means for obtaining a stream of images from a set of cameras;
means for obtaining, by an inferencing component, one or more image frames included in the stream of image frames, wherein the inferencing component comprising one or more computing components;
means for detecting, by a graphics processing component, one or more objects depicted in the one or more images, wherein the graphics processing unit comprises a graphics processing unit (GPU) separate from the one or more computing components;
means for inserting bounding boxes indicating detected objects depicted in the one or more images;
means for transforming a view of the one or more images to a uniform perspective;
means for calculating distances between two or more objects depicted in the one or more images, the distances being based on pixel distances between respective bounding boxes associated with the two or more objects, wherein the means for calculating the distances between the two or more of objects comprises:
means for calculating, for a pair of objects from the two or more objects, a first pixel distance between a first indication of a first object depicted in a modified image and a second indication of a second object depicted in the modified image;
means for calculating a second pixel distance between the first indication and the second indication;
means for modifying, using a ratio value, the first pixel distance to a first actual distance and the second pixel distance to a second actual distance;
and
means for calculating a distance between the first object and the second object based on the first actual distance and the second actual distance;
means for detecting an event based on one or more distances, from the distances, satisfying a threshold;
and
means for providing a user interface for display that indicates information associated with the event.

11 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/494,442Filed 25 Oct 2023 · us provisional application
Priority: 8 Nov 2022
Published: US 2024/0153274 A19 May 2024
Granted: 6 Oct 2026
Term ends: Not estimatedThe source records don’t support an estimate.

Classification9 codes

G06V 20/52
Context or environment of the image: surveillance or monitoring of activities, e.g. for recognising suspicious objects
G06T 3/04
Geometric image transformations in the plane of the image: context-preserving transformations, e.g. by using an importance map
G06T 7/74
Using feature-based methods: involving reference images or patches
G06V 10/70
Arrangements for image or video recognition or understanding: using pattern recognition or machine learning