US 11,907,771 B2Granted

Action recognition device and action recognition method

AssigneesHyundai Motor Company, Kia Corporation

InventorsYoung Chul Yoon, Hyeon Seok Jung

Life of this patent

Estimating the term…

Loading patent…

Abstract

Disclosed are an action recognition device and an action recognition method for recognizing actions of multiple objects in real time. The action recognition device includes a camera for capturing an image, a target queue storing therein data about at least one target, a reasoner configured to perform action reasoning, and a computing device electrically connected to the camera, the target queue and the reasoner, wherein the computing device may update the target queue based on an object tracking result on the image, extract a target from the target queue, request the reasoner to perform action reasoning on the extracted target, and output an action recognition result based on an action reasoning result provided from the reasoner.

Claims17

Dependent claims

An action recognition device comprising:

a camera configured to capture an image;
a target queue configured to store data about at least one target;
a reasoner configured to perform action reasoning;
and
a computing device electrically connected to the camera, the target queue and the reasoner;
wherein the computing device is configured to:
update the target queue based on an object tracking result on the image;
extract a target from the target queue;
request the reasoner to perform action reasoning on the extracted target;
and
output an action recognition result based on an action reasoning result provided from the reasoner;
wherein the computing device is further configured to:
arrange objects included in the object tracking result based on depth information of the objects;
search the target queue for a target having the same identification information as identification information of each of the objects in the arrangement order;
and
update data about the searched target using data about each of the objects.

13 more elements

An action recognition method comprising:

receiving, by a computing device, an image from a camera;
updating, by the computing device, a target queue storing data about at least one target, based on an object tracking result on the image;
reasoning, by the computing device, an action of a target extracted from the target queue using a reasoner;
and
outputting, by the computing device, an action recognition result based on an action reasoning result obtained using the reasoner;
wherein the updating of the target queue includes:
arranging, by the computing device, objects included in the object tracking result based on depth information of the objects;
searching, by the computing device, the target queue for a target having the same identification information as identification information of each of the objects in the arrangement order;
and
updating, by the computing device, data about the searched target using data about each of the objects.

7 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/702,108Filed 23 Mar 2022
Priority: KR 10-2021-012415316 Sep 2021
Published: US 2023/0079308 A116 Mar 2023
Granted: 20 Feb 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification9 codes

G06F 9/52
Multiprogramming arrangements: program synchronisation; Mutual exclusion, e.g. by means of semaphores
G06V 20/52
Context or environment of the image: surveillance or monitoring of activities, e.g. for recognising suspicious objects
G06F 9/546
Interprogram communication: message passing systems or structures, e.g. queues
G06F 18/2155
Generating training patterns; Bootstrap methods, e.g. bagging or boosting: characterised by the incorporation of unlabelled data, e.g. multiple…

Family

US 2023/0079308 A1Pre-grant publication · published 16 Mar 2023
US 11,907,771 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key