# US 2025/0148830 A1 · Action evaluation system, action evaluation method, and non-transitory computer-readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148830 A1
- Document ID: US20250148830A1
- Status: Published application
- Kind: A1
- Application number: 18/835,088
- Filed: 2022-02-09
- Published: 2025-05-08
- Earliest claimed: 2022-02-09
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Noboru YOSHIDA; Ryo KAWAI; Jianquan LIU
- Web page: https://patentgrep.com/patent/US20250148830A1

## CPC

- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G06Q 10/06398: {Performance of employee with respect to a job function}
- G06T 7/00: Image analysis
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- Y02P 90/30: Computing systems specially adapted for manufacturing
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- Y02P: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS

## Abstract

According to the present disclosure, it is possible to provide an action evaluation system, an action evaluation method, and the like for appropriately evaluating efficiency of a series of operations performed by a worker. An action evaluation system according to an example embodiment can include an action detection unit that detects a plurality of unit actions included in a series of operations performed by a worker from image data, according to a stored unit action pattern, and a time measurement unit that measures a time taken for the series of operations. The time measurement unit can also measure a time of each detected unit action and a time between the unit actions.

## Claims

### Claim 1

An action evaluation system comprising:
at least one memory storing instructions, and at least one processor configured to execute the instructions to;
detect a plurality of unit actions included in a series of operations performed by a worker from image data, according to a stored unit action pattern; and
measure a time taken for the series of operations.

### Claim 2 (depends on 1)

The action evaluation system according to claim 1, wherein the at least one processor is configured to execute the instructions to measure a time of each unit action included in the series of operations and a time between the unit actions.

### Claim 3 (depends on 1)

The action evaluation system according to claim 1, wherein the at least one processor is configured to execute the instructions to set a feature point and a pseudo skeleton of a body of a person based on the image data and detects a plurality of unit actions included in the series of operations from the image data, according to a stored unit action pattern.

### Claim 4 (depends on 1)

The action evaluation system according to claim 1, wherein the at least one processor is configured to execute the instructions to recognize an action of a body of a person in time series based on the image data in a plurality of consecutive frames.

### Claim 5 (depends on 1)

The action evaluation system according to claim 1, wherein the at least one processor is further configured to execute the instructions to store the unit action pattern in a plurality of consecutive frames.

### Claim 6 (depends on 1)

The action evaluation system according to claim 1, wherein the at least one processor is configured to execute the instructions to specify a position of the worker from the image data; and detect a plurality of unit actions included in a series of operations performed by the worker, according to a unit action pattern associated with the specified position.

### Claim 7 (depends on 1)

The action evaluation system according to claim 1, wherein the at least one processor is configured to execute the instructions to detect a start action and an end action of a unit action to recognize a type of the unit action.

### Claim 8 (depends on 1)

The action evaluation system according to claim 1, wherein the at least one processor is configured to execute the instructions to detect an unnecessary action pattern included in the series of operations according to a stored unnecessary action pattern not included in the series of operations.

### Claim 9 (depends on 1)

The action evaluation system according to claim 1, wherein at least one processor is configured to execute the instructions to recognize an object included in the image data; and
wherein the action detection means detects detect a unit action included in a series of operations performed by the worker based on an object accompanying the worker.

### Claim 10 (depends on 1)

The action evaluation system according to claim 1, wherein at least one processor is configured to execute the instructions to further perform comparison and evaluation between a time of the series of operations performed by the worker and a time of a reference operation stored in advance.

### Claim 11 (depends on 1)

The action evaluation system according to claim 1, wherein
the series of operations includes a plurality of unit actions performed by the worker on an operation object,
the at least one processor is configured to execute the instructions to receive attribute data related to an attribute of the operation object;
determine whether or not a unit action is similar to a stored action pattern corresponding to the attribute; and detect the unit action.

### Claim 12 (depends on 1)

The action evaluation system according to claim 1, wherein the series of operations includes a plurality of unit actions performed by the worker on an operation object, and the plurality of unit actions is performed in any order.

### Claim 13

An action evaluation method comprising:
detecting a plurality of unit actions included in a series of operations performed by a worker from image data, according to a stored unit action pattern; and
measuring a time taken for the series of operations.

### Claim 14

A non-transitory computer-readable medium storing a program for causing a computer to execute:
detecting a plurality of unit actions included in a series of operations performed by a worker from image data, according to a stored unit action pattern; and
measuring a time taken for the series of operations.
