# US 2025/0157046 A1 · Motion evaluation apparatus, motion evaluation method, and non-transitory computer-readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157046 A1
- Document ID: US20250157046A1
- Status: Published application
- Kind: A1
- Application number: 18/836,400
- Filed: 2022-03-18
- Published: 2025-05-15
- Earliest claimed: 2022-03-18
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Noboru YOSHIDA; Ryo KAWAI; Jianquan LIU
- Web page: https://patentgrep.com/patent/US20250157046A1

## CPC

- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/251: {involving models}
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 20/48: {Matching video sequences}
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A motion evaluation apparatus includes: motion identification unit for extracting skeletal information of a person in an acquired image and identifying an evaluation target motion related to a body of the person based on the extracted skeletal information of the person and a registered motion pattern formed by stored skeletal information; and evaluation unit for evaluating similarity between the evaluation target motion and a sample motion pattern formed by stored skeletal information, based on an integrated evaluation value including a first evaluation value that is based on a deviation amount of the skeletal information in a temporal axis direction and a second evaluation value that is based on a deviation amount of the skeletal information of the person in a spatial axis direction.

## Claims

### Claim 1

A motion evaluation apparatus comprising:
at least one memory storing instructions, and
at least one processor configured to execute the instructions to;
extract skeletal information of a person in an acquired image;
identify an evaluation target motion related to a body of the person based on the extracted skeletal information of the person and a registered motion pattern formed by stored skeletal information; and
evaluate similarity between the evaluation target motion and a sample motion pattern formed by stored skeletal information, based on an integrated evaluation value including a first evaluation value that is based on a deviation amount of the skeletal information in a temporal axis direction and a second evaluation value that is based on a deviation amount of the skeletal information of the person in a spatial axis direction.

### Claim 2 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the deviation amount of the skeletal information in the temporal axis direction is calculated from a distance between associated frames by matching the sample motion pattern with a motion start point of the evaluation target motion and associating each frame based on similarity of the skeletal information of each frame.

### Claim 3 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the deviation amount of the skeletal information in the spatial axis direction is obtained by associating a sample motion and an evaluation target motion similar to each other and calculating a deviation amount of a geometric shape of the skeletal information.

### Claim 4 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the at least one processor is configured to execute the instructions to identify the evaluation target motion based on instruction information of a user.

### Claim 5 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the at least one processor is configured to execute the instructions to select at least one sample motion pattern from a plurality of sample motion patterns formed by skeletal information for evaluating a motion of the person and having different evaluation criteria for a body part of interest.

### Claim 6 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the at least one processor is configured to execute the instructions to evaluate the deviation amount of the skeletal information of the person in the spatial axis direction, after the skeletal information related to the evaluation target motion and the skeletal information related to the sample motion pattern are normalized.

### Claim 7 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the at least one processor is configured to execute the instructions to output an evaluation result regarding the evaluation.

### Claim 8 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the at least one processor is configured to execute the instructions to identify the evaluation target motion related to a body part by setting a feature point and a pseudo skeleton of the body of the person in image data.

### Claim 9 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the at least one processor is configured to execute the instructions to identify a motion of the body in chronological order based on a plurality of consecutive image frames.

### Claim 10 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the at least one processor is further configured to execute the instructions to store a plurality of sample motion patterns and a plurality of registered motion patterns.

### Claim 11 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the at least one processor is further configured to execute the instructions to store evaluation criteria information including a plurality of evaluation criteria corresponding to a plurality of different parts.

### Claim 12 (depends on 11)

The motion evaluation apparatus according to claim 11, wherein the at least one processor is configured to execute the instructions to evaluate similarity for each predetermined part in the body based on the evaluation criteria.

### Claim 13 (depends on 5)

The motion evaluation apparatus according to claim 5, wherein the at least one processor is configured to execute the instructions to select one sample motion pattern based on voice data related to an input or a motion from an input unit.

### Claim 14 (depends on 1)

The motion evaluation apparatus according to claim 1, wherein the registered motion pattern includes the sample motion pattern.

### Claim 15

A motion evaluation method comprising:
extracting skeletal information of a person in an acquired image;
identifying an evaluation target motion based on the extracted skeletal information of the person and a registered motion pattern formed by stored skeletal information; and
evaluating similarity between the evaluation target motion and a sample motion pattern formed by stored skeletal information, based on an integrated evaluation value including a first evaluation value that is based on a deviation amount of the skeletal information in a temporal axis direction and a second evaluation value that is based on a deviation amount of the skeletal information of the person in a spatial axis direction.

### Claim 16

A non-transitory computer-readable medium storing a program that causes a computer to execute:
a process of extracting skeletal information of a person in an acquired image;
a process of identifying an evaluation target motion based on the extracted skeletal information of the person and a registered motion pattern formed by stored skeletal information; and
a process of evaluating similarity between the evaluation target motion and a sample motion pattern formed by stored skeletal information, based on an integrated evaluation value including a first evaluation value that is based on a deviation amount of the skeletal information in a temporal axis direction and a second evaluation value that is based on a deviation amount of the skeletal information of the person in a spatial axis direction.
