# US 2022/0284734 A1 · Information processing device, method, and program recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284734 A1
- Document ID: US20220284734A1
- Status: Published application
- Kind: A1
- Application number: 17/637,154
- Filed: 2019-09-02
- Published: 2022-09-08
- Earliest claimed: 2019-09-02
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Ryo KAWAI
- Web page: https://patentgrep.com/patent/US20220284734A1

## CPC

- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/73: using feature-based methods
- G06V 10/70: using pattern recognition or machine learning (optical pattern recognition or electronic computations therefor G06V10/88)
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06T 2207/30196: Human being; Person
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

To efficiently determine learning data for estimating an unknown behavior by a machine, an information processing device according to the present invention is provided with: an information acquisition means for acquiring an image including a person; and a feature conversion means for converting skeleton information extracted from the image into a feature vector which indicates elements constituting a behavior of the person and is a lower dimension than the skeleton information.

## Claims

### Claim 1

An information processing device comprising:
a memory storing a computer program; and
at least one processor configured to run the computer program to execute to:
acquire an image including a person; and
convert skeleton information extracted from the image into a feature vector which indicates elements constituting a behavior of the person and is a lower dimension than the skeleton information.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein
the at least one processor is configured to run the computer program to execute to:
convert the skeleton information using the feature conversion formula covering the behavior of the person.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein
the at least one processor is further configured to run the computer program to execute to:
define the feature formula; and
determine whether the feature conversion formula covers the behavior of the person.

### Claim 4 (depends on 3)

The information processing device according to claim 3, wherein
the at least one processor is configured to run the computer program to execute to:
define the feature conversion formula depending on a result of determination whether the feature conversion formula covers the behavior of the person or not.

### Claim 5 (depends on 3)

The information processing device according to claim 3, wherein
the at least one processor is further configured to run the computer program to execute to:
store the feature conversion formula depending on a result of determination whether the feature conversion formula covers the behavior of the person or not.

### Claim 6 (depends on 3)

The information processing device according to claim 3, wherein
the feature vector includes at least one element indicating the behavior of the person, and
the at least one processor is configured to run the computer program to execute to:
determine whether the behavior of the person is covered by at least one of a variance of the elements in the feature vector or a correlation coefficient between the elements in the feature vector.

### Claim 7 (depends on 3)

The information processing device according to claim 3, wherein
the at least one processor is configured to run the computer program to execute to:
execute a process of learning data including the skeleton information and obtaining the feature conversion formula.

### Claim 8 (depends on 1)

The information processing device according to claim 1, wherein
the at least one processor is further configured to run the computer program to execute to:
extract the skeleton information of the person included in the image.

### Claim 9 (depends on 1)

The information processing device according to claim 1, wherein
the skeleton information includes position information of a part of the person.

### Claim 10 (depends on 9)

The information processing device according to claim 9, wherein the part of the person includes at least one of a head, a neck, a left elbow, a right elbow, a left hand, a right hand, a waist, a left knee, a right knee, a left foot, and a right foot.

### Claim 11

An information processing method comprising:
acquiring an image including a person; and
converting skeleton information extracted from the image into a feature vector which indicates elements constituting a behavior of the person and is a lower dimension than the skeleton information.

### Claim 12

A program recording medium that records a program for causing a computer to execute:
a process of acquiring an image including a person; and
a process of converting skeleton information extracted from the image into a feature vector which indicates elements constituting a behavior of the person and is a lower dimension than the skeleton information.
