# US 2025/0157078 A1 · Image processing apparatus, image processing method, and non-transitory storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157078 A1
- Document ID: US20250157078A1
- Status: Published application
- Kind: A1
- Application number: 18/834,360
- Filed: 2022-02-14
- Published: 2025-05-15
- Earliest claimed: 2022-02-14
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Ryo KAWAI; Noboru YOSHIDA; Jianquan LIU
- Web page: https://patentgrep.com/patent/US20250157078A1

## CPC

- G06T 7/00: Image analysis
- G06T 7/74: {involving reference images or patches}
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present invention of an image processing apparatus (10) detects a keypoint of a human body included in an image; computes a degree of similarity between a pose or a movement of a human body detected from the image and a pose or a movement of a human body indicated by a preregistered template image; determines a place in the image where a human body also with the degree of similarity to a pose or a movement of a human body indicated by any template image to be less than a first threshold value is captured; and outputs information indicating the determined place or a partial image acquired by cutting the determined place out of the image.

## Claims

### Claim 1

An image processing apparatus comprising:
at least one memory configured to store one or more instructions; and
at least one processor configured to execute the one or more instructions to:
detect a keypoint of a human body included in an image;
compute a degree of similarity between a pose or a movement of a human body detected from the image and a pose or a movement of a human body indicated by a preregistered template image, based on the detected keypoint;
determine a place in the image where a human body also with the degree of similarity to a pose or a movement of a human body indicated by any template image to be less than a first threshold value is captured; and
output information indicating the determined place or a partial image acquired by cutting the determined place out of the image, as a candidate for the template image to be additionally registered in a decision apparatus that decides a pose or a movement of a human body detected from the image, based on a pose or a movement of a human body indicated by the template image.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein
the at least one processor is further configured to execute the one or more instructions to determine a place in the image where a human body not satisfying a first similarity condition to a pose or a movement of a human body indicated by any template image among human bodies also with the degree of similarity to a pose or a movement of a human body indicated by any template image to be less than the first threshold value is captured.

### Claim 3 (depends on 2)

The image processing apparatus according to claim 2, wherein
the first similarity condition includes a condition that the degree of similarity is equal to or more than a second threshold value and is less than the first threshold value.

### Claim 4 (depends on 2)

The image processing apparatus according to claim 2, wherein
the first similarity condition includes a condition that the degree of similarity to a pose or a movement of a human body indicated by the template image computed based on a part of the keypoints among the plurality of keypoints detected from each human body is equal to or more than a third threshold value.

### Claim 5 (depends on 2)

The image processing apparatus according to claim 2, wherein
the first similarity condition includes a condition that the degree of similarity to a pose or a movement of a human body indicated by the template image computed in consideration of a weighted value provided to each of the plurality of keypoints detected from each human body is equal to or more than a fourth threshold value.

### Claim 6 (depends on 2)

The image processing apparatus according to claim 2, wherein
the image and the template image are a moving image, and a movement of a human body is indicated by a time change in a pose of a human body indicated by each of a plurality of template images included in the moving image, and
the first similarity condition includes a condition of including a plurality of frame images indicating each human body with a pose in which a degree of similarity to a pose of a human body indicated by each of frame images in a predetermined proportion or more among the plurality of frame images included in the template image is equal to or more than a fifth threshold value.

### Claim 7 (depends on 1)

The image processing apparatus according to claim 1, wherein the at least one processor is further configured to execute the one or more instructions to
divide a plurality of human bodies captured at the determined place into groups, based on a degree of similarity between poses or movements, and
output a result of the division into groups.

### Claim 8

An image processing method comprising,
by a computer:
detecting a keypoint of a human body included in an image;
computing a degree of similarity between a pose or a movement of a human body detected from the image and a pose or a movement of a human body indicated by a preregistered template image, based on the detected keypoint;
determining a place in the image where a human body also with the degree of similarity to a pose or a movement of a human body indicated by any template image to be less than a first threshold value is captured; and
outputting information indicating the determined place or a partial image acquired by cutting the determined place out of the image, as a candidate for the template image to be additionally registered in a decision apparatus that decides a pose or a movement of a human body detected from the image, based on a pose or a movement of a human body indicated by the template image.

### Claim 9

A non-transitory storage medium storing a program causing a computer to:
detect a keypoint of a human body included in an image;
compute a degree of similarity between a pose or a movement of a human body detected from the image and a pose or a movement of a human body indicated by a preregistered template image, based on the detected keypoint;
determine a place in the image where a human body also with the degree of similarity to a pose or a movement of a human body indicated by any template image to be less than a first threshold value is captured; and
output information indicating the determined place or a partial image acquired by cutting the determined place out of the image, as a candidate for the template image to be additionally registered in a decision apparatus that decides a pose or a movement of a human body detected from the image, based on a pose or a movement of a human body indicated by the template image.

### Claim 10 (depends on 8)

The image processing method according to claim 8, wherein
the computer determines a place in the image where a human body not satisfying a first similarity condition to a pose or a movement of a human body indicated by any template image among human bodies also with the degree of similarity to a pose or a movement of a human body indicated by any template image to be less than the first threshold value is captured.

### Claim 11 (depends on 10)

The image processing method according to claim 10, wherein
the first similarity condition includes a condition that the degree of similarity is equal to or more than a second threshold value and is less than the first threshold value.

### Claim 12 (depends on 10)

The image processing method according to claim 10, wherein
the first similarity condition includes a condition that the degree of similarity to a pose or a movement of a human body indicated by the template image computed based on a part of the keypoints among the plurality of keypoints detected from each human body is equal to or more than a third threshold value.

### Claim 13 (depends on 10)

The image processing method according to claim 10, wherein
the first similarity condition includes a condition that the degree of similarity to a pose or a movement of a human body indicated by the template image computed in consideration of a weighted value provided to each of the plurality of keypoints detected from each human body is equal to or more than a fourth threshold value.

### Claim 14 (depends on 10)

The image processing method according to claim 10, wherein
the image and the template image are a moving image, and a movement of a human body is indicated by a time change in a pose of a human body indicated by each of a plurality of template images included in the moving image, and
the first similarity condition includes a condition of including a plurality of frame images indicating each human body with a pose in which a degree of similarity to a pose of a human body indicated by each of frame images in a predetermined proportion or more among the plurality of frame images included in the template image is equal to or more than a fifth threshold value.

### Claim 15 (depends on 8)

The image processing method according to claim 8, wherein the computer
divides a plurality of human bodies captured at the determined place into groups, based on a degree of similarity between poses or movements, and
outputs a result of the division into groups.

### Claim 16 (depends on 9)

The non-transitory storage medium according to claim 9, wherein
the program causing the computer to determine a place in the image where a human body not satisfying a first similarity condition to a pose or a movement of a human body indicated by any template image among human bodies also with the degree of similarity to a pose or a movement of a human body indicated by any template image to be less than the first threshold value is captured.

### Claim 17 (depends on 16)

The non-transitory storage medium according to claim 16, wherein
the first similarity condition includes a condition that the degree of similarity is equal to or more than a second threshold value and is less than the first threshold value.

### Claim 18 (depends on 16)

The non-transitory storage medium according to claim 16, wherein
the first similarity condition includes a condition that the degree of similarity to a pose or a movement of a human body indicated by the template image computed based on a part of the keypoints among the plurality of keypoints detected from each human body is equal to or more than a third threshold value.

### Claim 19 (depends on 16)

The non-transitory storage medium according to claim 16, wherein
the first similarity condition includes a condition that the degree of similarity to a pose or a movement of a human body indicated by the template image computed in consideration of a weighted value provided to each of the plurality of keypoints detected from each human body is equal to or more than a fourth threshold value.

### Claim 20 (depends on 16)

The non-transitory storage medium according to claim 16, wherein
the image and the template image are a moving image, and a movement of a human body is indicated by a time change in a pose of a human body indicated by each of a plurality of template images included in the moving image, and
the first similarity condition includes a condition of including a plurality of frame images indicating each human body with a pose in which a degree of similarity to a pose of a human body indicated by each of frame images in a predetermined proportion or more among the plurality of frame images included in the template image is equal to or more than a fifth threshold value.
