# US 2025/0157077 A1 · Image processing system, image processing method, and non-transitory computer-readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157077 A1
- Document ID: US20250157077A1
- Status: Published application
- Kind: A1
- Application number: 18/833,096
- Filed: 2022-02-09
- Published: 2025-05-15
- Earliest claimed: 2022-02-09
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Noboru YOSHIDA
- Web page: https://patentgrep.com/patent/US20250157077A1

## CPC

- G06T 7/74: {involving reference images or patches}
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06T 2207/30196: Human being; Person
- G06T 2207/30232: Surveillance
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An image processing system (10) according to the present disclosure includes: an acquisition unit (11) configured to acquire pose information based on estimation of a pose of a person included in a first image; an extraction unit (12) configured to extract, based on the pose information acquired by the acquisition unit (11), an orientation dependence-reduced feature amount in which dependence of the pose information on a pose orientation is reduced; and a setting unit (13) configured to set the orientation dependence-reduced feature amount extracted by the extraction unit (12) as a feature amount of a reference pose for detecting a state of a target person included in a second image.

## Claims

### Claim 1

An image processing system comprising:
at least one memory storing instructions, and at least one processor configured to execute the instructions stored in the at least one memory to;
acquire pose information based on estimation of a pose of a person included in a first image;
extract, based on the acquired pose information, an orientation dependence-reduced feature amount in which dependence of the pose information on a pose orientation is reduced; and
set the extracted orientation dependence-reduced feature amount as a feature amount of a reference pose for detecting a state of a target person included in a second image.

### Claim 2 (depends on 1)

The image processing system according to claim 1, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to:
normalize the pose orientation of the pose information to a predetermined direction; and
extract a feature amount of the orientation-normalized pose information as the orientation dependence-reduced feature amount.

### Claim 3 (depends on 1)

The image processing system according to claim 1, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to:
map the pose information to a feature space of a feature amount invariant to orientation; and
extract the mapped feature amount on the feature space as the orientation dependence-reduced feature amount.

### Claim 4 (depends on 1)

The image processing system according to claim 1, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to:
aggregate the extracted orientation dependence-reduced feature amount for each predetermined unit; and
set the feature amount of the reference pose, based on the aggregation result.

### Claim 5 (depends on 4)

The image processing system according to claim 4, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to calculate a statistical value of the orientation dependence-reduced feature amount for each of the predetermined units.

### Claim 6 (depends on 4)

The image processing system according to claim 4, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to:
cluster the orientation dependence-reduced feature amount for each of the predetermined units; and
set the feature amount of the reference pose, based on the clustered result.

### Claim 7 (depends on 4)

The image processing system according to claim 4, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to aggregate the orientation dependence-reduced feature amount for each of the first images or for each predetermined region in the first image.

### Claim 8 (depends on 4)

The image processing system according to claim 4, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to aggregate the orientation dependence-reduced feature amount for each predetermined time period in which the first image is captured.

### Claim 9 (depends on 1)

The image processing system according to claim 1, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to detect a state of a target person included in the second image, based on the set feature amount of the reference pose.

### Claim 10 (depends on 9)

The image processing system according to claim 9, wherein
the at least one processor is further configured to execute the instructions stored in the at least one memory to:
acquire pose information based on estimation of the pose of the target person included in the second image;
extract the orientation dependence-reduced feature amount of the pose of the target person, based on the pose information acquired from the second image; and
detect the state of the target person, based on a similarity degree between the feature amount of the reference pose and the orientation dependence-reduced feature amount of the pose of the target person.

### Claim 11 (depends on 10)

The image processing system according to claim 10, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to calculate the similarity degree, based on a weight set for each part in the reference pose.

### Claim 12 (depends on 10)

The image processing system according to claim 10, wherein
the feature amount of the reference pose and the orientation dependence-reduced feature amount of the pose of the target person each include feature amounts of a plurality of poses, and
the at least one processor is further configured to execute the instructions stored in the at least one memory to calculate a similarity degree of the feature amounts of the plurality of poses.

### Claim 13 (depends on 10)

The image processing system according to claim 10, wherein
the feature amount of the reference pose and the orientation dependence-reduced feature amount of the pose of the target person each include time-series feature amounts extracted based on a plurality of images consecutive in time series, and
the at least one processor is further configured to execute the instructions stored in the at least one memory to calculate a similarity degree of the time-series feature amounts.

### Claim 14 (depends on 10)

The image processing system according to claim 10, wherein the at least one processor is further configured to execute the instructions stored in the at least one memory to detect whether the target person is in an abnormal state, based on the similarity degree by using the reference pose as a normal state pose.

### Claim 15

An image processing method comprising:
acquiring pose information based on estimation of a pose of a person included in a first image;
extracting, based on the acquired pose information, an orientation dependence-reduced feature amount in which dependence of the pose information on a pose orientation is reduced; and
setting the extracted orientation dependence-reduced feature amount as a feature amount of a reference pose for detecting a state of a target person included in a second image.

### Claim 16 (depends on 15)

The image processing method according to claim 15, further comprising;
normalizing the pose orientation of the pose information to a predetermined direction; and
extracting a feature amount of the orientation-normalized pose information as the orientation dependence-reduced feature amount.

### Claim 17 (depends on 15)

The image processing method according to claim 15, further comprising:
mapping the pose information to a feature space of a feature amount invariant to orientation; and
extracting the mapped feature amount on the feature space as the orientation dependence-reduced feature amount.

### Claim 18

A non-transitory computer-readable medium storing an image processing program for causing a computer to execute processing of:
acquiring pose information based on estimation of a pose of a person included in a first image;
extracting, based on the acquired pose information, an orientation dependence-reduced feature amount in which dependence of the pose information on a pose orientation is reduced; and
setting the extracted orientation dependence-reduced feature amount as a feature amount of a reference pose for detecting a state of a target person included in a second image.

### Claim 19 (depends on 18)

The non-transitory computer-readable medium according to claim 18, further comprising:
normalizing the pose orientation of the pose information to a predetermined direction; and
extracting a feature amount of the orientation-normalized pose information as the orientation dependence-reduced feature amount.

### Claim 20 (depends on 18)

The non-transitory computer-readable medium according to claim 18, further comprising:
mapping the pose information to a feature space of a feature amount invariant to orientation; and
extracting the mapped feature amount on the feature space as the orientation dependence-reduced feature amount.
