# US 2025/0095192 A1 · Pose estimation apparatus, pose estimation method, and non-transitory computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095192 A1
- Document ID: US20250095192A1
- Status: Published application
- Kind: A1
- Application number: 18/727,184
- Filed: 2022-01-21
- Published: 2025-03-20
- Earliest claimed: 2022-01-21
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Yadong PAN
- Web page: https://patentgrep.com/patent/US20250095192A1

## CPC

- G06T 7/73: using feature-based methods
- G06V 10/82: using neural networks
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A pose estimation apparatus detects key-points from a target image in which one or more persons are captured, and computes one or more selection factors based on the key-points. The selection factor includes density, resolution, or both of persons in the target image. The pose estimation apparatus selects one of predefined multiple key-point association algorithms based on the selection factor. The pose estimation apparatus performs key-point association on the key-points using the selected algorithm to divide the key-points into one or more key-point groups each of which includes the key-points of the same person as each other. For each of the key-point groups, the pose estimation apparatus estimates a pose of the person corresponding to the key-point group based on the key-points included in the key-point group.

## Claims

### Claim 1

A pose estimation apparatus comprising:
at least one memory that is configured to store instructions; and
at least one processor that is configured to execute the instructions to:
acquire a target image in which one or more persons are captured;
detect key-points from the target image;
compute one or more selection factors based on the key-points, the one or more selection factors including density, resolution, or both of persons in the target image;
select an algorithm for key-point association from predefined algorithms for key-point association based on the one or more selection factors;
perform key-point association on the key-points using the selected algorithm to divide the key-points into one or more key-point groups each of which includes the key-points of a same person as each other; and
for each of the key-point groups, estimate a pose of the person corresponding to the key-point group based on the key-points included in the key-point group.

### Claim 2 (depends on 1)

The pose estimation apparatus according to claim 1,
wherein types of the key-points include right shoulder and left shoulder, and
wherein the computation of the density of persons in the target image includes:
for each of the key-points of left shoulder, liking the key-point of left shoulder with the key-point of right shoulder closest thereto;
for each of the key-point of right shoulder that is linked with multiple key-points of left shoulder, deleting a longest link having the key-point of right shoulder when a length of the longest link is more than predetermined times of a length of a shortest link having the key-point of right shoulder; and
computing the density of persons in the target image based on a number of the key-points of right shoulder that are linked with multiple key-points of left shoulder.

### Claim 3 (depends on 1)

The pose estimation apparatus according to claim 1,
wherein types of the key-points include right shoulder and left shoulder, and
wherein the computation of the resolution of persons in the target image includes:
for each of the key-points of left shoulder, liking the key-point of left shoulder with the key-point of right shoulder closest thereto;
for each of the key-point of right shoulder that is linked with multiple key-points of left shoulder, deleting a longest link having the key-point of right shoulder when a length of the longest link is more than predetermined times of a length of a shortest link having the key-point of right shoulder; and
computing the resolution of persons in the target image based on a number of the links remained after the deletion and a number of the links whose lengths are less than a threshold that is defined based on one of dimensions of the target image.

### Claim 4 (depends on 1)

The pose estimation apparatus according to claim 1,
wherein the predefined algorithms include mid-point algorithm, direction map algorithm, location map algorithm, or two or three of them.

### Claim 5 (depends on 1)

The pose estimation apparatus according to claim 1,
wherein the selection algorithm for key-point association includes:
determining whether or not the selection factor is less than a threshold of the selection factor;
selecting a first algorithm for key-point association when the selection factor is less than the threshold of the selection factor; and
selecting a second algorithm for key-point association when the selection factor is not less than the threshold of the selection factor.

### Claim 6 (depends on 5)

The pose estimation apparatus according to claim 5,
wherein the selection algorithm for key-point association includes:
determining whether or not the resolution of persons in the target image is less than a threshold of the resolution;
selecting mid-point algorithm when the resolution of persons in the target image is less than the threshold of the resolution; and
selecting direction map algorithm or location map algorithm when the resolution of persons in the target image is not less than the threshold of the resolution.

### Claim 7 (depends on 5)

The pose estimation apparatus according to claim 5,
wherein the selection algorithm for key-point association includes:
determining whether or not the density of persons in the target image is less than a threshold of the density;
selecting mid-point algorithm or direction map algorithm when the density of persons in the target image is less than the threshold of the density; and
selecting location map algorithm when the density of persons in the target image is not less than the threshold of the density.

### Claim 8

A pose estimation method performed by one or more computers comprising:
acquiring a target image in which one or more persons are captured;
detect key-points from the target image;
computing one or more selection factors based on the key-points, the one or more selection factors including density, resolution, or both of persons in the target image;
selecting an algorithm for key-point association from predefined algorithms for key-point association based on the one or more selection factors;
performing key-point association on the key-points using the selected algorithm to divide the key-points into one or more key-point groups each of which includes the key-points of a same person as each other; and
for each of the key-point groups, estimating a pose of the person corresponding to the key-point group based on the key-points included in the key-point group.

### Claim 9 (depends on 8)

The pose estimation method according to claim 8,
wherein types of the key-points include right shoulder and left shoulder, and
wherein the computation of the density of persons in the target image includes:
for each of the key-points of left shoulder, liking the key-point of left shoulder with the key-point of right shoulder closest thereto;
for each of the key-point of right shoulder that is linked with multiple key-points of left shoulder, deleting a longest link having the key-point of right shoulder when a length of the longest link is more than predetermined times of a length of a shortest link having the key-point of right shoulder; and
computing the density of persons in the target image based on a number of the key-points of right shoulder that are linked with multiple key-points of left shoulder.

### Claim 10 (depends on 8)

The pose estimation method according to claim 8,
wherein types of the key-points include right shoulder and left shoulder, and
wherein the computation of the resolution of persons in the target image includes:
for each of the key-points of left shoulder, liking the key-point of left shoulder with the key-point of right shoulder closest thereto;
for each of the key-point of right shoulder that is linked with multiple key-points of left shoulder, deleting a longest link having the key-point of right shoulder when a length of the longest link is more than predetermined times of a length of a shortest link having the key-point of right shoulder; and
computing the resolution of persons in the target image based on a number of the links remained after the deletion and a number of the links whose lengths are less than a threshold that is defined based on one of dimensions of the target image.

### Claim 11 (depends on 8)

The pose estimation method according to claim 8,
wherein the predefined algorithms include mid-point algorithm, direction map algorithm, location map algorithm, or two or three of them.

### Claim 12 (depends on 8)

The pose estimation method according to claim 8,
wherein the selection algorithm for key-point association includes:
determining whether or not the selection factor is less than a threshold of the selection factor;
selecting a first algorithm for key-point association when the selection factor is less than the threshold of the selection factor; and
selecting a second algorithm for key-point association when the selection factor is not less than the threshold of the selection factor.

### Claim 13 (depends on 12)

The pose estimation method according to claim 12,
wherein the selection algorithm for key-point association includes:
determining whether or not the resolution of persons in the target image is less than a threshold of the resolution;
selecting mid-point algorithm when the resolution of persons in the target image is less than the threshold of the resolution; and
selecting direction map algorithm or location map algorithm when the resolution of persons in the target image is not less than the threshold of the resolution.

### Claim 14 (depends on 12)

The pose estimation method according to claim 12,
wherein the selection algorithm for key-point association includes:
determining whether or not the density of persons in the target image is less than a threshold of the density;
selecting mid-point algorithm or direction map algorithm when the density of persons in the target image is less than the threshold of the density; and
selecting location map algorithm when the density of persons in the target image is not less than the threshold of the density.

### Claim 15

A non-transitory computer-readable storage medium storing a program that causes one or more computers to execute:
acquiring a target image in which one or more persons are captured;
detect key-points from the target image;
computing one or more selection factors based on the key-points, the one or more selection factors including density, resolution, or both of persons in the target image;
selecting an algorithm for key-point association from predefined algorithms for key-point association based on the one or more selection factors;
performing key-point association on the key-points using the selected algorithm to divide the key-points into one or more key-point groups each of which includes the key-points of a same person as each other; and
for each of the key-point groups, estimating a pose of the person corresponding to the key-point group based on the key-points included in the key-point group.

### Claim 16 (depends on 15)

The storage medium according to claim 15,
wherein types of the key-points include right shoulder and left shoulder, and
wherein the computation of the density of persons in the target image includes:
for each of the key-points of left shoulder, liking the key-point of left shoulder with the key-point of right shoulder closest thereto;
for each of the key-point of right shoulder that is linked with multiple key-points of left shoulder, deleting a longest link having the key-point of right shoulder when a length of the longest link is more than predetermined times of a length of a shortest link having the key-point of right shoulder; and
computing the density of persons in the target image based on a number of the key-points of right shoulder that are linked with multiple key-points of left shoulder.

### Claim 17 (depends on 15)

The storage medium according to claim 15,
wherein types of the key-points include right shoulder and left shoulder, and
wherein the computation of the resolution of persons in the target image includes:
for each of the key-points of left shoulder, liking the key-point of left shoulder with the key-point of right shoulder closest thereto;
for each of the key-point of right shoulder that is linked with multiple key-points of left shoulder, deleting a longest link having the key-point of right shoulder when a length of the longest link is more than predetermined times of a length of a shortest link having the key-point of right shoulder; and
computing the resolution of persons in the target image based on a number of the links remained after the deletion and a number of the links whose lengths are less than a threshold that is defined based on one of dimensions of the target image.

### Claim 18 (depends on 15)

The storage medium according to claim 15,
wherein the predefined algorithms include mid-point algorithm, direction map algorithm, location map algorithm, or two or three of them.

### Claim 19 (depends on 15)

The storage medium according to claim 15,
wherein the selection algorithm for key-point association includes:
determining whether or not the selection factor is less than a threshold of the selection factor;
selecting a first algorithm for key-point association when the selection factor is less than the threshold of the selection factor; and
selecting a second algorithm for key-point association when the selection factor is not less than the threshold of the selection factor.

### Claim 20 (depends on 19)

The storage medium according to claim 19,
wherein the selection algorithm for key-point association includes:
determining whether or not the resolution of persons in the target image is less than a threshold of the resolution;
selecting mid-point algorithm when the resolution of persons in the target image is less than the threshold of the resolution; and
selecting direction map algorithm or location map algorithm when the resolution of persons in the target image is not less than the threshold of the resolution.

### Claim 21

(canceled)
