# US 12,215,964 B2 · Height estimation method, height estimation apparatus, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,215,964 B2
- Document ID: US12215964B2
- Status: Granted
- Kind: B2
- Application number: 17/800,588
- Filed: 2020-02-20
- Published: 2023-03-09
- Granted: 2025-02-04
- Earliest claimed: 2020-02-20
- Assignees: Nippon Telegraph and Telephone Corporation
- Applicants: Nippon Telegraph and Telephone Corporation
- Inventors: Toshiaki Takeda; Dan Mikami; Yoshinori Kusachi
- Web page: https://patentgrep.com/patent/US12215964B2

## CPC

- G01B 11/02: for measuring length, width or thickness (G01B11/08 takes precedence)
- G01B 11/022: {by means of tv-camera scanning}
- A61B 5/1072: {measuring distances on the body, e.g. measuring length, height or thickness (A61B5/1076 takes precedence)}
- A61B 5/1079: {using optical or photographic means}
- G06T 7/60: Analysis of geometric attributes
- G06T 7/73: using feature-based methods
- A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence)
- G06T 2207/30196: Human being; Person
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A height estimation method performed by a height estimation apparatus includes a first feature point extraction step of extracting a feature point coordinate, a first coordinate estimation step of estimating a coordinate of a first subject frame, a pre-generation step of deriving a height of the first subject frame and generating a distance addition pattern and a correction coefficient for an individual missing pattern, a second feature point extraction step of extracting a feature point coordinate from a second input image, a second coordinate estimation step of estimating a coordinate of a second subject frame and estimating a coordinate of an object frame, a subject data selection step of selecting the individual missing pattern and the correction coefficient in accordance with the feature point coordinate, an object data selection step of selecting an object height, and a height estimation step of adding up a distance between a feature point coordinate and another feature point coordinate extracted in accordance with the missing pattern and deriving an estimated value of a height of the subject in accordance with a result of adding up the distance, the correction coefficient, the object height, and the coordinates of the object frame.

## Claims

### Claim 1

A height estimation method performed by a height estimation apparatus, the method comprising:
extracting, from a first input image in which a subject image that is an image of a subject is captured, a feature point coordinate that is a coordinate of a feature point predetermined along a skeleton of the subject image;
estimating a coordinate of a first subject frame that is a frame surrounding the subject image in the first input image;
deriving a height of the first subject frame in the first input image in accordance with the coordinate of the first subject frame and generating a distance addition pattern that is an addition pattern of a distance between a feature point coordinate and another feature point coordinate and a correction coefficient for an individual missing pattern that is a pattern of a combination of one or a plurality of the feature point coordinates that are not extracted among the plurality of the feature point coordinates predetermined;
extracting a feature point coordinate from a second input image in which an object image that is an image of an object and the subject image are captured;
estimating a coordinate of a second subject frame that is a frame surrounding the subject image in the second input image and estimating a coordinate of an object frame that is a frame surrounding the object image in the second input image;
selecting the individual missing pattern and the correction coefficient in accordance with the feature point coordinate extracted from the second input image;
selecting an object height that is a height of the object in the object image in the second input image in accordance with information on the object image in the second input image; and
adding up a distance between a feature point coordinate and another feature point coordinate extracted from the second input image in accordance with the missing pattern selected and deriving an estimated value of a height of the subject in accordance with a result of adding up the distance between the feature point coordinate and the other feature point coordinate in the second input image, the correction coefficient selected, the object height, and the coordinate of the object frame.

### Claim 2 (depends on 1)

The height estimation method according to claim 1, comprising
displaying a distance between the subject and the object.

### Claim 3 (depends on 1)

A non-transitory computer-readable medium having computer-executable instructions that, upon execution of the instructions by a processor of a computer, cause the computer to function as the height estimation method according to claim 1.

### Claim 4

A height estimation apparatus comprising:
a processor; and
a storage medium having computer program instructions stored thereon, when executed by the processor, perform to:
extract, from a first input image in which a subject image that is an image of a subject is captured, a feature point coordinate that is a coordinate of a feature point predetermined along a skeleton of the subject image;
estimate a coordinate of a first subject frame that is a frame surrounding the subject image in the first input image;
derive a height of the first subject frame in the first input image in accordance with the coordinates of the first subject frame, and generate a distance addition pattern that is an addition pattern of a distance between a feature point coordinate and another feature point coordinate and a correction coefficient for an individual missing pattern that is a pattern of a combination of one or a plurality of the feature point coordinates that are not extracted among the plurality of the feature point coordinates predetermined;
extract a feature point coordinate from a second input image in which an object image that is an image of an object and the subject image are captured;
estimate a coordinate of a second subject frame that is a frame surrounding the subject image in the second input image and estimate a coordinate of an object frame that is a frame surrounding the object image in the second input image;
select the individual missing pattern and the correction coefficient in accordance with the feature point coordinate extracted from the second input image;
select an object height that is a height of the object in the object image in the second input image in accordance with information on the object image in the second input image; and
add up a distance between a feature point coordinate and another feature point coordinate extracted from the second input image in accordance with the missing pattern selected and derive an estimated value of a height of the subject in accordance with a result of adding up the distance between the feature point coordinate and the other feature point coordinate in the second input image, the correction coefficient selected, the object height, and the coordinate of the object frame.