# US 2026/0017828 A1 · Information processing apparatus, information processing method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0017828 A1
- Document ID: US20260017828A1
- Status: Published application
- Kind: A1
- Application number: 19/263,602
- Filed: 2025-07-09
- Published: 2026-01-15
- Earliest claimed: 2024-07-10
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Masafumi TAKIMOTO; Yusuke BABA
- Web page: https://patentgrep.com/patent/US20260017828A1

## CPC

- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 7/11: Region-based segmentation
- G06T 7/262: using transform domain methods, e.g. Fourier domain methods
- G06T 7/55: from multiple images
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20044: Skeletonization; Medial axis transform
- G06T 2207/20052: Discrete cosine transform [DCT]
- G06T 2207/20064: Wavelet transform [DWT]
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30196: Human being; Person
- G06T 2207/30244: Camera pose
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An information processing apparatus includes: an obtainment unit configured to obtain a captured image obtained by each of multiple image capturing apparatuses; a detection unit configured to detect a position of a predetermined part in the object from the captured image of each of the multiple image capturing apparatuses; an estimation unit configured to estimate a camera parameter indicating a position and an orientation of each of the multiple image capturing apparatuses by using the detected position of the predetermined part; an update unit configured to update the camera parameter of each of the multiple image capturing apparatuses by using the estimated camera parameter as an initial value; and a determination unit configured to determine the camera parameter of each of the multiple image capturing apparatuses based on a result of performing three-dimensional reconstruction of the object based on the updated camera parameter.

## Claims

### Claim 1

An information processing apparatus comprising:
one or more memories storing instructions; and
one or more processors executing the instructions to:
obtain a captured image obtained by each of a plurality of image capturing apparatuses by capturing an object;
detect a position of a predetermined part in the object from the captured image obtained by each of the plurality of image capturing apparatuses;
estimate a camera parameter indicating a position and an orientation of each of the plurality of image capturing apparatuses by using the detected position of the predetermined part;
update the camera parameter of each of the plurality of image capturing apparatuses by using the estimated camera parameter as an initial value; and
determine the camera parameter of each of the plurality of image capturing apparatuses based on a result of performing three-dimensional reconstruction of the object based on the updated camera parameter.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the result of the three-dimensional reconstruction of the object is a model configured to output an image of the object observed with inputted viewpoint information, and
the camera parameter of each of the plurality of image capturing apparatuses is determined based on a result of comparing the image output from the model by inputting the viewpoint information indicated by the updated camera parameter and the captured image obtained by each of the plurality of image capturing apparatuses.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the updated camera parameter in a case where a value indicating a difference between the output image and the captured image obtained by each of the plurality of image capturing apparatuses is equal to or smaller than a threshold is determined as the camera parameter of each of the plurality of image capturing apparatuses.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2, wherein
the one or more processors execute the instructions to further
perform the three-dimensional reconstruction of the object on each of a plurality of frames obtained by each of the plurality of image capturing apparatuses, and
integrate results of the three-dimensional reconstruction by using the updated camera parameter.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein
the integration is performed by converting a posture of the object expressed by the results of the three-dimensional reconstruction into a predetermined posture, and
the one or more processors execute the instructions to further
inversely convert the posture of the object expressed by the integrated results of the three-dimensional reconstruction, wherein
the model is a model obtained by the inverse conversion.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, wherein
the update of the camera parameter of each of the plurality of image capturing apparatuses is performed based on the position of the predetermined part.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein
the position of the predetermined part in the captured image obtained by each of the plurality of image capturing apparatuses is detected, and
the one or more processors execute the instructions to further
integrate the position of the predetermined part detected from each of the captured image by using the updated camera parameter, wherein,
the update of the camera parameter of each of the plurality of image capturing apparatuses is performed based on a result of comparing the detected position of the predetermined part in the captured image and the integrated position of the predetermined part.

### Claim 8 (depends on 6)

The information processing apparatus according to claim 6, wherein
the updated camera parameter in a case where a value indicating an error of the updated camera parameter calculated based on a first value and a second value is equal to or smaller than a threshold is determined as the camera parameter of each of the plurality of image capturing apparatuses,
the first value being a value based on the position of the predetermined part, and
the second value being a value based on the result of the three-dimensional reconstruction of the object.

### Claim 9 (depends on 8)

The information processing apparatus according to claim 8, wherein
the first value is a value further based on a likelihood of each position of the predetermined parts detected from the captured image obtained by each of the plurality of image capturing apparatuses.

### Claim 10 (depends on 1)

The information processing apparatus according to claim 1, wherein
the estimation of the camera parameter of each of the plurality of image capturing apparatuses is performed without using a position of the predetermined part of which a likelihood is equal to or smaller than a threshold.

### Claim 11 (depends on 2)

The information processing apparatus according to claim 2, wherein
the object captured by each of the plurality of image capturing apparatuses is a plurality of objects, and
the one or more processors execute the instructions to further
generate a mask indicating a region of each of the plurality of objects in the captured image that is obtained by tracking each of the plurality of objects in chronological order, wherein
the determination of the camera parameter of each of the plurality of image capturing apparatuses is performed based on a result of comparing the regions of the masks between the regions in the output image and the captured image.

### Claim 12 (depends on 11)

The information processing apparatus according to claim 11, wherein
the one or more processors execute the instructions to further
apply an identifier to each of the plurality of objects included in the captured image of each of the plurality of image capturing apparatuses by instance segmentation.

### Claim 13 (depends on 2)

The information processing apparatus according to claim 2, wherein
the object captured by each of the plurality of image capturing apparatuses is a plurality of objects,
the model is a model corresponding to each of the plurality of objects, and
the one or more processors execute the instructions to further
display an image of a rendered object selected by a user by using the model of the object selected by the user.

### Claim 14 (depends on 1)

The information processing apparatus according to claim 1, wherein
the one or more processors execute the instructions to further
estimate a track indicating transition of the position of the predetermined part for each of the plurality of image capturing apparatuses, wherein
the update of the camera parameter of each of the plurality of image capturing apparatuses is performed such that the estimated tracks of the plurality of image capturing apparatuses match.

### Claim 15 (depends on 14)

The information processing apparatus according to claim 14, wherein
the estimation of the track for each of the plurality of image capturing apparatuses is performed by using a track basis vector or a basis function defined in advance.

### Claim 16 (depends on 14)

The information processing apparatus according to claim 14, wherein
the track estimated for each of the plurality of image capturing apparatuses is compared for each direction component in a three-dimensional space.

### Claim 17 (depends on 14)

The information processing apparatus according to claim 14, wherein
the one or more processors execute the instructions to further
instruct the plurality of image capturing apparatuses to start the image capturing while providing a predetermined time difference less than a time of one frame.

### Claim 18 (depends on 1)

The information processing apparatus according to claim 1, wherein
the object is a person or an animal, and
the predetermined part is each joint in the person or the animal.

### Claim 19 (depends on 1)

The information processing apparatus according to claim 1, wherein
the object is an object of a non-living material, and
the position of the predetermined part is a position of a center of the object.

### Claim 20 (depends on 1)

The information processing apparatus according to claim 1, wherein
the plurality of image capturing apparatuses are two or three image capturing apparatuses.

### Claim 21

An information processing method, comprising:
obtaining a captured image obtained by each of a plurality of image capturing apparatuses by capturing an object;
detecting a position of a predetermined part in the object from the captured image obtained by each of the plurality of image capturing apparatuses;
estimating a camera parameter indicating a position and an orientation of each of the plurality of image capturing apparatuses by using the detected position of the predetermined part;
updating the camera parameter of each of the plurality of image capturing apparatuses by using the estimated camera parameter as an initial value; and
determining the camera parameter of each of the plurality of image capturing apparatuses based on a result of performing three-dimensional reconstruction of the object based on the updated camera parameter.

### Claim 22

A non-transitory computer readable storage medium storing a program which causes a computer to perform an information processing method, the information processing method comprising:
obtaining a captured image obtained by each of a plurality of image capturing apparatuses by capturing an object;
detecting a position of a predetermined part in the object from the captured image obtained by each of the plurality of image capturing apparatuses;
estimating a camera parameter indicating a position and an orientation of each of the plurality of image capturing apparatuses by using the detected position of the predetermined part;
updating the camera parameter of each of the plurality of image capturing apparatuses by using the estimated camera parameter as an initial value; and
determining the camera parameter of each of the plurality of image capturing apparatuses based on a result of performing three-dimensional reconstruction of the object based on the updated camera parameter.
