US 2026/0301199 A1 · METHOD FOR PERFORMING THREE-DIMENSIONAL POSE RECONSTRUCTION UNDER OCCLUDED AND APPARATUS THEREOF

Abstract

A method for performing three-dimensional pose reconstruction under occluded and apparatus thereof is provided. The method comprises: capturing an image including a target object via a camera, wherein at least a portion of the target object in the image is occluded; performing image preprocessing on the image; estimating two-dimensional joints of the target object from the preprocessed image using a skeleton estimation model; determining a specific motion of the target object based on the two-dimensional joints; selecting a trained generative model according to the specific motion, and executing the trained generative model via a processor to generate predicted two-dimensional joints corresponding to the occluded portions of the target object, wherein the trained generative model is trained by using non-occluded images of the target object performing the specific motion; and performing three-dimensional pose reconstruction via the processor on the two-dimensional joints and the predicted two-dimensional joints to obtain three-dimensional joints.

Claims12

Dependent claims

A method for performing three-dimensional pose reconstruction under occluded, comprising:

obtaining an image including an object through a camera, wherein at least a part of the object in the image is occluded;
performing image preprocessing on the image;
estimating a plurality of two-dimensional joints of the object based on a skeleton estimation model and the preprocessed image;
determining a specific motion of the object based on the plurality of two-dimensional joints;
selecting a trained generative model according to the specific motion, executing the trained generative model to generate a plurality of predicted two-dimensional joints corresponding to occluded part of the object, wherein the trained generative model is trained using non-occluded images of the specific motion of the object;
and
performing three-dimensional pose reconstruction on the plurality of two-dimensional joints and the plurality of predicted two-dimensional joints to obtain a plurality of three-dimensional joints.

4 more elements

An apparatus for performing three-dimensional pose reconstruction under occluded, comprising:

a camera configured to obtain an image including an object, wherein at least a part of the object in the image is occluded;
and
an edge computing device communicatively connected to the camera, the edge computing device comprising a processor and a memory electrically connected to the processor, the memory configured to store instructions that, when executed by the processor, cause the processor to:
perform image preprocessing on the image;
estimate a plurality of two-dimensional joints of the object based on a skeleton estimation model and the preprocessed image;
determine a specific motion of the object based on the plurality of two-dimensional joints;
select a trained generative model according to the specific motion, execute the trained generative model through the processor to generate a plurality of predicted two-dimensional joints corresponding to occluded part of the object, wherein the trained generative model is trained using non-occluded images of the specific motion of the object;
and
perform three-dimensional pose reconstruction on the plurality of two-dimensional joints and the plurality of predicted two-dimensional joints to obtain a plurality of three-dimensional joints.

6 more elements

Dependencies are inferred from the claim text.

Method for performing three-dimensional pose reconstruction under occluded and apparatus thereof

Life of this patent

Method for performing three-dimensional pose reconstruction under occluded and apparatus thereof

Life of this patent

Abstract

Claims12