US 2024/0177353 A1Published application

Point cloud processing method, decoder and storage medium

AssigneeGuangdong Oppo Mobile Telecommunications Corp., Ltd.

InventorsHui YUAN, Hao LIU, Tingting WANG, Ming LI

Life of this patent

Estimating the term…

Loading patent…

Abstract

A GAN-based point cloud processing method, decoder and computer-readable storage medium are provided. The method includes: a first point cloud is input into a feature extraction module to obtain a first feature of a point in the first point cloud; the first feature is input into a coarse feature extension module to obtain a second feature; the second feature is input into a geometry generation module to map the second feature from a feature space to a geometric space to obtain a second point cloud; the second feature and the second point cloud are input into a geometric offset prediction module to determine the offset of points in the second point cloud in the geometric space; and a third point cloud according to the second point cloud and the offset is obtained.

Claims20

Dependent claims

A point cloud processing method based on a generative adversarial network (GAN), wherein the GAN comprises a generator, wherein the generator comprises a feature extraction module, a coarse feature expansion module, a geometry generation module and a geometry offset prediction module, and the method comprises:

inputting a first point cloud into the feature extraction module to obtain a first feature of a point of the first point cloud;
inputting the first feature into the coarse feature expansion module to perform up- sampling on the first feature to obtain a second feature;
inputting the second feature into the geometry generation module to map the second feature from a feature space to a geometry space to obtain a second point cloud;
inputting the second feature and the second point cloud into the geometry offset prediction module to determine an offset value of a point in the second point cloud in the geometry space;
and
obtaining a third point cloud based on the second point cloud and the offset value.

3 more elements

A decoder, comprising a feature extraction module, a coarse feature expansion module, a geometry generation module, a geometry offset prediction module and a processing module, wherein

the feature extraction module is configured to perform feature extraction on a first point cloud input into the feature extraction module, to obtain a first feature of a point of the first point cloud;
the coarse feature expansion module is configured to up-sample the first feature input into the coarse feature expansion module, to obtain a second feature;
the geometry generation module is configured to map the second feature input into the geometry generation module from a feature space to a geometry space, to obtain a second point cloud;
the geometry offset prediction module is configured to determine an offset value of a point in the second point cloud in the geometry space after the second feature and the second point cloud are input into the geometry offset prediction module;
and
the processing module is configured to obtain a third point cloud based on the second point cloud and the offset value.

3 more elements

Dependencies are inferred from the claim text.