Back to results
US 12,764,331 B2Granted
Dynamic PCC with multiple reference frames
AssigneeInterDigital VC Holdings, Inc.
InventorsJunghyun Ahn, Jiahao Pang, Muhammad Asad Lodhi, Dong Tian
Life of this patent
Estimating the term…
Abstract
Some embodiments of a method may include: obtaining one or more motion bitstreams; decoding one or more motion features corresponding to the one or more motion bitstreams; obtaining one or more reference features corresponding to the one or more motion features; generating, via a set of neural network layers, one or more predicted features corresponding to the one or more motion features and the one or more reference features; merging, via another set of neural network layers, the one or more predicted features into a merged feature; and reconstructing a point cloud based on the merged feature.
Claims20
A method, comprising:
- obtaining multiple reference frames;
- obtaining one or more motion bitstreams;
- decoding one or more motion features corresponding to the one or more motion bitstreams;
- obtaining multiple reference features based on the multiple reference frames;
- generating, via a set of neural network layers, multiple predicted features corresponding to the one or more motion features and the multiple reference features;
- merging, via another set of neural network layers, the multiple predicted features into a merged feature;
- and
- reconstructing a point cloud based on the merged feature,
- wherein reconstructing the point cloud based on the merged feature comprises passing the merged feature as a condition for a conditional decoder to generate the reconstructed point cloud.
6 more elements
An apparatus comprising:
- a processor;
- and
- a memory storing instructions operative, when executed by the processor, to cause the apparatus to:
- obtain multiple reference frames;
- obtain one or more motion bitstreams;
- decode one or more motion features corresponding to the one or more motion bitstreams;
- obtain multiple reference features based on the multiple reference frames;
- generate, via a set of neural network layers, multiple predicted features corresponding to the one or more motion features and the multiple reference features;
- merge, via another set of neural network layers, the multiple predicted features into a merged feature;
- and
- reconstruct a point cloud based on the merged feature.
8 more elements
A method, comprising:
- obtaining multiple reference frames;
- obtaining multiple reference features based on the multiple reference frames;
- obtaining a current feature;
- estimating one or more motion features from the multiple reference features, each paired with the current feature;
- generating, via a set of neural network layers, multiple predicted features corresponding to the one or more motion features and the multiple reference features;
- merging, via another set of neural network layers, the multiple predicted features into a merged feature;
- conditionally encoding a current point cloud frame using the merged feature as a condition;
- and
- packing the one or more motion features into one or more motion bitstreams.
6 more elements
An apparatus comprising:
- a processor;
- and
- a memory storing instructions operative, when executed by the processor, to cause the apparatus to:
- obtain multiple reference frames;
- obtain multiple reference features based on the multiple reference frames;
- obtain a current feature;
- estimate one or more motion features from the multiple reference features, each paired with the current feature;
- generate, via a set of neural network layers, multiple predicted features corresponding to the one or more motion features and the multiple reference features;
- merge, via another set of neural network layers, the multiple predicted features into a merged feature;
- conditionally encode a current point cloud frame using the merged feature as a condition;
- and
- pack the one or more motion features into one or more motion bitstreams.
9 more elements
A method, comprising:
- obtaining multiple reference frames;
- obtaining one or more motion bitstreams;
- decoding one or more motion features corresponding to the one or more motion bitstreams;
- obtaining multiple reference features based on the multiple reference frames;
- generating, via a set of neural network layers, multiple predicted features corresponding to the one or more motion features and the multiple reference features;
- merging, via another set of neural network layers, the multiple predicted features into a merged feature,
- wherein merging the multiple predicted features into the merged feature comprises:
- weighting the multiple predicted features;
- and
- adding the weighted multiple predicted features to generate the merged feature;
- and
- reconstructing a point cloud based on the merged feature.
9 more elements
A method, comprising:
- obtaining multiple reference frames;
- obtaining multiple reference features based on the multiple reference frames;
- obtaining a current feature;
- estimating one or more motion features from the multiple reference features, each paired with the current feature;
- generating, via a set of neural network layers, multiple predicted features corresponding to the one or more motion features and the multiple reference features;
- merging, via another set of neural network layers, the multiple predicted features into a merged feature,
- wherein merging the multiple predicted features into the merged feature comprises:
- weighting the multiple predicted features;
- and
- adding the weighted multiple predicted features to generate the merged feature;
- and
- packing the one or more motion features into one or more motion bitstreams.
9 more elements
Dependencies are inferred from the claim text.