Convolutional approach to fast and compact packing of 3D mesh into 2D maps

A device comprising a memory for storing computer instructions and a processor, the processor, when executing the computer instructions to project a first portion of a three-dimensional (3D) mesh frame to a two-dimensional (2D) occupancy map, is configured to:

• obtain an initial 2D occupancy map, the initial 2D occupancy map comprising:
• zero or more pixels with a first predefined value indicating that the zero or more pixels have been mapped to at least one other portion of the 3D mesh frame, the at least one other portion being non-overlapping with the first portion of the 3D mesh frame;
• and
• remaining pixels with a second predefined value indicating that the remaining pixels have not been mapped to the 3D mesh frame;
• generate a 2D occupancy matrix for the first portion of the 3D mesh frame, wherein the first predefined value corresponds to an occupied pixel and the second predefined value corresponds to an unoccupied pixel;
• compute a correlation matrix between the initial 2D occupancy map and the 2D occupancy matrix;
• identify a zero-valued target element in the correlation matrix;
• and
• generate an updated 2D occupancy map by replacing pixels having the second predefined value in a patch in the initial 2D occupancy map having a same size as the 2D occupancy matrix with corresponding elements in the 2D occupancy matrix, the patch being located in the initial 2D occupancy map at a packing location according to a position of the zero-valued target element in the correlation matrix.

A non-transitory computer readable medium for storing computer instructions, the computer instructions when executed by a processor of an electronic device to project a first portion of a three-dimensional (3D) mesh frame to a two-dimensional (2D) occupancy map, is configured to cause the electronic device to:

• obtain an initial 2D occupancy map, the initial 2D occupancy map comprising:
• zero or more pixels with a first predefined value indicating that the zero or more pixels have been mapped to at least one other portion of the 3D mesh frame, the at least one other portion being non-overlapping with the first portion of the 3D mesh frame;
• and
• remaining pixels with a second predefined value indicating that the remaining pixels have not been mapped to the 3D mesh frame;
• generate a 2D occupancy matrix for the first portion of the 3D mesh frame, wherein the first predefined value corresponds to an occupied pixel and the second predefined value corresponds to an unoccupied pixel;
• compute a correlation matrix between the initial 2D occupancy map and the 2D occupancy matrix;
• identify a zero-valued target element in the correlation matrix;
• and
• generate an updated 2D occupancy map by replacing pixels having the second predefined value in a patch in the initial 2D occupancy map having a same size as the 2D occupancy matrix with corresponding elements in the 2D occupancy matrix, the patch being located in the initial 2D occupancy map at a packing location according to a position of the zero-valued target element in the correlation matrix.