Projection-based style transfer for volumetric data
AssigneesSony Group Corporation, Sony Corporation of America
InventorsALEXANDRE ZAGHETTO, DANILLO BRACCO GRAZIOSI, ALI TABATABAI
Life of this patent
Estimating the term…
Abstract
Provided is a system and method for projection-based style transfer for volumetric data. The system acquires three-dimensional (3D) volumetric data and two-dimensional (2D) style image data. Further, the system generates a plurality of 2D projection images based on the acquired 3D volumetric data and prepares an input for a style transfer neural network based on the generated plurality of 2D projection images and the acquired 2D style image data. The system generates a plurality of stylized 2D projection images based on application of the style transfer neural network on the prepared input and obtains a stylized 3D volumetric data based on the plurality of stylized 2D projection images.
Claims22
A system, comprising:
- circuitry configured to:
- acquire three-dimensional (3D) volumetric data;
- acquire two-dimensional (2D) style image data;
- generate a plurality of 2D projection images based on the acquired 3D volumetric data;
- prepare an input for a style transfer neural network based on the generated plurality of 2D projection images and the acquired 2D style image data;
- generate a plurality of stylized 2D projection images based on application of the style transfer neural network on the prepared input;
- and
- obtain a stylized 3D volumetric data based on the plurality of stylized 2D projection images.
A method, comprising:
- in a system:
- acquiring three-dimensional (3D) volumetric data;
- acquiring 2D style image data;
- generating a plurality of two-dimensional (2D) projection images based on the acquired 3D volumetric data;
- preparing an input for a style transfer neural network based on the generated plurality of 2D projection images and the acquired 2D style image data;
- generating a plurality of stylized 2D projection images based on application of the style transfer neural network on the prepared input;
- and
- obtaining a stylized 3D volumetric data based on the plurality of stylized 2D projection images.
A non-transitory computer-readable medium having stored thereon, computer-executable instructions that when executed by a system comprising control circuitry, causes the system to execute operations, the operations comprising:
- acquiring three-dimensional (3D) volumetric data;
- acquiring 2D style image data;
- generating a plurality of two-dimensional (2D) projection images based on the acquired 3D volumetric data;
- preparing an input for a style transfer neural network based on the generated plurality of 2D projection images and the acquired 2D style image data;
- generating a plurality of stylized 2D projection images based on application of the style transfer neural network on the prepared input;
- and
- obtaining a stylized 3D volumetric data based on the plurality of stylized 2D projection images.
Dependencies are inferred from the claim text.