US 2026/0087730 A1 · GENERATING THREE-DIMENSIONAL IMAGES USING TRANSFORMER-BASED AND DIFFUSION-BASED ARTIFICIAL INTELLIGENCE TECHNIQUES

Abstract

Methods, apparatus, and processor-readable storage media for generating 3D images using transformer-based and diffusion-based artificial intelligence techniques are provided herein. An example computer-implemented method includes obtaining at least one 2D image; generating one or more point cloud tokens and one or more triplane tokens based at least in part on at least portions of the at least one 2D image; determining multiple 3D features associated with the at least portions of the at least one 2D image by processing at least a portion of the one or more point cloud tokens and at least a portion of the one or more triplane tokens using one or more transformer-based artificial intelligence techniques; and generating a 3D image associated with the at least portions of the at least one 2D image by processing at least a portion of the multiple 3D features using one or more diffusion-based artificial intelligence techniques.

Claims20

Dependent claims

A computer-implemented method comprising:

obtaining at least one two-dimensional image;
generating one or more point cloud tokens and one or more triplane tokens based at least in part on at least portions of the at least one two-dimensional image;
determining multiple three-dimensional features associated with the at least portions of the at least one two-dimensional image by processing at least a portion of the one or more point cloud tokens and at least a portion of the one or more triplane tokens using one or more transformer-based artificial intelligence techniques;
and
generating a three-dimensional image associated with the at least portions of the at least one two-dimensional image by processing at least a portion of the multiple three-dimensional features using one or more diffusion-based artificial intelligence techniques;
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

3 more elements

A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:

to obtain at least one two-dimensional image;
to generate one or more point cloud tokens and one or more triplane tokens based at least in part on at least portions of the at least one two-dimensional image;
to determine multiple three-dimensional features associated with the at least portions of the at least one two-dimensional image by processing at least a portion of the one or more point cloud tokens and at least a portion of the one or more triplane tokens using one or more transformer-based artificial intelligence techniques;
and
to generate a three-dimensional image associated with the at least portions of the at least one two-dimensional image by processing at least a portion of the multiple three-dimensional features using one or more diffusion-based artificial intelligence techniques.

2 more elements

An apparatus comprising:

at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured:
to obtain at least one two-dimensional image;
to generate one or more point cloud tokens and one or more triplane tokens based at least in part on at least portions of the at least one two-dimensional image;
to determine multiple three-dimensional features associated with the at least portions of the at least one two-dimensional image by processing at least a portion of the one or more point cloud tokens and at least a portion of the one or more triplane tokens using one or more transformer-based artificial intelligence techniques;
and
to generate a three-dimensional image associated with the at least portions of the at least one two-dimensional image by processing at least a portion of the multiple three-dimensional features using one or more diffusion-based artificial intelligence techniques.

4 more elements

Dependencies are inferred from the claim text.

Generating three-dimensional images using transformer-based and diffusion-based artificial intelligence techniques

Life of this patent

Generating three-dimensional images using transformer-based and diffusion-based artificial intelligence techniques

Life of this patent

Abstract

Claims20