# US 2022/0035970 A1 · Three-Dimensional (3D) Modeling Systems and Methods for Automatically Generating Photorealistic, Virtual 3D Package and Product Models from 3D and Two-Dimensional (2D) Imaging Assets

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0035970 A1
- Document ID: US20220035970A1
- Status: Published application
- Kind: A1
- Application number: 16/941,689
- Filed: 2020-07-29
- Published: 2022-02-03
- Earliest claimed: 2020-07-29
- Assignees: The Procter & Gamble Company
- Applicants: The Procter & Gamble Company
- Inventors: Diana Jobson Cheshire; David A Lombardi, Jr.
- Web page: https://patentgrep.com/patent/US20220035970A1

## CPC

- G06F 30/10: Geometric CAD
- G06F 30/23: using finite element methods [FEM] or finite difference methods [FDM]
- G06F 30/12: characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
- G06F 2111/20: Configuration CAD, e.g. designing by assembling or positioning modules selected from libraries of predesigned modules
- G06F 2113/10: Additive manufacturing, e.g. three-dimensional [3D] printing
- G06F 2113/20: Packaging, e.g. boxes or containers
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Three-dimensional (3D) modeling systems and methods are described for automatically generating photorealistic, virtual 3D package and product models from 3D and two-dimensional (2D) imaging assets. The 3D modeling systems and methods include loading, into a memory with one or more processors, computer-aided design (CAD) component(s) and assembling, with an automatic imaging asset assembly script, the CAD component(s) to create a parametric-based CAD model. A polygonal model of a real-world product or product package is generated based on the parametric-based CAD model. Digital surface finish artifact(s) of a virtual material library, as selected from the 2D imaging assets, are applied to the polygonal model. A virtual 3D model is generated based on the polygonal model and a UV coordinate mapping corresponding to a virtual product label, and rendered, via a graphical display, as a photorealistic image representing the real-world product or product package.

## Claims

### Claim 1

A three-dimensional (3D) modeling system configured to automatically generate photorealistic, virtual 3D package and product models from 3D and two-dimensional (2D) imaging assets, the 3D modeling system comprising:
one or more processors;
an automatic imaging asset assembly script configured to execute on the one or more processors; and
a memory configured to store 2D imaging assets and 3D imaging assets accessible by the automatic imaging asset assembly script,
wherein the one or more processors are configured to:
load, into a memory, one or more computer-aided design (CAD) components as selected from one or more of the 2D imaging assets or the 3D imaging assets;
assemble, with the automatic imaging asset assembly script, the one or more CAD components to create a parametric-based CAD model, the parametric-based CAD model corresponding to a design for a real-world product or product package;
generate a polygonal model of the real-world product or product package based on the parametric-based CAD model, wherein one or more digital surface finish artifacts of a virtual material library, as selected from the 2D imaging assets, are applied to the polygonal model;
generate, based on parametric information of the parametric-based CAD model, a UV coordinate mapping corresponding to a virtual product label;
generate a virtual 3D model of the real-world product or product package based on the polygonal model, the UV coordinate mapping, and the virtual product label; and
render, via a graphical display, the virtual 3D model as a photorealistic image representing the real-world product or product package.

### Claim 2 (depends on 1)

The 3D modeling system of claim 1, wherein the virtual 3D model is a high resolution polygonal model representing of the real-world product or product package.

### Claim 3 (depends on 1)

The 3D modeling system of claim 1, wherein the one or more processors are further configured to initiate creation of at least a portion of the real-world product or product package based on the virtual 3D model.

### Claim 4 (depends on 3)

The 3D modeling system of claim 3 further comprising creating, with a 3D printer, at least a portion of the real-world product or product package based on the virtual 3D model.

### Claim 5 (depends on 3)

The 3D modeling system of claim 3 further comprising transmitting via a computer network to a process plant the virtual 3D model for creation of at least a portion of the real-world product or product package.

### Claim 6 (depends on 1)

The 3D modeling system of claim 1 further comprising a server comprising at least one processor of the one or more processors, wherein at least a portion of the 2D imaging assets or the 3D imaging assets are retrieved via a computing network.

### Claim 7 (depends on 1)

The 3D modeling system of claim 1, wherein the one or more processors are further configured to launch a visualization editor, the visualization editor configured to load into memory, or render on the graphical display, any one or more of the one or more CAD components, the parametric information, the parametric-based CAD model, the polygonal model, the UV coordinate mapping, the virtual product label, or the virtual 3D model.

### Claim 8 (depends on 7)

The 3D modeling system of claim 7, wherein the visualization editor is configured to receive user selections to manipulate any of a shape of the virtual 3D model, a virtual material of virtual 3D model, a finish of the virtual 3D model, a color of the virtual 3D model, or the virtual product label.

### Claim 9 (depends on 8)

The 3D modeling system of claim 8, wherein the one or more processors are further configured to generate or render a new virtual 3D model based on the user selections, the new virtual 3D model representing a new product or product package corresponding to the user selections.

### Claim 10 (depends on 9)

The 3D modeling system of claim 9, wherein the one or more processors are further configured to store the virtual 3D model in memory such that the virtual 3D model is accessible to the automatic imaging asset assembly script or the visualization editor, the automatic imaging asset assembly script or the visualization editor configured to generate one or more additional virtual 3D models corresponding to one or more additional real-world products or product packages.

### Claim 11

A three-dimensional (3D) modeling method for automatically generating photorealistic, virtual 3D package and product models from 3D and two-dimensional (2D) imaging assets, the 3D modeling method comprising:
loading, into a memory with one or more processors, one or more computer-aided design (CAD) components as selected from one or more of the 2D imaging assets or the 3D imaging assets;
assembling, with an automatic imaging asset assembly script implemented on the one or more processors, the one or more CAD components to create a parametric-based CAD model, the parametric-based CAD model corresponding to a design for a real-world product or product package;
generating, with the one or more processors, a polygonal model of the real-world product or product package based on the parametric-based CAD model, wherein one or more digital surface finish artifacts of a virtual material library, as selected from the 2D imaging assets, are applied to the polygonal model;
generating, with the one or more processors and based on parametric information of the parametric-based CAD model, a UV coordinate mapping corresponding to a virtual product label;
generating, with the one or more processors, a virtual 3D model of the real-world product or product package based on the polygonal model, the UV coordinate mapping, and the virtual product label; and
rendering, via a graphical display, the virtual 3D model as a photorealistic image representing the real-world product or product package.

### Claim 12 (depends on 11)

The 3D modeling method of claim 11, wherein the one or more CAD components are loaded in memory based on a predefined design shape corresponding to the real-world product or product package.

### Claim 13 (depends on 12)

The 3D modeling method of claim 12, wherein a selection of the predefined design shape causes the one or more processors to select and execute the automatic imaging asset assembly script, wherein the automatic imaging asset assembly script is selected based on a classification of the predefined design shape.

### Claim 14 (depends on 11)

The 3D modeling method of claim 11 further comprising rendering, with the one or more processors, the photorealistic image within a first image scene.

### Claim 15 (depends on 14)

The 3D modeling method of claim 14 further comprising rendering, with the one or more processors, the photorealistic image within a second image scene, the second image scene different from the first image scene.

### Claim 16 (depends on 11)

The 3D modeling method of claim 11 further comprising launching, with the one or more processors, a visualization editor, the visualization editor configured to load into memory, or render on the graphical display, any one or more of the one or more CAD components, the parametric information, the parametric-based CAD model, the polygonal model, the UV coordinate mapping, the virtual product label, or the virtual 3D model.

### Claim 17 (depends on 16)

The 3D modeling method of claim 16, wherein the visualization editor is configured to receive user selections to manipulate any of a shape of the virtual 3D model, a virtual material of virtual 3D model, a finish of the virtual 3D model, a color of the virtual 3D model, or the virtual product label.

### Claim 18 (depends on 17)

The 3D modeling method of claim 17 further comprising generating or rendering, with the one or more processors, a new virtual 3D model based on the user selections, the new virtual 3D model representing a new product or product package corresponding to the user selections.

### Claim 19 (depends on 18)

The 3D modeling method of claim 18 further comprising storing, with the one or more processors, the virtual 3D model in memory such that the virtual 3D model is accessible to the automatic imaging asset assembly script or the visualization editor, the automatic imaging asset assembly script or the visualization editor configured to generate one or more additional virtual 3D models corresponding to one or more additional real-world products or product packages.

### Claim 20

A tangible, non-transitory computer-readable medium storing instructions for automatically generating photorealistic, virtual three-dimensional (3D) package and product models from 3D and two-dimensional (2D) imaging assets, that when executed by one or more processors cause the one or more processors to:
load, into a memory, one or more computer-aided design (CAD) components as selected from one or more of the 2D imaging assets or the 3D imaging assets;
assemble the one or more CAD components to create a parametric-based CAD model, the parametric-based CAD model corresponding to a design for a real-world product or product package;
generate a polygonal model of the real-world product or product package based on the parametric-based CAD model, wherein one or more digital surface finish artifacts of a virtual material library, as selected from the 2D imaging assets, are applied to the polygonal model;
generate, based on parametric information of the parametric-based CAD model, a UV coordinate mapping corresponding to a virtual product label;
generate a virtual 3D model of the real-world product or product package based on the polygonal model, the UV coordinate mapping, and the virtual product label; and
render, via a graphical display, the virtual 3D model as a photorealistic image representing the real-world product or product package.
