# US 2023/0274040 A1 · Modeling shapes using differentiable signed distance functions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274040 A1
- Document ID: US20230274040A1
- Status: Published application
- Kind: A1
- Application number: 17/683,188
- Filed: 2022-02-28
- Published: 2023-08-31
- Earliest claimed: 2022-02-28
- Assignees: Adobe Inc.
- Applicants: Adobe Inc.
- Inventors: Adrien Kaiser; Vojtech Krs; Thibault Groueix; Tamy Boubekeur; Pierre Gueth; Mathieu Gaillard; Matheus Gadelha
- Web page: https://patentgrep.com/patent/US20230274040A1

## CPC

- G06F 30/12: characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06F 30/10: Geometric CAD
- G06F 30/20: Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30)
- G06F 30/25: using particle-based methods
- G06F 30/27: using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
- G06T 2219/20: Indexing scheme for editing of 3D models
- G06T 2219/2021: Shape modification
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Certain aspects and features of this disclosure relate to modeling shapes using differentiable, signed distance functions. 3D modeling software can edit a 3D model represented using the differentiable, signed distance functions while displaying the model in a manner that is computing resource efficient and fast. Further, such 3D modeling software can automatically create such an editable 3D model from a reference representation that can be obtained in various ways and stored in a variety of formats. For example, a real-world object can be scanned using LiDAR and a reference representation can be produced from the LiDAR data. Candidate procedural models from a library of curated procedural models are optimized to obtain the best procedural model for editing. A selected procedural model provides an editable, reconstructed shape based on the reference representation of the object.

## Claims

### Claim 1

A method comprising:
accessing a reference representation of an object;
transforming the reference representation into a common representation by sampling points associated with the reference representation of the object;
selecting a plurality of candidate procedural models corresponding to the reference representation based on the common representation;
optimizing the plurality of candidate procedural models by comparing a procedural value and a reference value of a differentiable signed distance function for each of the points associated with the reference representation of the object to provide a selected procedural model; and
producing a 3D, editable procedural model of a reconstructed shape based on the reference representation of the object using the selected procedural model.

### Claim 2 (depends on 1)

The method of claim 1, wherein selecting the plurality of candidate procedural models further comprises:
accessing a set of initial parameters for a procedural graph for each available procedural model;
generating a 3D, reconstructed shape for each set of initial parameters; and
storing the procedural graph for the 3D, reconstructed shape closest to the common representation.

### Claim 3 (depends on 2)

The method of claim 2, further comprising determining the 3D, reconstructed shape closest to the reference representation by minimizing a mean-squared error of signed distances between locations on the 3D, reconstructed shape and the reference representation.

### Claim 4 (depends on 2)

The method of claim 2, further comprising determining the 3D, reconstructed shape closest to the reference representation by minimizing a value of a loss function.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
rendering an image corresponding to the 3D, editable procedural model; and
rendering an editing interface associated with the image, the editing interface including adjustable parameters corresponding to the reconstructed shape as based on the reference representation.

### Claim 6 (depends on 1)

The method of claim 1, further comprising accessing partial captured LiDAR image data from the object to produce the reference representation.

### Claim 7 (depends on 1)

The method of claim 1, wherein the selected procedural model includes portions of the object not present in the reference representation.

### Claim 8

A system comprising:
a memory component; and
a processing device coupled to the memory component, the processing device to perform operations comprising:
transforming a reference representation of an object into a common representation by sampling points associated with the reference representation of the object;
selecting a plurality of candidate procedural models corresponding to the reference representation based on the common representation;
optimizing the plurality of candidate procedural models by comparing a procedural value and a reference value of a differentiable signed distance function for each of the points associated with the reference representation of the object to provide a selected procedural model;
producing a 3D, editable procedural model of a reconstructed shape based on the reference representation of the object using the selected procedural model;
rendering an image corresponding to the 3D, editable procedural model; and
rendering an editing interface associated with the image.

### Claim 9 (depends on 8)

The system of claim 8, wherein the operation of selecting the plurality of candidate procedural models further comprises the operations of:
accessing a set of initial parameters for a procedural graph for each available procedural model;
generating a 3D, reconstructed shape for each set of initial parameters; and
storing the procedural graph for the 3D, reconstructed shape closest to the common representation.

### Claim 10 (depends on 9)

The system of claim 9, wherein the operations further comprise determining the 3D, reconstructed shape closest to the reference representation by minimizing a mean-squared error in signed distances between locations on the 3D, reconstructed shape and the reference representation.

### Claim 11 (depends on 9)

The system of claim 9, wherein the operations further comprise determining the 3D, reconstructed shape closest to the reference representation by minimizing a value of a loss function.

### Claim 12 (depends on 8)

The system of claim 8, wherein the editing interface comprises adjustable parameters corresponding to the reconstructed shape as based on the reference representation.

### Claim 13 (depends on 8)

The system of claim 8, wherein the operations further comprise accessing partial captured LiDAR image data from the object to produce the reference representation.

### Claim 14 (depends on 8)

The system of claim 8, wherein the selected procedural model includes portions of the object not present in the reference representation.

### Claim 15

A non-transitory computer-readable medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:
accessing a reference representation of an object;
transforming the reference representation into a common representation by sampling points associated with the reference representation of the object;
a step for selecting a plurality of candidate procedural models based on the common representation; and
a step for producing a 3D, editable procedural model of a reconstructed shape based on the reference representation of the object using a selected procedural model.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the operations further comprise determining a 3D, reconstructed shape closest to the reference representation by minimizing a mean-squared error in signed distances between locations on the 3D, reconstructed shape and the reference representation.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the operations further comprise determining the 3D, reconstructed shape closest to the reference representation by minimizing a value of a loss function.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the operations further comprise rendering an editing interface including adjustable parameters corresponding to the reconstructed shape as based on the reference representation.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the operations further comprise accessing partial captured LiDAR image data from the object to produce the reference representation.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the selected procedural model includes portions of the object not present in the reference representation.
