# US 2023/0274494 A1 · Cropping for efficient three-dimensional digital rendering

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274494 A1
- Document ID: US20230274494A1
- Status: Published application
- Kind: A1
- Application number: 18/083,796
- Filed: 2022-12-19
- Published: 2023-08-31
- Earliest claimed: 2022-02-25
- Assignees: Adobe Inc.
- Applicants: Adobe Inc.
- Inventors: Kowsheek Mahmood; Kevin Roan; David McKinley Cardwell
- Web page: https://patentgrep.com/patent/US20230274494A1

## CPC

- G06T 15/08: Volume rendering
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 15/50: Lighting effects
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 2210/22: Cropping
- G06T 2219/004: Annotating, labelling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method for generating a volume for three-dimensional rendering extracts a plurality of images from a source image input, normalizes the extracted images to have a common pixel size, and determines a notional camera placement for each normalized image to obtain a plurality of annotated normalized images, each annotated with a respective point of view through the view frustum of the notional camera. From the annotated normalized images, the method generates a first volume encompassing a first three-dimensional representation of the target object and selects a smaller subspace within the first volume that encompasses the first three-dimensional representation of the target object. The method generates, from the annotated normalized images, a second volume overlapping the first volume, encompassing a second three-dimensional representation of the target object and having a plurality of voxels, and crops the second volume to limit the second volume to the subspace.

## Claims

### Claim 1

A method for generating a volume for three-dimensional rendering, the method comprising:
receiving a plurality of images, wherein each image of the plurality of images depicts a target object from a particular view angle of a plurality of view angles;
for each of the plurality of images, determining a notional camera placement for the image to obtain a plurality of annotated images, wherein each annotated image of the plurality of annotated images is annotated with a respective point of view of the target object based on the corresponding notional camera placement;
generating, from the plurality of annotated images, a first volume encompassing a first three-dimensional representation of the target object;
selecting a subspace within the first volume, wherein the subspace is smaller than the first volume and the subspace encompasses the first three-dimensional representation of the target object;
generating, from at least a subset of the plurality of annotated images, a second volume, the second volume overlapping the first volume and encompassing a second three-dimensional representation of the target object; and
cropping the second volume to limit the second volume to the subspace to obtain a cropped volume encompassing the second three-dimensional representation of the target object, wherein the cropped volume is rendered at a computing device.

### Claim 2 (depends on 1)

The method of claim 1, wherein plurality of images are extracted from a source image input, and wherein:
the source image input is a CAD file; and
using a path tracing system, a plurality of high-fidelity images are generated, wherein the plurality of images are selected from the plurality of high-fidelity images.

### Claim 3 (depends on 1)

The method of claim 1, wherein plurality of images are extracted from a source image input, and wherein:
the source image input is a video file, wherein the video file captures the target object from the plurality of view angles; and
the plurality of images are selected from images extracted from the video file, wherein each image extracted from the video file is associated with the particular view angle of the plurality of view angles.

### Claim 4 (depends on 1)

The method of claim 1, wherein generating, from at least a subset of the plurality of annotated images, the second volume encompassing the second three-dimensional representation of the target object comprises:
providing at least a subset of the plurality of annotated images to a view generation engine, wherein the view generation engine generates a plurality of annotated synthetic images, wherein each annotated synthetic image is annotated with a respective point of view; and
extrapolating the second volume from the plurality of annotated synthetic images.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first volume is a point cloud.

### Claim 6 (depends on 1)

The method of claim 1, wherein selecting the subspace of the first volume is responsive to a signal received from a user computing device representing a user delineation of the subspace.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the notional cameral placement of the image includes:
transforming the image to have a specified width and height to generate a normalized image; and
determining the notional cameral placement from the normalized image.

### Claim 8 (depends on 1)

The method of claim 1, wherein the second volume includes a plurality of voxels each having a color and an opacity.

### Claim 9

A method for generating a volume for three-dimensional rendering, the method comprising:
transmitting, from a user computing device, a plurality of images, wherein each image of the plurality of images depicts a target object from a particular view angle of a plurality of view angles;
receiving, at the user computing device, a first volume encompassing a first three-dimensional representation of the target object, wherein the first volume is obtained by:
for each of the plurality of images, determining a notional camera placement for the image to obtain a plurality of annotated images, wherein each annotated image of the plurality of annotated images is annotated with a respective point of view of the target object based on the corresponding notional camera placement; and
generating the first volume from the plurality of annotated images;
presenting, on a display of the user computing device, a visualization of the first volume;
transmitting, from the user computing device, a delineation of a subspace within the first volume, wherein the subspace is smaller than the first volume and the subspace encompasses the first three-dimensional representation of the target object;
receiving, at the user computing device, a cropped volume encompassing a second three-dimensional representation of the target object, wherein the cropped volume is limited to the subspace; and
rendering, at the user computing device, the cropped volume.

### Claim 10 (depends on 9)

The method of claim 9, wherein the cropped volume is obtained by:
generating, from at least a subset of the plurality of annotated images, a second volume encompassing the target object, wherein the second volume overlapping the first volume and encompassing the second three-dimensional representation of the target object; and
cropping the second volume to limit the second volume to the subspace to obtain the cropped volume.

### Claim 11 (depends on 10)

The method of claim 10, wherein generating, from at least a subset of the plurality of annotated images, a second volume encompassing of the target object, comprises:
providing at least a subset of the plurality of annotated images to a view generation engine, wherein the view generation engine generates a plurality of annotated synthetic images, wherein each annotated synthetic image is annotated with a respective point of view; and
extrapolating the second volume from the plurality of annotated synthetic images.

### Claim 12 (depends on 11)

The method of claim 11, wherein the second volume includes a plurality of voxels each having a color and an opacity.

### Claim 13 (depends on 9)

The method of claim 9, wherein plurality of images are extracted from a source image input, and wherein:
the source image input is a CAD file; and
using a path tracing system, 200 to 400 high-fidelity images are generated, wherein the plurality of images are selected from the 200 to 400 high-fidelity images.

### Claim 14 (depends on 9)

The method of claim 9, wherein plurality of images are extracted from a source image input, and wherein:
the source image input is a video file, wherein the video file captures the target object from the plurality of view angles; and
the plurality of images are selected from images extracted from the video file, wherein each image extracted from the video file is associated with the particular view angle of the plurality of view angles.

### Claim 15

A data processing system comprising at least one processor and a memory coupled to the at least one processor, the memory containing instructions which, when executed by the at least one processor, cause the at least one processor to perform:
receiving a source image input, wherein the source image input is selected from the group consisting of:
an image set comprising a plurality of images; and
a CAD file;
wherein the source image input captures a target object;
extracting a plurality of images from the source image input to obtain extracted images;
normalizing the extracted images to obtain normalized images, wherein the normalized images have a common pixel size;
for each of the normalized images, determining a notional camera placement for that respective normalized image to obtain a plurality of annotated normalized images, wherein each annotated normalized image is annotated with a respective point of view through a view frustum of a notional camera;
generating, from the annotated normalized images, a first volume encompassing a first three-dimensional representation of the target object;
selecting a subspace within the first volume, wherein the subspace is smaller than the first volume and the subspace encompasses the first three-dimensional representation of the target object;
generating, from at least a subset of the annotated normalized images, a second volume, the second volume overlapping the first volume and encompassing a second three-dimensional representation of the target object;
wherein the second volume includes a plurality of voxels each having a color and an opacity; and
cropping the second volume to limit the second volume to the subspace to obtain a cropped volume encompassing the second three-dimensional representation of the target object.

### Claim 16 (depends on 15)

The data processing system of claim 15, wherein:
the source image input is a CAD file; and
using a path tracing system, 200 to 400 high-fidelity images are generated.

### Claim 17 (depends on 15)

The data processing system of claim 15, wherein:
the source image input is a video file, and wherein:
the video file is of at least 1 minute but less than 3 minutes in length;
the video file captures the target object from a plurality of view angles; and
the video file has a frame rate of X frames per second; and
images are extracted at every Yth frame, where Y<X, to extract a total of 200 to 400 images.

### Claim 18 (depends on 15)

The data processing system of claim 15, wherein generating, from at least a subset of the plurality of annotated normalized images, the second volume encompassing the second three-dimensional representation of the target object comprises:
providing at least a subset of the plurality of annotated images to a view generation engine, wherein the view generation engine generates a plurality of annotated synthetic images, wherein each annotated synthetic image is annotated with a respective point of view; and
extrapolating the second volume from the plurality of annotated synthetic images.

### Claim 19 (depends on 15)

The data processing system of claim 15, wherein the first volume is a point cloud.

### Claim 20 (depends on 15)

The data processing system of claim 15, wherein selecting the subspace of the first volume is responsive to a signal received from a user computing device representing a user delineation of the subspace.
