# US 2025/0166291 A1 · Method and electronic apparatus for 3d reconstruction of object using view synthesis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0166291 A1
- Document ID: US20250166291A1
- Status: Published application
- Kind: A1
- Application number: 19/030,776
- Filed: 2025-01-17
- Published: 2025-05-22
- Earliest claimed: 2022-09-29
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Sunyoung JEON; Jungmin LEE; Kwangpyo CHOI
- Web page: https://patentgrep.com/patent/US20250166291A1

## CPC

- G06T 7/55: from multiple images
- G06T 7/00: Image analysis
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G06T 7/33: using feature-based methods
- G06T 7/593: from stereo images
- G06T 7/73: using feature-based methods
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 15/10: Geometric effects
- G06T 15/205: {Image-based rendering}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30168: Image quality inspection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method and electronic apparatus for three-dimensional (3D) reconstruction of an object by using view synthesis are provided. The method includes obtaining source images of a scene including an object, generating a target viewpoint based on a spatial distribution of source viewpoints corresponding to the source images, generating a target image corresponding to the target viewpoint by performing the view synthesis, and generating a 3D model of the object by 3D reconstruction based on the source images and the target image.

## Claims

### Claim 1

A method for three-dimensional (3D) reconstruction of an object, the method comprising:
obtaining source images of a scene including an object;
generating a target viewpoint based on a spatial distribution of source viewpoints corresponding to the source images;
generating a target image corresponding to the target viewpoint by performing view synthesis; and
generating a 3D model of the object by 3D reconstruction based on the source images and the target image.

### Claim 2 (depends on 1)

The method of claim 1, wherein the generating the target image corresponding to the target viewpoint by performing the view synthesis comprises:
generating a temporary target image corresponding to the target viewpoint by performing the view synthesis;
evaluating a quality of the temporary target image; and
generating the target image by reperforming the view synthesis based on a result of the evaluating the quality of the temporary target image.

### Claim 3 (depends on 2)

The method of claim 2, wherein the generating the target image by reperforming the view synthesis based on the result of the evaluating the quality of the temporary target image comprises:
adjusting a processing cost of the view synthesis based on the result of the evaluating the quality of the temporary target image; and
generating the target image by performing the view synthesis with the adjusted processing cost.

### Claim 4 (depends on 3)

The method of claim 3, wherein the view synthesis is based on a deep learning network, and
wherein the processing cost of the view synthesis is adjusted by changing the processing cost of the deep learning network.

### Claim 5 (depends on 1)

The method of claim 1, wherein the generating the target image corresponding to the target viewpoint by performing the view synthesis comprises:
generating source depth images from the source images;
generating masked source depth images by performing object masking on the source depth images; and
generating the target image by performing the view synthesis by using the source images and the masked source depth images.

### Claim 6 (depends on 1)

The method of claim 1, wherein the generating the target viewpoint based on the spatial distribution of the source viewpoints comprises:
generating a grid map on a coordinate system;
matching the source viewpoints with cells of the grid map based on coordinate values of the source viewpoints on the coordinate system; and
generating the target viewpoint to be matched to any one cell among the cells of the grid map that are not matched with the source viewpoints.

### Claim 7 (depends on 6)

The method of claim 6, wherein the matching the source viewpoints with the cells of the grid map based on the coordinate values of the source viewpoints on the coordinate system comprises:
based on a coordinate range of a cell of the grid map for two coordinates on the coordinate system including a coordinate value of a source viewpoint about the two coordinates on the coordinate system, matching the source viewpoint to the cell.

### Claim 8 (depends on 6)

The method of claim 6, wherein the generating the target viewpoint to be matched to any one cell among the cells of the grid map that are not matched with the source viewpoints comprises:
generating the target viewpoint such that a coordinate value the target viewpoint for two coordinates on the coordinate system is included in a coordinate range of the a cell for the two coordinates on the coordinate system.

### Claim 9 (depends on 6)

The method of claim 6, wherein the generating the 3D model of the object by the 3D reconstruction based on the source images and the target image comprises:
generating a temporary 3D model of the object by the 3D reconstruction based on the source images and the target image;
evaluating a quality of the temporary 3D model;
generating an additional target viewpoint based on a result of the evaluating the quality of the temporary 3D model;
generating an additional target image corresponding to the additional target viewpoint by performing the view synthesis; and
generating the 3D model of the object by the 3D reconstruction based on the source images, the target image, and the additional target image.

### Claim 10 (depends on 9)

The method of claim 9, wherein the generating the additional target viewpoint based on the quality of the temporary 3D model comprises:
sensing a defective region of the temporary 3D model;
matching at least one cell of the grid map with the defective region;
dividing the matched at least one cell; and
generating the additional target viewpoint to be matched to the divided at least one cell.

### Claim 11 (depends on 10)

The method of claim 10, wherein the matching the at least one cell of the grid map with the defective region comprises:
sensing at least one image used to generate the defective region among the source images and the target image; and
matching at least one cell matched with the at least one image to the defective region.

### Claim 12 (depends on 10)

The method of claim 10, wherein the matching the at least one cell of the grid map to the defective region comprises matching at least one cell with a largest size in the defective region to the defective region when the temporary 3D model is two-dimensional (2D)-rendered on the grid map.

### Claim 13

An electronic apparatus for three-dimensional (3D) reconstruction of an object by using view synthesis, the electronic apparatus comprising:
memory configured to store one or more instructions; and
at least one processor configured to execute the one or more instructions,
wherein the one or more instructions, when executed by the at least one processor, cause the electronic apparatus to:
obtain source images of a scene including an object,
generate a target viewpoint based on a spatial distribution of source viewpoints corresponding to the source images,
generate a target image corresponding to the target viewpoint by performing the view synthesis, and
generate a 3D model of the object by 3D reconstruction based on the source images and the target image.

### Claim 14 (depends on 13)

The electronic apparatus of claim 13, wherein the one or more instructions, when executed by the at least one processor, cause the electronic apparatus to:
generate a temporary target image corresponding to the target viewpoint by performing the view synthesis,
evaluate a quality of the temporary target image, and
generate the target image by reperforming the view synthesis based on a result of the evaluation of the quality of the temporary target image.

### Claim 15 (depends on 14)

The electronic apparatus of claim 14, wherein the one or more instructions, when executed by the at least one processor, cause the electronic apparatus to:
adjust a processing cost of the view synthesis based on the result of the evaluation of the quality of the temporary target image, and
generate the target image by performing the view synthesis with the adjusted processing cost.

### Claim 16 (depends on 13)

The electronic apparatus of claim 13, wherein the one or more instructions, when executed by the at least one processor, cause the electronic apparatus to:
generate source depth images from the source images,
generate masked source depth images by performing object masking on the source depth images; and
generate the target image by performing the view synthesis by using the source images and the masked source depth images.

### Claim 17 (depends on 13)

The electronic apparatus of claim 13, wherein the one or more instructions, when executed by the at least one processor, cause the electronic apparatus to:
generate a grid map on a coordinate system;
match the source viewpoints with cells of the grid map based on coordinate values of the source viewpoints on the coordinate system; and
generate the target viewpoint to be matched to any one cell among the cells of the grid map that are not matched with the source viewpoints.

### Claim 18 (depends on 17)

The electronic apparatus of claim 17, wherein the one or more instructions, when executed by the at least one processor, cause the electronic apparatus to:
generate a temporary 3D model of the object by the 3D reconstruction based on the source images and the target image;
evaluate a quality of the temporary 3D model;
generate an additional target viewpoint based on a result of the evaluating the quality of the temporary 3D model;
generate an additional target image corresponding to the additional target viewpoint by performing the view synthesis; and
generate the 3D model of the object by the 3D reconstruction based on the source images, the target image, and the additional target image.

### Claim 19 (depends on 18)

The electronic apparatus of claim 18, wherein the one or more instructions, when executed by the at least one processor, cause the electronic apparatus to:
sense a defective region of the temporary 3D model;
match at least one cell of the grid map with the defective region;
divide the matched at least one cell; and
generate the additional target viewpoint to be matched to the divided at least one cell.

### Claim 20 (depends on 19)

The electronic apparatus of claim 19, wherein the one or more instructions, when executed by the at least one processor, cause the electronic apparatus to:
sense at least one image used to generate the defective region among the source images and the target image; and
match at least one cell matched with the at least one image to the defective region.