# US 2022/0284667 A1 · Image processing method and image processing device for generating 3d content by means of 2d images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284667 A1
- Document ID: US20220284667A1
- Status: Published application
- Kind: A1
- Application number: 17/636,433
- Filed: 2020-08-24
- Published: 2022-09-08
- Earliest claimed: 2019-08-23
- Assignees: Art & Space It Inc.
- Applicants: Art & Space It Inc.
- Inventors: Bayng Jae PARK; Hee Geun KIM; Jae Min LEE
- Web page: https://patentgrep.com/patent/US20220284667A1

## CPC

- G06T 7/579: from motion
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 7/13: Edge detection
- G06T 7/564: from contours
- G06T 15/10: Geometric effects
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06V 20/64: Three-dimensional [3D] objects
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2219/008: Cut plane or projection plane definition
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed in the present specification is an image processing method performed by an image processing device, the image processing method comprising the steps of: obtaining a first image representing a 2D image of 3D content observed from a first position in a 3D coordinate system and a second image representing a 2D image of the 3D content observed from a second position in the 3D coordinate system; detecting a first boundary line representing one boundary of the 3D content from the first image; detecting a second boundary line representing the one boundary from the second image; and determining a third boundary line for three-dimensionally expressing the one boundary in the 3D coordinate system using the first boundary line and second boundary line.

## Claims

### Claim 1

An image processing method performed by an image processing device, the image processing method comprising:
obtaining a first image representing a 2D image of 3D contents observed from a first position in a 3D coordinate system and a second image representing a 2D image of the 3D contents observed from a second position in the 3D coordinate system;
detecting a first boundary line representing one boundary of the 3D contents from the first image;
detecting a second boundary line representing the one boundary from the second image; and
determining a third boundary line for three-dimensionally representing the one boundary in the 3D coordinate system using the first boundary line and second boundary line.

### Claim 2 (depends on 1)

The image processing method of claim 1, wherein the determining of the third boundary line includes:
creating a first projection surface by projecting the first boundary line in a direction in which the 3D contents are observed at the first position;
creating a second projection surface by projecting the second boundary line in a direction in which the 3D contents are observed at the second position; and
determining the third boundary line on the basis of crossing of the first projection surface and the second projection surface.

### Claim 3 (depends on 2)

The image processing method of claim 2, wherein the creating of the first projection surface is performed by projecting the first boundary line on the basis of FOV (Field Of View) information and resolution information of the first image.

### Claim 4 (depends on 1)

The image processing method of claim 1, wherein the detecting of the first boundary line includes:
displaying the first image on a user terminal;
representing the first boundary line on the first image on the basis of user input; and
detecting the first boundary line in accordance with representation of the first boundary line.

### Claim 5 (depends on 4)

The image processing method of claim 4, further comprising modifying the first boundary line by changing the position of at least one point constituting the first boundary line in accordance with position movement of an indicator displayed on the terminal,
wherein the position of the indicator displayed on the terminal is changed in accordance with user input.

### Claim 6 (depends on 1)

The image processing method of claim 1, further comprising creating a boundary surface three-dimensionally represented in the 3D coordinate system using the third boundary line.

### Claim 7 (depends on 6)

The image processing method of claim 6, wherein the boundary surface is created extending the third boundary line in a predetermined direction.

### Claim 8

An image processing method performed by an image processing device, the image processing method comprising:
recognizing a target object in 3D contents;
obtaining a first image and a second image in which the target object is 2-dimensionally represented;
detecting a boundary line of the target object in the first image and the second image; and
determining a boundary line three-dimensionally represented in the 3D coordinate system using the detected boundary line.

### Claim 9 (depends on 8)

The image processing method of claim 8, wherein the determining of the three-dimensionally represented boundary line includes determining a boundary line representing the same boundary of the target object represented in both the first image and the second image.

### Claim 10 (depends on 8)

The image processing method of claim 8, further comprising creating a boundary surface three-dimensionally represented in the 3D coordinate system using the three-dimensionally represented boundary line.

### Claim 11 (depends on 10)

The image processing method of claim 10, further comprising adding the created boundary surface to the 3D contents.

### Claim 12 (depends on 11)

The image processing method of claim 11, wherein data about the created boundary surface are added to the 3D contents, after predetermined data corresponding to the created boundary line are removed from the 3D contents.

### Claim 13

An image processing device comprising a processor and a memory,
wherein the processor
obtains a first image representing a 2D image of 3D contents observed from a first position in a 3D coordinate system,
obtains a second image representing a 2D image of the 3D contents observed from a second position in the 3D coordinate system,
detects a first boundary line representing one boundary of the 3D contents from the first image,
detects a second boundary line representing the one boundary from the second image; and
determines a third boundary line for three-dimensionally representing the one boundary in the 3D coordinate system using the first boundary line and second boundary line.

### Claim 14

An image processing device comprising a processor and a memory,
wherein the processor
recognizes a target object in 3D contents,
obtains a first image and a second image in which the target object is 2-dimensionally represented,
detects a boundary line of the target object in the first image and the second image, and
determines a boundary line three-dimensionally represented in the 3D coordinate system using the detected boundary line.

### Claim 15 (depends on 1, 8)

A computer-readable recording medium in which computer programs for performing the method of claim 1 or 8 are recorded.
