# US 2010/0073364 A1 · Conversion method and apparatus with depth map generation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0073364 A1
- Document ID: US20100073364A1
- Status: Published application
- Kind: A1
- Application number: 12/453,115
- Filed: 2009-04-29
- Published: 2010-03-25
- Earliest claimed: 2008-09-25
- Assignees: Samsung Electronics Co., Ltd.
- Inventors: Yong Ju Jung; Aron Baik; Du-Sik Park
- Web page: https://patentgrep.com/patent/US20100073364A1

## CPC

- G06T 7/13: Edge detection
- G06T 7/543: from line drawings
- G06T 2207/10012: Stereo images
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A conversion method and apparatus with a generating of a depth map for two dimensional (2D)-to-three dimensional (3D) conversion. A depth order may be restored based on a line tracing and an edge map generated from an input image, and a stereo image may be generated using depth information.

## Claims

### Claim 1

A conversion method with a generated a depth map for two dimensional (2D)-to-three dimensional (3D) conversion, the method comprising:
generating an edge map using a determined edge of an input image;
extracting an edge having an identified characteristic meeting a predetermined requirement from the edge map, mapping the extracted edge to an initial line map, and generating a line map including a plurality of lines generated by the mapping of the extracted edge to the initial line map; and
generating the depth map to have a sequential depth order, using the plurality of lines of the line map.

### Claim 2 (depends on 1)

The conversion method of claim 1, wherein the generating of the edge map includes extracting an edge from the input image based on a detected luminance difference of at least one pixel of the input image to generate the edge map.

### Claim 3 (depends on 1)

The conversion method of claim 1, wherein the extracting, the mapping, and the generating of the line map includes extracting an edge with an identified value being greater than a predetermined value in a defined direction from a defined border of the edge map to another border of the edge map, a mapping of the extracted edge having the identified value being greater than the predetermined value in the defined direction to the initial line map, and generating the line map including a plurality of lines generated by the mapping of the extracted edge having the identified value being greater than the predetermined value in the defined direction to the initial line map.

### Claim 4 (depends on 1)

The conversion method of claim 1, wherein the generating of the depth map sequentially increases or decreases a depth order of a region between lines of the plurality of lines to generate the depth map.

### Claim 5 (depends on 4)

The conversion method of claim 4, wherein the region is located between lines of the plurality of lines of the line map, and each region has an identical depth order.

### Claim 6 (depends on 1)

The conversion method of claim 1, wherein the plurality of lines do not cross each other and are equal to or less than a predetermined gradient value.

### Claim 7 (depends on 1)

The conversion method of claim 1, wherein the generating of the line map further comprises:
preventing each of the plurality of lines from changing in a vertical direction, and applying a smoothness constraint to select a line for the line map nearest to the edge map.

### Claim 8 (depends on 1)

The conversion method of claim 1, wherein the generating of the line map further comprises:
applying an elasticity constraint to prevent any one of the plurality of lines from changing in a vertical direction with an identified value being greater than a predetermined value.

### Claim 9 (depends on 1)

The conversion method of claim 1, wherein the generating of the edge map further comprises down-scaling the input image.

### Claim 10 (depends on 1)

The conversion method of claim 1, further comprising:
up-scaling the depth map; and
smoothing the depth map.

### Claim 11 (depends on 1)

The conversion method of claim 1, further comprising:
lateral-shifting the depth map based on a depth order of a location of each pixel of the depth map, and generating a stereo image based on the lateral-shifting.

### Claim 12 (depends on 1)

The conversion method of claim 1, further comprising:
generating a pictorial depth cue using the depth map; and
regenerating the depth map using the pictorial depth cue.

### Claim 13

A conversion apparatus with a generating of a depth map for 2D-to-3D conversion, the apparatus comprising:
an edge sensing unit to generate an edge map using a determined edge of an input image;
a line trace unit to extract an edge having an identified characteristics meeting a predetermined requirement from the edge map, map the extracted edge to an initial line map, and generate a line map including a plurality of lines generated by the mapping of the extracted edge to the initial line map; and
a depth generation unit to generate the depth map to have a sequential depth order, using the plurality of lines of the line map.

### Claim 14 (depends on 13)

The conversion apparatus of claim 13, wherein the edge sensing unit extracts an edge from the input image based on a detected luminance difference of at least one pixel of the input image to generate the edge map.

### Claim 15 (depends on 13)

The conversion apparatus of claim 13, wherein the line trace unit extracts the edge with an identified value being greater than a predetermined value in a defined direction from a defined border of the edge map to another border of the edge map, maps the extracted edge having the identified value being greater than the predetermined value in the defined direction to the initial line map, and generates the line map including a plurality of lines generated by the mapping of the extracted edge having the identified value being greater than the predetermined value in the defined direction to the initial line map.

### Claim 16 (depends on 13)

The conversion apparatus of claim 13, wherein the depth generation unit sequentially increases or decreases a depth order of a region between lines of the plurality of lines to generate the depth map.

### Claim 17 (depends on 16)

The conversion apparatus of claim 16, wherein the region is located between each of the plurality of lines of the line map, and each region has a different depth order.

### Claim 18 (depends on 13)

The conversion apparatus of claim 13, wherein the plurality of lines do not cross each other and are equal to or less than a predetermined gradient value.

### Claim 19 (depends on 13)

The conversion apparatus of claim 13, wherein the line trace unit prevents each of the plurality of lines from changing in a vertical direction, and applies a smoothness constraint to select a line for the line map nearest to the edge map.

### Claim 20 (depends on 13)

The conversion apparatus of claim 13, wherein the line trace unit applies an elasticity constraint to prevent any one line of the plurality of lines from changing in a vertical direction with an identified value being greater than a predetermined value.

### Claim 21 (depends on 13)

The conversion apparatus of claim 13, further comprising a down-scaling unit to down-scale the input image.

### Claim 22 (depends on 13)

The conversion apparatus of claim 13, further comprising:
an up-scaling unit to up-scale the depth map; and
a smoothing unit to smooth the depth map.

### Claim 23 (depends on 13)

The conversion apparatus of claim 13, further comprising:
a lateral shifting unit to lateral-shift the depth map based on a depth order of a location of each pixel of the depth map, and generate a stereo image based on the lateral-shifting.

### Claim 24 (depends on 13)

The conversion apparatus of claim 13, further comprising:
a pictorial depth cue generation unit to generate a pictorial depth cue using the depth map; and
a depth map regeneration unit to regenerate the depth map using the pictorial depth cue.

### Claim 25 (depends on 13)

The conversion apparatus of claim 13, wherein the conversion apparatus is a stereoscopic display configured to display a corresponding 3D image or video, the conversion apparatus converting a corresponding input 2D image or video based on the depth map to the corresponding 3D image or video.
