# US 2010/0166338 A1 · Image processing method and apparatus therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0166338 A1
- Document ID: US20100166338A1
- Status: Published application
- Kind: A1
- Application number: 12/563,310
- Filed: 2009-09-21
- Published: 2010-07-01
- Earliest claimed: 2008-12-26
- Assignees: Samsung Electronics Co., Ltd.
- Inventors: Dae-jong Lee; Sung-wook Park; Hyun-kwon Chung; Kil-soo Jung; Hye-young Jun
- Web page: https://patentgrep.com/patent/US20100166338A1

## CPC

- H04N 13/178: Metadata, e.g. disparity information
- H04N 13/128: Adjusting depth or disparity
- H04N 13/261: with monoscopic-to-stereoscopic image conversion
- H04N 2213/003: Aspects relating to the "2D+depth" image format
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing method, including extracting compensation information comprising one from among a depth compensation value and a depth value compensated for by using the depth compensation value; when the compensation information comprises the depth compensation value, compensating for a depth value to be applied to a pixel of a two-dimensional (2D) image by using the depth compensation value, and generating a depth map about the 2D image by using the compensated depth value, and when the compensation information comprises the compensated depth value, generating the depth map about the 2D image by using the compensated depth value; obtaining positions in a left-eye image and a right-eye image by using the depth map, wherein the pixel of the 2D image is mapped to the positions; and generating the left-eye image and the right-eye image comprising the positions to which the pixel is mapped.

## Claims

### Claim 1

An image processing method comprising:
extracting compensation information comprising a depth compensation value or a depth value compensated for based on the depth compensation value;
when the compensation information comprises the depth compensation value, compensating for a depth value to be applied to a pixel of a 2D (two-dimensional) image based on the depth compensation value, and generating a depth map about the 2D image based on the compensated depth value, and
when the compensation information comprises the compensated depth value, generating the depth map about the 2D image based on the compensated depth value;
obtaining positions in a left-eye image and a right-eye image based on the depth map, wherein the pixel of the 2D image is mapped to the positions; and
generating the left-eye image and the right-eye image in which the pixels are mapped to the obtained positions.

### Claim 2 (depends on 1)

The image processing method of claim 1, wherein the compensation information comprises image identification information identifying the 2D image.

### Claim 3 (depends on 1)

The image processing method of claim 1, wherein the compensation information comprises compensation value identification information indicating whether the compensation information includes the depth compensation value or the depth value compensated for based on the depth compensation value.

### Claim 4 (depends on 2)

The image processing method of claim 2, wherein the compensation information comprises title identification information identifying a title comprising the 2D image, disc identification information identifying a disc having the title recorded thereon, and/or user identification information for determining which of a plurality of users is related to the compensation information when compensation information is stored with respect to the plurality of users.

### Claim 5 (depends on 2)

The image processing method of claim 2, wherein the compensation information comprises depth compensation values or depth values compensated for based on the depth compensation values which are respectively for a plurality of objects and backgrounds included in the 2D image.

### Claim 6 (depends on 4)

The image processing method of claim 4, wherein the compensating for the depth value to be applied to the pixel of a 2D image based on the depth compensation value comprises increasing or decreasing depth values of pixels of the 2D image according to the same percentage value.

### Claim 7 (depends on 4)

The image processing method of claim 4, wherein:
the depth value to be applied to the pixel of the 2D image is in a range between an N and M value, where N<M and N and M are integers, and
the compensating for the depth value to be applied to the pixel of the 2D image based on the depth compensation value comprises increasing the value of N and/or decreasing the value of M, thereby allowing the pixels of the 2D image to respectively have a depth value from among depth values in the adjusted range.

### Claim 8

An image processing method comprising:
extracting compensation information comprising a position compensation value or a position value compensated for based on the position compensation value; and
when the compensation information comprises the position compensation value, compensating for positions in a left-eye image and a right-eye image based on the position compensation value, wherein the positions are obtained based on a depth map about a 2D image and wherein a pixel of the 2D image is mapped to the positions, and generating the left-eye image and the right-eye image comprising the compensated positions to which the pixel is mapped, and
when the compensation information comprises the compensated position value, mapping the pixel to positions in the left-eye image and the right-eye image so as to generate the left-eye image and the right-eye image, wherein the positions are obtained based on the compensated position value and wherein the pixel of the 2D image is mapped to the positions.

### Claim 9 (depends on 8)

The image processing method of claim 8, wherein the compensation information comprises image identification information identifying the 2D image.

### Claim 10 (depends on 8)

The image processing method of claim 8, wherein the compensation information comprises identification information indicating whether the compensation information comprises the position compensation value or a position value compensated for based on the position compensation value.

### Claim 11 (depends on 10)

The image processing method of claim 10, wherein the compensation information comprises title identification information identifying a title comprising the 2D image, disc identification information identifying a disc having the title recorded thereon, and/or user identification information for determining which of a plurality of users is related to the compensation information when compensation information is stored with respect to the plurality of users.

### Claim 12 (depends on 10)

The image processing method of claim 10, wherein the compensation information comprises position compensation values or position values compensated for based on the position compensation values which are respectively for a plurality of objects and backgrounds included in the 2D image.

### Claim 13 (depends on 12)

The image processing method of claim 12, wherein the compensating for the positions based on the position compensation value comprises increasing or decreasing position values of pixels of the 2D image according to the same percentage value, wherein the pixels are respectively mapped to the position values.

### Claim 14 (depends on 12)

The image processing method of claim 12, wherein:
the position value to be mapped to the pixel of the 2D image is in a range between N and M value, where N<M and N and M are integers, and
the compensating for the positions based on the position compensation value comprises increasing the value of N and/or decreasing the value of M, thereby allowing the position values to respectively have a value from among position values in the adjusted range, wherein the pixels of the 2D image are respectively mapped to the position values.

### Claim 15

An image processing method comprising:
compensating for a depth value to be applied to a pixel of a 2D image based on a depth compensation value received from a user;
generating a depth map about the 2D image based on the compensated depth value, and obtaining positions in a left-eye image and a right-eye image based on the depth map, wherein the pixel of the 2D image is mapped to the positions;
generating the left-eye image and the right-eye image comprising the positions to which the pixel is mapped; and
generating compensation information comprising the depth compensation value and/or the compensated depth value, and storing the compensation information.

### Claim 16 (depends on 15)

The image processing method of claim 15, wherein the compensation information comprises image identification information identifying the 2D image, title identification information identifying a title comprising the 2D image, disc identification information identifying a disc having the title recorded thereon, and user identification information for determining which of a plurality of users is related to the compensation information when compensation information is stored with respect to the plurality of users.

### Claim 17

An image processing method, comprising:
obtaining positions in a left-eye image and a right-eye image based on a depth value to be applied to a pixel of a 2D image, wherein the pixel is mapped to the positions;
adjusting the positions according to a position compensation value received from a user;
generating the left-eye image and the right-eye image comprising the adjusted positions to which the pixel is mapped; and
generating compensation information comprising the position compensation value and/or the adjusted positions, and storing the compensation information.

### Claim 18 (depends on 17)

The image processing method of claim 17, wherein the compensation information comprises image identification information identifying the 2D image, title identification information identifying a title comprising the 2D image, disc identification information identifying a disc having the title recorded thereon, and/or user identification information for determining which of a plurality of users is related to the compensation information when compensation information is stored with respect to the plurality of users.

### Claim 19

An image processing apparatus, comprising:
a compensation information processing unit to extract compensation information comprising a depth compensation value or a depth value compensated for based on the depth compensation value;
a depth map generating unit to compensate for a depth value to be applied to a pixel of a 2D image based on the depth compensation value when the compensation information comprises the depth compensation value, and to generate a depth map about the 2D image based on the compensated depth value, and to generate the depth map about the 2D image based on the compensated depth value when the compensation information comprises the compensated depth value; and
a three-dimensional (3D) image generating unit to obtain positions in a left-eye image and a right-eye image based on the depth map, wherein the pixel of the 2D image is mapped to the positions, and to generate the left-eye image and the right-eye image comprising the positions to which the pixel is mapped.

### Claim 20 (depends on 19)

The image processing apparatus of claim 19, wherein the compensation information comprises image identification information identifying the 2D image.

### Claim 21 (depends on 19)

The image processing apparatus of claim 19, wherein the compensation information comprises identification information indicating whether the compensation information comprises the depth compensation value or the depth value compensated for based on the depth compensation value.

### Claim 22 (depends on 20)

The image processing apparatus of claim 20, wherein the compensation information comprises title identification information identifying a title comprising the 2D image, disc identification information identifying a disc having the title recorded thereon, and user identification information for determining which of a plurality of users is related to the compensation information when compensation information is stored with respect to the plurality of users.

### Claim 23 (depends on 20)

The image processing apparatus of claim 20, wherein the compensation information comprises depth compensation values or depth values compensated for based on the depth compensation values which are respectively for a plurality of objects and backgrounds comprised in the 2D image.

### Claim 24 (depends on 22)

The image processing apparatus of claim 22, wherein the compensation information processing unit compensates for the depth value by increasing or decreasing depth values of pixels of the 2D image according to a same percentage value by using the depth compensation value.

### Claim 25 (depends on 22)

The image processing apparatus of claim 22, wherein:
the depth value to be applied to the pixel of the 2D image is in a range between N and M value, where N<M and N and M are integers, and
wherein the compensation information processing unit increases the value of N and/or decreases the value of M, thereby allowing the pixels of the 2D image to respectively have a depth value from among depth values in the adjusted range.

### Claim 26

An image processing apparatus, comprising:
a compensation information processing unit to extract compensation information comprising one from among a position compensation value and a position value compensated for based on the position compensation value; and
a 3D image generating unit to compensate for positions in a left-eye image and a right-eye image based on the position compensation value when the compensation information comprises the position compensation value, wherein the positions are obtained based on a depth map about a 2D image and wherein a pixel of the 2D image is mapped to the positions, and to generate the left-eye image and the right-eye image comprising the compensated positions to which the pixel is mapped, and to generate the left-eye image and the right-eye image by mapping the pixel to positions in the left-eye image and the right-eye image when the compensation information comprises the compensated position value, wherein the positions are obtained based on the compensated position value and wherein the pixel of the 2D image is mapped to the positions.

### Claim 27 (depends on 26)

The image processing apparatus of claim 26, wherein the compensation information comprises image identification information identifying the 2D image.

### Claim 28 (depends on 26)

The image processing apparatus of claim 26, wherein the compensation information comprises identification information indicating whether the compensation information comprises the position compensation value or a position value compensated for based on the position compensation value.

### Claim 29 (depends on 28)

The image processing apparatus of claim 28, wherein the compensation information comprises title identification information identifying a title comprising the 2D image, disc identification information identifying a disc having the title recorded thereon, and/or user identification information for determining which of a plurality of users is related to the compensation information when compensation information is stored with respect to the plurality of users.

### Claim 30 (depends on 28)

The image processing apparatus of claim 28, wherein the compensation information comprises position compensation values or position values compensated for based on the position compensation values for each of a plurality of objects and backgrounds comprised in the 2D image.

### Claim 31 (depends on 30)

The image processing apparatus of claim 30, wherein the compensation information processing unit increases or decreases position values of pixels of the 2D image according to a same percentage value based on the position compensation value, wherein the pixels are respectively mapped to the position values, and thus adjusts positions in a left-eye image and a right-eye image, wherein the pixel of the 2D image is mapped to the positions.

### Claim 32 (depends on 30)

The image processing apparatus of claim 30, wherein:
the position value to be mapped to the pixel of the 2D image is in a range between N and M value, where N<M and N and M are integers, and
the compensation information processing unit increases the value of N and/or decreases the value of M, and thus allows the position values to respectively have a value from among position values in the adjusted range, wherein the pixels of the 2D image are respectively mapped to the position values.

### Claim 33

An image processing apparatus, comprising:
a user interface to receive a depth compensation value from a user;
a depth map generating unit to compensate for a depth value to be applied to a pixel of a 2D image based on the depth compensation value, and to generate a depth map about the 2D image based on the compensated depth value;
a 3D image generating unit to obtain positions in a left-eye image and a right-eye image based on the depth map, and to map the pixel of the 2D image to the positions, and to generate the left-eye image and the right-eye image comprising the positions to which the pixel is mapped; and
a compensation information processing unit to generate compensation information comprising the depth compensation value and/or the compensated depth value, and to store the compensation information in a local storage unit.

### Claim 34 (depends on 33)

The image processing apparatus of claim 33, wherein the compensation information comprises image identification information identifying the 2D image, title identification information identifying a title comprising the 2D image, disc identification information identifying a disc having the title recorded thereon, and/or user identification information for determining which of a plurality of users is related to the compensation information when compensation information is stored with respect to the plurality of users.

### Claim 35

An image processing apparatus, comprising:
a user interface to receive a position compensation value from a user;
a 3D image generating unit to obtain positions in a left-eye image and a right-eye image based on a depth value to be applied to a pixel of a 2D image, to map the pixel to the positions, to adjust the positions according to the position compensation value, and to generate the left-eye image and the right-eye image comprising the adjusted positions to which the pixel is mapped; and
a compensation information processing unit to generate compensation information comprising the position compensation value and/or the adjusted positions, and to store the compensation information.

### Claim 36 (depends on 35)

The image processing apparatus of claim 35, wherein the compensation information comprises image identification information identifying the 2D image, title identification information identifying a title comprising the 2D image, disc identification information identifying a disc having the title recorded thereon, and/or user identification information for determining which of a plurality of users is related to the compensation information when compensation information is stored with respect to the plurality of users.

### Claim 37

An image processing method, comprising:
obtaining compensation information;
generating a depth map for a two-dimensional frame of video data based on the compensation information; and
generating a left-eye image and a right-eye image based on the depth map

### Claim 38 (depends on 37)

The image processing method of claim 37, wherein:
the compensation information comprises a depth compensation value;
the image processing method further comprises compensating for depth values to be applied to pixels of the two-dimensional frame based on the depth compensation value; and
the generating of the depth map comprises generating the depth map based on the compensated depth values.

### Claim 39 (depends on 37)

The image processing method of claim 37, wherein:
the compensation information comprises a compensated depth value; and
the generating of the depth map comprises generating the depth map based on the compensated depth value.

### Claim 40 (depends on 37)

The image processing method of claim 37, wherein:
the compensation information comprises a position compensation value; and
the generating of the left-eye image and the right-eye image comprises:
obtaining positions of pixels in the left-eye image and the right-eye image based on the depth map,
compensating for the positions of pixels in the left-eye image and the right-eye image based on the position compensation value, and
generating a compensated left-eye image and a compensated right-eye image based on the compensated positions of the pixels in the left-eye image and the right-eye image.

### Claim 41 (depends on 37)

The image processing method of claim 37, wherein:
the compensation information comprises a position value for each pixel in the frame compensated for based on a position compensation value; and
the generating of the left-eye image and the right-eye image comprises:
obtaining positions of pixels in the left-eye image and the right-eye image based on the position value for each pixel;
mapping each pixel in the frame to a corresponding position in the left-eye image and the right-eye image based on the obtained positions;
generating the left-eye image and the right-eye image based on the mapping.