# US 2010/0302234 A1 · Method of establishing dof data of 3d image and system thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0302234 A1
- Document ID: US20100302234A1
- Status: Published application
- Kind: A1
- Application number: 12/472,852
- Filed: 2009-05-27
- Published: 2010-12-02
- Earliest claimed: 2009-05-27
- Assignees: Chunghwa Picture Tubes, Ltd.
- Inventors: MENG-CHAO KAO; CHUN-CHUEH CHIU; CHIEN-HUNG CHEN; HSIANG-TAN LIN
- Web page: https://patentgrep.com/patent/US20100302234A1

## CPC

- G06T 7/593: from stereo images
- G06T 2207/10012: Stereo images
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method and a system of establishing depth of field data of a 3D image, applicable to a 3D image including a first and a second visual image. The system includes a storage module, an offset calculator, and a comparator. An offset vector matrix includes data fields in the same number as that of pixels of a first visual image. An offset calculator divides a reference frame by taking an ath first pixel of the first visual image as a center, and finds out a target frame having a minimum grayscale difference value with the reference frame from a second visual image, so as to calculate an offset vector value according to the minimum grayscale difference value. A comparator determines that the offset vector values of all the ath first pixels are recorded in the offset vector matrix, so as to convert the offset vector matrix into a depth map.

## Claims

### Claim 1

A method of establishing depth of field (DOF) data of a three-dimensional (3D) image, applicable to a 3D image comprising a first visual image and a second visual image, the method comprising:
establishing an offset vector matrix, wherein the offset vector matrix comprises a plurality of data fields corresponding to n first pixels of the first visual image, and the n is a natural number;
obtaining an ath first pixel of the first visual image, wherein the a is an integer between 1 and n;
establishing a reference frame in the first visual image according to a pixel selection block by taking the ath first pixel as a center, wherein the reference frame comprises a plurality of first pixels;
searching for a target frame in the second visual image according to the reference frame where the ath first pixel belongs to, wherein the target frame has a minimum grayscale difference value with the reference frame;
calculating an offset vector value of the ath first pixel according to the minimum grayscale difference value;
recording the offset vector value into an ath data field of the offset vector matrix;
determining whether each offset vector value of the ath first pixels have all been recorded;
when it is determined that the offset vector values of the ath first pixels have all been recorded, converting the offset vector matrix into a depth map; and
when it is determined that the offset vector values of the ath first pixels are not all recorded, setting an (a+1)th first pixel as the ath first pixel, and returning to the step of establishing a reference frame in the first visual image according to a pixel selection block.

### Claim 2 (depends on 1)

The method of establishing DOF data of a 3D image according to claim 1, wherein the first visual image is a left-eye visual image, and the second visual image is a right-eye visual image.

### Claim 3 (depends on 1)

The method of establishing DOF data of a 3D image according to claim 1, wherein the first visual image is a right-eye visual image, and the second visual image is a left-eye visual image.

### Claim 4 (depends on 1)

The method of establishing DOF data of a 3D image according to claim 1, wherein the step of searching for a target frame in the second visual image according to the reference frame where the ath first pixel belongs to further comprises:
obtaining a plurality of pre-selected second pixels according to an ath second pixel of the second visual image and an offset pixel value;
establishing a plurality of pre-selection frames in the second visual image according to the pixel selection block by taking the pre-selected second pixels as centers, wherein each of the pre-selection frames comprises a plurality of second pixels;
matching positions of the first pixels of the reference frame individually with positions of the second pixels of each of the pre-selection frames, calculating grayscale differences of the first pixels and the second pixels that have matched positions and summing up the grayscale difference values, and obtaining a plurality of grayscale difference sums corresponding to the pre-selection frames;
obtaining a minimum grayscale difference value from the grayscale difference sums, wherein the pre-selection frame where the minimum grayscale difference value belongs to is the target frame; and
calculating the offset vector value according to the minimum grayscale difference value.

### Claim 5 (depends on 4)

The method of establishing DOF data of a 3D image according to claim 4, wherein the offset pixel value is x, the pre-selected second pixels comprises an (a−x)th second pixel to an (a+x)th second pixel, and the x is an integer between 0 and n.

### Claim 6 (depends on 5)

The method of establishing DOF data of a 3D image according to claim 5, wherein each offset vector value is an integer between −x and x.

### Claim 7 (depends on 1)

The method of establishing DOF data of a 3D image according to claim 1, wherein the pixel selection block is in a square shape, and a length of the square is 3 pixels, 5 pixels, 7 pixels, or 9 pixels.

### Claim 8 (depends on 1)

The method of establishing DOF data of a 3D image according to claim 1, wherein before the step of converting the offset vector matrix into a depth map, the method further comprises:
converting the offset vector values of the offset vector matrix into a plurality of grayscale difference values satisfying a grayscale format.

### Claim 9 (depends on 8)

The method of establishing DOF data of a 3D image according to claim 8, wherein each of the grayscale difference values is an integer between 0 and 255.

### Claim 10

A system of establishing depth of field (DOF) data of a three-dimensional (3D) image, applicable to a 3D image comprising a first visual image and a second visual image, the system comprising:
a storage module, for recording an offset vector matrix, wherein the offset vector matrix comprises a plurality of data fields corresponding to n first pixels of the first visual image, and the n is a natural number;
an offset calculator, for establishing a reference frame comprising a plurality of first pixels in the first visual image according to a pixel selection block by taking an ath first pixel as a center, searching for a target frame having a minimum grayscale difference value with the reference frame from the second visual image according to the reference frame where the ath first pixel belongs to, and calculating an offset vector value of the ath first pixel according to the minimum grayscale difference value; and
a comparator, for recording the offset vector value into an ath data field of the offset vector matrix, setting an (a+1)th first pixel as the ath first pixel to return to the offset calculator when it is determined that the data fields of the offset vector matrix are not all filled with values, and converting the offset vector matrix into a depth map when it is determined that the offset vector values of the ath first pixels have all been recorded.

### Claim 11 (depends on 10)

The system of establishing DOF data of a 3D image according to claim 10, wherein the first visual image is a left-eye visual image, and the second visual image is a right-eye visual image.

### Claim 12 (depends on 10)

The system of establishing DOF data of a 3D image according to claim 10, wherein the first visual image is a right-eye visual image, and the second visual image is a left-eye visual image.

### Claim 13 (depends on 10)

The system of establishing DOF data of a 3D image according to claim 10, wherein the comparator searches for the target frame through following steps:
obtaining a plurality of pre-selected second pixels according to an ath second pixel of the second visual image and an offset pixel value;
establishing a plurality of pre-selection frames in the second visual image according to the pixel selection block by taking the pre-selected second pixels as centers, wherein each of the pre-selection frames comprises a plurality of second pixels;
matching positions of the first pixels of the reference frame individually with positions of the second pixels of each of the pre-selection frames, calculating grayscale differences of the first pixels and the second pixels that have matched positions and summing up the grayscale difference values, and obtaining a plurality of grayscale difference sums corresponding to the pre-selection frames;
obtaining a minimum grayscale difference value from the grayscale difference sums, wherein the pre-selection frame where the minimum grayscale difference value belongs to is the target frame; and
calculating the offset vector value according to the minimum grayscale difference value.

### Claim 14 (depends on 13)

The system of establishing DOF data of a 3D image according to claim 13, wherein the offset pixel value is x, the pre-selected second pixels comprise an (a−x)th second pixel to an (a+x)th second pixel, and the x is an integer between 0 and n.

### Claim 15 (depends on 14)

The system of establishing DOF data of a 3D image according to claim 14, wherein each offset vector value is an integer between −x and x.

### Claim 16 (depends on 10)

The system of establishing DOF data of a 3D image according to claim 10, wherein a pixel length and a pixel width of the pixel selection block are 3 pixels, 5 pixels, 7 pixels, or 9 pixels.

### Claim 17 (depends on 10)

The system of establishing DOF data of a 3D image according to claim 10, wherein before the comparator converts the offset vector matrix into a depth map, the comparator further converts the offset vector values of the offset vector matrix into a plurality of grayscale difference values satisfying a grayscale value recording rule.

### Claim 18 (depends on 17)

The system of establishing DOF data of a 3D image according to claim 17, wherein each of the grayscale difference values is an integer between 0 and 255.
