# US 2013/0155192 A1 · Stereoscopic image shooting and display quality evaluation system and method applicable thereto

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0155192 A1
- Document ID: US20130155192A1
- Status: Published application
- Kind: A1
- Application number: 13/571,958
- Filed: 2012-08-10
- Published: 2013-06-20
- Earliest claimed: 2011-12-15
- Assignees: Industrial Technology Research Institute
- Inventors: Fu-Jen Hsiao; Wei-Jia Huang; Chung-Wei Lin
- Web page: https://patentgrep.com/patent/US20130155192A1

## CPC

- H04N 13/207: using a single two-dimensional [2D] image sensor
- H04N 13/211: using temporal multiplexing
- H04N 13/221: using the relative movement between cameras and objects
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A stereoscopic image shooting system including an image shooting module and a score evaluation module is provided. The image shooting module is used for shooting a plurality of multi-view images of an object. The score evaluation module analyzes a plurality of stereoscopic images formed from the multi-view images to calculate a stereoscopic quality score of the stereoscopic images.

## Claims

### Claim 1

A stereoscopic image shooting system, comprising:
an image shooting module used for shooting a plurality of multi-view images of an object; and
a score evaluation module used for analyzing a plurality of stereoscopic images formed from the plurality of multi-view images to calculate a stereoscopic quality score of the plurality of stereoscopic images.

### Claim 2 (depends on 1)

The stereoscopic image shooting system according to claim 1, comprising:
a feedback module used for controlling the image shooting module to adjust shooting parameters of the image shooting module according to the stereoscopic quality score.

### Claim 3 (depends on 1)

The stereoscopic image shooting system according to claim 1, wherein the image shooting module comprises:
at least one image capture unit used for capturing the plurality of multi-view images of the object; and
at least one motion mechanism used for changing a relative distance relationship and/or a relative angle relationship between the object and the at least one image capture unit.

### Claim 4 (depends on 1)

The stereoscopic image shooting system according to claim 1, wherein the score evaluation module analyzes an optimum horizontal disparity score of the plurality of stereoscopic images of the object.

### Claim 5 (depends on 1)

The stereoscopic image shooting system according to claim 1, wherein the score evaluation module analyzes a vertical disparity score of the plurality of stereoscopic images of the object.

### Claim 6 (depends on 1)

The stereoscopic image shooting system according to claim 1, wherein the score evaluation module analyzes a stereoscopic window violation score of the plurality of stereoscopic images of the object.

### Claim 7 (depends on 1)

The stereoscopic image shooting system according to claim 1, wherein:
the score evaluation module analyzes at least any one of an optimum horizontal disparity score, a vertical disparity score and a stereoscopic window violation score of the plurality of stereoscopic images of the object or any combination thereof, and
the score evaluation module summarizes the optimum horizontal disparity score and/or the vertical disparity score and/or the stereoscopic window violation score as a final score.

### Claim 8 (depends on 5)

The stereoscopic image shooting system according to claim 5, wherein when the score evaluation module analyzes the vertical disparity score,
the score evaluation module locates and filters a plurality of feature point matches of a stereoscopic image pair, wherein the stereoscopic image pair is a combination of the plurality of multi-view images;
the score evaluation module calculates respective vertical disparity of each feature point match of the stereoscopic image pair;
the score evaluation module calculates a ratio of high vertical disparity feature point matches of the stereoscopic image pair to total feature point matches of the stereoscopic image pair, wherein a high vertical disparity feature point match is defined as the feature point match having a vertical disparity larger than a vertical disparity threshold; and
the score evaluation module sums respective vertical disparity quantitative indicator of each stereoscopic image pair, and outputs the vertical disparity score according to the sum.

### Claim 9 (depends on 6)

The stereoscopic image shooting system according to claim 6, wherein when the score evaluation module analyzes the stereoscopic window violation score,
the score evaluation module evaluates the stereoscopic window violation score based on a plurality of negative disparity pixels of a stereoscopic image pair within a range distant from an image border and absolute values of negative disparities of the plurality of negative disparity pixels, wherein the stereoscopic image pair is selected from the plurality of multi-view images;
the score evaluation module calculates respective stereoscopic window violation score of each negative disparity pixel, wherein the stereoscopic window violation score is associated with the absolute values of the negative disparities of the plurality of negative disparity pixels and a weight function related to a distance from one of the plurality of negative disparity pixels to the image border.

### Claim 10 (depends on 7)

The stereoscopic image shooting system according to claim 7, wherein when the score evaluation module analyzes the optimum horizontal disparity score,
the score evaluation module pairs up the plurality of multi-view images into a plurality of stereoscopic image pairs;
the score evaluation module obtains respective critical horizontal disparity of the stereoscopic image pairs;
the score evaluation module compares the respective critical horizontal disparity of the stereoscopic image pairs to calculate an optimum horizontal disparity interval; and
the score evaluation module compares the optimum horizontal disparity interval with a tolerable disparity interval of a stereoscopic screen to obtain the optimum horizontal disparity score.

### Claim 11 (depends on 10)

The stereoscopic image shooting system according to claim 10, wherein when the score evaluation module obtains the respective critical horizontal disparity of the stereoscopic image pairs,
the score evaluation module analyzes and filters image features of the stereoscopic image pair;
the score evaluation module obtains a statistic information of disparities of the stereoscopic image pair according to the image features of the stereoscopic image pair; and
the score evaluation module determines the corresponding critical horizontal disparity of the stereoscopic image pair according to the statistic information of disparities, wherein the critical horizontal disparity comprises a critical positive disparity and a critical negative disparity.

### Claim 12 (depends on 11)

The stereoscopic image shooting system according to claim 11, wherein when the score evaluation module compares the respective critical horizontal disparity of the stereoscopic image pairs to calculate the optimum horizontal disparity interval,
the score evaluation module selects a maximum from the critical positive disparities of the critical horizontal disparity of the stereoscopic image pairs and selects a minimum from the critical negative disparities of the critical horizontal disparity of the stereoscopic image pairs to form the optimum horizontal disparity interval.

### Claim 13 (depends on 11)

The stereoscopic image shooting system according to claim 11, wherein
the score evaluation module analyzes the image features of the stereoscopic image pair according to a dense feature matching or a feature-based matching; and
the score evaluation module filters the image features of the stereoscopic image pair according to a disparity absolute distance parameter, a vertical disparity parameter and an epipolar geometry parameter.

### Claim 14

A stereoscopic quality evaluation system for evaluating a plurality of stereoscopic sensing factors of a 3D display, the stereoscopic quality evaluation system comprising:
an image shooting module used for capturing a plurality of multi-view images from a 3D display device; and
a score evaluation module used for analyzing stereoscopic images of the plurality of multi-view images to output a score of the 3D display device.

### Claim 15 (depends on 14)

The stereoscopic quality evaluation system according to claim 14, wherein the score evaluation module analyzes a optimum horizontal disparity score, or a vertical disparity score, or a stereoscopic window violation score, or a cross-talking score, or an overall score of the plurality of multi-view images, or any combination thereof.

### Claim 16 (depends on 15)

The stereoscopic quality evaluation system according to claim 15, wherein when the score evaluation module analyzes the vertical disparity score,
the score evaluation module locates and filters a plurality of corresponding feature point matches of a stereoscopic image pair, wherein the stereoscopic image pair is selected from the plurality of multi-view images;
the score evaluation module calculates respective vertical disparity of each feature point match of the stereoscopic image pair;
the score evaluation module calculates a ratio of high vertical disparity feature point matches of the stereoscopic image pair to total feature point matches of the stereoscopic image pair, wherein a high vertical disparity feature point match is defined as the feature point match having a vertical disparity larger than a vertical disparity threshold; and
the score evaluation module sums respective vertical disparity quantitative indicator of each stereoscopic image pair and outputs the vertical disparity score according to the sum.

### Claim 17 (depends on 15)

The stereoscopic quality evaluation system according to claim 15, wherein when the score evaluation module analyzes the stereoscopic window violation score,
the score evaluation module evaluates the stereoscopic window violation score based on to a plurality of negative disparity pixels of a stereoscopic image pair within a range distant from an image border and absolute values of negative disparities of the plurality of negative disparity pixels, wherein the stereoscopic image pair is selected from the plurality of multi-view images;
the score evaluation module calculates respective stereoscopic window violation score of each negative disparity pixel, wherein the stereoscopic window violation score is associated with the absolute values of the negative disparities of the plurality of negative disparity pixels and a weight function related to a distance from one of the plurality of negative disparity pixels to the image border.

### Claim 18 (depends on 15)

The stereoscopic quality evaluation system according to claim 15, wherein when the score evaluation module calculates the cross-talking score,
the score evaluation module calculates a corresponding region of a stereoscopic image pair, wherein the stereoscopic image pair is selected from the plurality of multi-view images;
the score evaluation module calculates color difference of the corresponding region of the stereoscopic image pair to estimate a cross-talking quantitative indicator; and
the score evaluation module calculates a sum of all cross-talking quantitative indicators of the stereoscopic image pairs to output the cross-talking score.

### Claim 19 (depends on 15)

The stereoscopic quality evaluation system according to claim 15, wherein when the score evaluation module analyzes the optimum horizontal disparity score,
the score evaluation module pairs up the plurality of multi-view images into a plurality of stereoscopic image pairs;
the score evaluation module obtains respective critical horizontal disparity of the stereoscopic image pairs;
the score evaluation module compares the respective critical horizontal disparity of the stereoscopic image pairs to calculate an optimum horizontal disparity interval; and
the score evaluation module compares the optimum horizontal disparity interval with a tolerable disparity interval of a stereoscopic screen to obtain the optimum horizontal disparity score.

### Claim 20 (depends on 19)

The stereoscopic quality evaluation system according to claim 19, wherein when the score evaluation module obtains the respective critical horizontal disparity of the stereoscopic image pairs,
the score evaluation module analyzes and filters image features of the stereoscopic image pair;
the score evaluation module obtains a statistic information of disparities of the stereoscopic image pair according to the image features of the stereoscopic image pair; and
the score evaluation module determines the corresponding critical horizontal disparity of the stereoscopic image pair according to the statistic information of disparities, wherein the critical horizontal disparity comprises a critical positive disparity and a critical negative disparity.

### Claim 21 (depends on 19)

The stereoscopic quality evaluation system according to claim 19, wherein when the score evaluation module compares the respective critical horizontal disparity of the stereoscopic image pairs to calculate an optimum horizontal disparity interval,
the score evaluation module selects a maximum from the critical positive disparities of the critical horizontal disparity of the stereoscopic image pair and selects a minimum from the critical negative disparities of the critical horizontal disparity of the stereoscopic image pairs to form the optimum horizontal disparity interval.

### Claim 22

A stereoscopic image shooting method, comprising:
capturing a plurality of multi-view images of an object; and
performing a score evaluation step to analyze a plurality of stereoscopic images selected from the plurality of multi-view images for calculating a stereoscopic quality score of the plurality of stereoscopic images.

### Claim 23 (depends on 22)

The method according to claim 22, further comprising:
controlling the image capturing step to adjust shooting parameters according to the stereoscopic quality score.

### Claim 24 (depends on 22)

The method according to claim 22, wherein the image capturing step further comprises:
changing a capturing distance relationship and/or a shooting angle relationship to the object.

### Claim 25 (depends on 22)

The method according to claim 22, wherein the score evaluation step analyzes an optimum horizontal disparity score and/or a vertical disparity score and/or a stereoscopic window violation score and/or an overall score of the plurality of stereoscopic images of the object.

### Claim 26 (depends on 25)

The method according to claim 25, wherein when the score evaluation step analyzes the vertical disparity score,
the score evaluation step locates and filters a plurality of feature point matches of a stereoscopic image pair, wherein the stereoscopic image pair is selected from the plurality of multi-view images;
the score evaluation step calculates respective vertical disparity of each feature point match of the stereoscopic image pair;
the score evaluation step calculates a ratio of high vertical disparity feature point matches of the stereoscopic image pair to total feature point matches of the stereoscopic image pair, wherein a high vertical disparity feature point match is defined as the feature point match having a vertical disparity larger than a vertical disparity threshold; and
the score evaluation step sums respective vertical disparity quantitative indicator of each stereoscopic image pair and outputs the vertical disparity score according to the sum.

### Claim 27 (depends on 25)

The method according to claim 25, wherein when the score evaluation step analyzes the stereoscopic window violation score,
the score evaluation step calculates the stereoscopic window violation score according to a plurality of negative disparity pixels of a stereoscopic image pair within a range distant from an image border and absolute values of negative disparities of the plurality of negative disparity pixels, wherein the stereoscopic image pair is selected from the plurality of multi-view images;
the score evaluation step calculates respective stereoscopic window violation score of each negative disparity pixel, wherein the stereoscopic window violation score is associated with the absolute values of the negative disparities of the plurality of negative disparity pixels and a weight function related to a distance from one of the plurality of negative disparity pixels to the image border.

### Claim 28 (depends on 25)

The method according to claim 25, wherein when the score evaluation step analyzes the optimum horizontal disparity score,
the score evaluation step pairs up the plurality of multi-view images into a plurality of stereoscopic image pairs;
the score evaluation step obtains respective critical horizontal disparity of the stereoscopic image pairs;
the score evaluation step compares the respective critical horizontal disparity of the stereoscopic image pairs to calculate an optimum horizontal disparity interval; and
the score evaluation step compares the optimum horizontal disparity interval with a tolerable disparity interval of a stereoscopic screen to obtain the optimum horizontal disparity score.

### Claim 29 (depends on 28)

The method according to claim 28, wherein the score evaluation module obtains the respective critical horizontal disparity of the stereoscopic image pairs,
the score evaluation step analyzes and filters image features of the stereoscopic image pair;
the score evaluation step obtains a statistic information of disparities of the stereoscopic image pair according to the image features of the stereoscopic image pair; and
the score evaluation step determines the corresponding critical horizontal disparity of the stereoscopic image pair according to the statistic information of disparities, wherein the critical horizontal disparity comprises a critical positive disparity and a critical negative disparity.

### Claim 30 (depends on 28)

The method according to claim 28, wherein when the score evaluation step compares the respective critical horizontal disparity of the stereoscopic image pairs to calculate an optimum horizontal disparity interval,
the score evaluation step selects a maximum from the critical positive disparities of the critical horizontal disparity of the stereoscopic image pairs and selects a minimum from the critical negative disparities of the critical horizontal disparity of the stereoscopic image pairs to form the optimum horizontal disparity interval.

### Claim 31 (depends on 29)

The method according to claim 29, wherein
the score evaluation step analyzes the image features of the stereoscopic image pair according to a dense feature matching or a feature-based matching; and
the score evaluation step filters the image features of the stereoscopic image pair according to a disparity absolute distance parameter, a vertical disparity parameter and an epipolar geometry parameter.

### Claim 32

A stereoscopic quality evaluation method for evaluating a plurality of stereoscopic sensing factors of a 3D display, the stereoscopic quality evaluation method comprising:
capturing a plurality of multi-view images from a 3D display device; and
performing a score evaluation step to analyze stereoscopic images of the plurality of multi-view images and output a score of the 3D display device.

### Claim 33 (depends on 32)

The method according to claim 32, wherein the score evaluation step calculates an optimum horizontal disparity score and/or a vertical disparity score and/or a stereoscopic window violation score and/or a cross-talking score and/or an overall score of the plurality of multi-view images.

### Claim 34 (depends on 33)

The method according to claim 33, wherein when the score evaluation step analyzes the vertical disparity score,
the score evaluation step locates and filters a plurality of corresponding feature point matches of a stereoscopic image pair, wherein the stereoscopic image pair is selected from the plurality of multi-view images;
the score evaluation step calculates respective vertical disparity of each corresponding feature point match of the stereoscopic image pair;
the score evaluation step calculates a ratio of high vertical disparity feature point matches of the stereoscopic image pair to total feature point matches of the stereoscopic image pair, wherein a high vertical disparity feature point match is defined as the feature point match having a vertical disparity larger than a vertical disparity threshold; and
the score evaluation step sums respective vertical disparity quantitative indicator of each stereoscopic image pair and outputs the vertical disparity score according to the sum.

### Claim 35 (depends on 33)

The method according to claim 33, wherein when the score evaluation step analyzes the stereoscopic window violation score,
the score evaluation step evaluates based on a plurality of negative disparity pixels of a stereoscopic image pair within a range distant from an image border and absolute values of negative disparities of the plurality of negative disparity pixels, wherein the stereoscopic image pair is selected from the plurality of multi-view images;
the score evaluation step calculates respective stereoscopic window violation score of each negative disparity pixel, wherein the stereoscopic window violation score is associated with the absolute values of the negative disparities of the plurality of negative disparity pixels and a weight function related to a distance from one of the plurality of negative disparity pixels to the image border.

### Claim 36 (depends on 33)

The method according to claim 33, wherein when the score evaluation step calculates the cross-talking score,
the score evaluation step calculates a corresponding region of a stereoscopic image pair, wherein the stereoscopic image pair is selected from the plurality of multi-view images;
the score evaluation step calculates color difference of the corresponding region of the stereoscopic image pairs to calculate a cross-talking quantitative indicator of two of the plurality of multi-view images; and
the score evaluation step calculates a sum of all cross-talking quantitative indicators of the stereoscopic image pairs to output the cross-talking score.

### Claim 37 (depends on 33)

The method according to claim 33, wherein when the score evaluation step analyzes the optimum horizontal disparity score,
the score evaluation step pairs up the plurality of multi-view images into a plurality of stereoscopic image pairs;
the score evaluation step obtains respective critical horizontal disparity of the stereoscopic image pair;
the score evaluation step compares the respective critical horizontal disparity of the stereoscopic image pairs to calculate an optimum horizontal disparity interval; and
the score evaluation step compares the optimum horizontal disparity interval with a tolerable disparity interval of a stereoscopic screen to obtain the optimum horizontal disparity score.

### Claim 38 (depends on 37)

The method according to claim 37, wherein when the score evaluation step obtains the respective critical horizontal disparity of the stereoscopic image pairs,
the score evaluation step analyzes and filters image features of the stereoscopic image pair;
the score evaluation step obtains a statistic information of disparities of the stereoscopic image pair according to the image features of the stereoscopic image pair; and
the score evaluation step determines the corresponding critical horizontal disparity of the stereoscopic image pair according to the statistic information of disparities, wherein the critical horizontal disparity comprises a critical positive disparity and a critical negative disparity.

### Claim 39 (depends on 37)

The method according to claim 37, wherein when the score evaluation step compares respective critical horizontal disparity of the stereoscopic image pairs to calculate the optimum horizontal disparity interval, the score evaluation step selects a maximum from the critical positive disparities of the critical horizontal disparity of the stereoscopic image pairs and selects a minimum from the critical negative disparities of a critical horizontal disparity threshold of the stereoscopic image pairs to form the optimum horizontal disparity interval.
