# US 10,313,650 B2 · Apparatus and method for calculating cost volume in stereo matching system including illuminator > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,650 B2 - Document ID: US10313650B2 - Status: Granted - Kind: B2 - Application number: 15/469,223 - Filed: 2017-03-24 - Published: 2017-12-28 - Granted: 2019-06-04 - Earliest claimed: 2016-06-23 - Assignees: Electronics and Telecommunications Research Institute - Applicants: Electronics and Telecommunications Research Institute - Inventors: Eul Gyoon Lim; Ji Ho Chang; Jae Chan Jeong - Web page: https://patentgrep.com/patent/US10313650B2 ## CPC - H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597) - H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) - H04N 13/246: Calibration of cameras - H04N 13/257: Colour aspects - H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An apparatus and method for calculating a cost volume by controlling an intensity so as to receive relatively less influence from a condition of intensity when capturing a stereo image and changing a parameter for each level according to distance is provided. The apparatus includes an illuminator controller, a pixel expected ratio calculator, and a cost volume calculator, and controls intensity using the illuminator when capturing an object, and calculates a cost volume value so as to receive relatively less influence from distance and intensity when performing stereo matching by changing a parameter used for calculating the cost volume value according to distance to the object and intensity. ## Claims ### Claim 1 An apparatus for calculating a cost volume in a stereo matching system including an illuminator comprising: an illuminator controller configured to calculate a pixel intensity ratio of a received stereo image, compare the pixel intensity ratio and a predetermined intensity ratio, generate a general cost volume calculation command or a per-disparity level cost volume calculation command, and controls the illuminator; a pixel expected ratio calculator configured to obtain a camera parameter by performing a camera calibration, calculate a disparity value through the obtained camera parameter, and generate an expected intensity ratio of a pixel according to distance for each disparity level from the calculated disparity value; and a cost volume calculator configured to apply a predetermined parameter or different parameters for each disparity level based on the expected intensity ratio of the pixel according to distance for each disparity level according to the received cost volume calculation command for the received image, and calculate a cost volume value. ### Claim 2 (depends on 1) The apparatus for calculating a cost volume in a stereo matching system including an illuminator of claim 1, wherein the illuminator controller further comprises: a first comparison controller configured to calculate the pixel intensity ratio of the received image, compare the calculated pixel intensity ratio and the predetermined intensity ratio, control a use of the illuminator when the calculated pixel intensity ratio is smaller than the predetermined intensity ratio, and transmit the general cost volume calculation command and a captured image when the calculated pixel intensity ratio is greater than the predetermined intensity ratio; and a second comparison controller configured to receive an image obtained after using the illuminator when the illuminator is used, calculate a pixel intensity ratio of the received image, compare the calculated pixel intensity ratio and the predetermined intensity ratio, transmit the per-disparity level cost volume calculation command and the received image when the calculated pixel intensity ratio is smaller than the predetermined intensity ratio, and transmit the general cost volume calculation command and the received image when the calculated pixel intensity ratio is greater than the predetermined intensity ratio. ### Claim 3 (depends on 1) The apparatus for calculating a cost volume in a stereo matching system including an illuminator of claim 1, wherein the cost volume calculator further comprises: a general cost volume calculator configured to calculate the cost volume by applying a predetermined constant parameter for the image received together with the general cost volume calculation command; and a per-level cost volume calculator configured to calculate the cost volume by applying different parameters for each disparity level using the expected intensity ratio of the pixel according to the distance for each disparity level received for the image received together with the per-level cost volume calculation command. ### Claim 4 (depends on 1) The apparatus for calculating a cost volume in a stereo matching system including an illuminator of claim 1, wherein the pixel expected ratio calculator further comprises: a parameter acquisitor configured to obtain a camera parameter including a focal length and a coordinate of a principal point from stereo camera setting information; a disparity calculator configured to calculate the disparity value using the focal length and the coordinate of the principal point included in the obtained camera parameter; and an expected intensity ratio generator configured to generate the expected intensity ratio of the pixel according to distance for each disparity level through the disparity value. ### Claim 5 A method for calculating a cost volume in a stereo matching system including an illuminator comprising: calculating a pixel intensity ratio of a received stereo image, comparing the calculated pixel intensity ratio and a predetermined intensity ratio, generating a general cost volume calculation command or a per-disparity level cost volume calculation command, and controlling the illuminator; obtaining a camera parameter by performing a camera calibration, calculating a disparity value through the obtained camera parameter, and generating an expected intensity ratio of a pixel according to distance for each disparity level from the calculated disparity value; and applying a predetermined parameter or different parameters for each disparity level based on the expected intensity ratio of the pixel according to distance for each disparity level according to the received cost volume calculation command for the received image for the received image, and calculating a cost volume value. ### Claim 6 (depends on 5) The method for calculating a cost volume in a stereo matching system including an illuminator of claim 5, wherein the controlling of the illuminator further comprises: calculating a pixel intensity ratio of the received image, comparing the calculated pixel intensity ratio and the predetermined intensity ratio, controlling use of the illuminator when the calculated pixel intensity ratio is smaller than the predetermined intensity ratio, and transmitting the general cost volume calculation command and a captured image when the calculated pixel intensity ratio is greater than the predetermined intensity ratio; and receiving an image obtained after using the illuminator when the illuminator is used, calculating a pixel intensity ratio of the received image, comparing the calculated pixel intensity ratio and the predetermined intensity ratio, transmitting the per-disparity level cost volume calculation command and the received image when the calculated pixel intensity ratio is smaller than the predetermined intensity ratio, and transmitting the general cost volume calculation command and the received image when the calculated pixel intensity ratio is greater than the predetermined intensity ratio. ### Claim 7 (depends on 5) The method for calculating a cost volume in a stereo matching system including an illuminator of claim 5, wherein the calculating of the cost volume value further comprises: calculating the cost volume by applying a predetermined constant parameter for the image received together with the general cost volume calculation command; and calculating the cost volume by applying different parameters for each disparity level using the expected intensity ratio of the pixel according to the distance for each disparity level for the image received together with the per-level cost volume calculation command. ### Claim 8 (depends on 5) The method for calculating a cost volume in a stereo matching system including an illuminator of claim 5, wherein the generating of the pixel expected ratio further comprises: obtaining a camera parameter including a focal length and a coordinate of a principal point from stereo camera setting information; calculating a disparity value using the focal length and the coordinate of the principal point included in the obtained camera parameter; and generating the expected intensity ratio of the pixel according to distance for each disparity level through the disparity value.