# US 2016/0366391 A1 · Method for encoding and reconstructing depth image using color image information > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2016/0366391 A1 - Document ID: US20160366391A1 - Status: Published application - Kind: A1 - Application number: 14/926,256 - Filed: 2015-10-29 - Published: 2016-12-15 - Earliest claimed: 2015-06-15 - Assignees: Electronics and Telecommunications Research Institute - Applicants: Electronics and Telecommunications Research Institute - Inventors: Han Shin LIM - Web page: https://patentgrep.com/patent/US20160366391A1 ## CPC - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - G01B 11/22: for measuring depth - H04N 13/15: for colour aspects of image signals - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 2013/0077: {Colour aspects} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS ## Abstract A method of encoding and reconstructing a depth image using color image information includes segmenting a color image and a depth image corresponding to the color image into block units, selecting a position of a pixel sampling value from each block of the depth image using the color image information, and encoding the pixel sampling value of the selected position as depth information. ## Claims ### Claim 1 A method for encoding a depth image using color image information, the method comprising: segmenting a color image and a depth image corresponding to the color image into block units; selecting a position of a pixel sampling value from each block of the depth image using the color image information; and encoding the pixel sampling value of the selected position as depth information. ### Claim 2 (depends on 1) The method of claim 1, wherein the segmenting of the color image and the depth image corresponding to the color image into block units comprises segmenting the color image and the depth image into block units having a height of n pixels and a width of n pixels, where n is a multiple of 2. ### Claim 3 (depends on 1) The method of claim 1, wherein the selecting of the position of the pixel sampling value from each block of the depth image using the color image information comprises converting colors of blocks of the color image corresponding to the blocks of the depth image to frequencies, and selecting a position of a pixel having a pixel value for which absolute values of differences and DC coefficients of the blocks of the frequency-converted color image are the minimum for a position of a pixel sampling value of each block. ### Claim 4 (depends on 1) The method of claim 1, wherein the encoding of the pixel sampling value of the selected position as depth information comprises downsampling the depth image into units having a height of n pixels and a width of n pixels and encoding the pixel sampling value of the downsampled depth image as the depth information. ### Claim 5 (depends on 1) A method for reconstructing a depth image using color image information, the method comprising: in a method for reconstructing the depth image using depth information encoded through the method of claim 1, decoding the encoded depth image and reconstructing a pixel sampling value for each block as the depth information; selecting a position of the reconstructed pixel sampling value from each block of the depth image using the color image information; and reconstructing the depth image using the position of the reconstructed pixel sampling value for each block. ### Claim 6 (depends on 5) The method of claim 5, wherein the selecting of the position of the reconstructed pixel sampling value from each block of the depth image using the color image information comprises converting colors of blocks of the color image corresponding to the blocks of the depth image to frequencies, and selecting a position of a pixel having a pixel value for which absolute values of differences and DC coefficients of the frequency-converted blocks of the color image are the minimum for a position of a reconstructed pixel sampling value of each block. ### Claim 7 (depends on 5) The method of claim 5, wherein the reconstructing of the depth image using the position of the reconstructed pixel sampling value for each block comprises generating a mesh in the depth image using the position of the reconstructed pixel sampling value as a node and determining a depth value of the inside of the mesh using the color image information. ### Claim 8 A device for encoding a depth image using color image information, the device comprising: a block dividing unit configured to segment a color image and the depth image corresponding to the color image into block units; a pixel sampling position selecting unit configured to select a position of a pixel sampling value from each block of the depth image using the color image information; and an encoding unit configured to encode the pixel sampling value of the selected position as depth information. ### Claim 9 (depends on 8) The device of claim 8, wherein the block dividing unit segments the color image and the depth image into block units having a height of n pixels and a width of n pixels, where n is a multiple of 2. ### Claim 10 (depends on 8) The device of claim 8, wherein the pixel sampling position selecting unit converts frequencies of blocks of the color image corresponding to the blocks of the depth image and selects a position of a pixel having a pixel value for which absolute values of differences and DC coefficients of the frequency-converted blocks of the color image are the minimum for a position of a pixel sampling value of each block. ### Claim 11 (depends on 8) The device of claim 8, wherein the encoding unit downsamples the depth image into units having a height of n pixels and a width of n pixels and encodes the pixel sampling value of the downsampled depth image as depth information. ### Claim 12 (depends on 8) A device for reconstructing a depth image using color image information, the device comprising: a decoding unit configured to decode a depth image encoded by the device of claim 8 and reconstruct a pixel sampling value for each block as depth information; a pixel sampling position selecting unit configured to select a position of the reconstructed pixel sampling value from each block of the depth image using the color image information; and a depth image reconstructing unit configured to reconstruct the depth image using, the position of the reconstructed pixel sampling value for each block. ### Claim 13 (depends on 12) The device of claim 12, wherein the pixel sampling value position selecting unit converts frequencies of blocks of the color image corresponding to the blocks of the depth image and selects a position of a pixel having a pixel value for which absolute values of differences and DC coefficients of the frequency-converted blocks of the color image are the minimum for a position of the reconstructed pixel sampling value of each block. ### Claim 14 (depends on 12) The device of claim 12, wherein the depth image reconstructing unit generates a mesh in the depth image using the position of the reconstructed pixel sampling value as a node and determines a depth value of the inside of the mesh using the color image information.