# US 9,438,890 B2 · Image processor, 3D image capture device, image processing method, and image processing program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,438,890 B2 - Document ID: US9438890B2 - Status: Granted - Kind: B2 - Application number: 13/816,748 - Filed: 2012-07-04 - Published: 2015-05-21 - Granted: 2016-09-06 - Earliest claimed: 2011-08-25 - Assignees: Panasonic Intellectual Property Corporation of America - Applicants: Yasunori Ishii; Masao Hiramoto - Inventors: Yasunori Ishii; Masao Hiramoto - Web page: https://patentgrep.com/patent/US9438890B2 ## CPC - H04N 13/257: Colour aspects - H04N 13/133: Equalising the characteristics of different image components, e.g. their average brightness or colour balance - H04N 13/15: for colour aspects of image signals - H04N 13/214: using spectral multiplexing - H04N 13/218: using spatial multiplexing - H04N 25/704: Pixels specially adapted for focusing, e.g. phase difference pixel sets - H04N 23/673: {based on contrast or high frequency components of image signals, e.g. hill climbing method} - H04N 25/134: {based on three different wavelength filter elements} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image processor 7 includes: an in-focus area extracting section 72 that extracts an in-focus area of two images with parallax; a color conversion matrix calculating section 73 that obtains a color conversion matrix between the two images by reference to information about the colors of pixels that are included in the in-focus area of the two images; and a color conversion section 74 that converts the color of one of the two images by using the color conversion matrix. ## Claims ### Claim 1 An image processor that matches the colors of two images with parallax to each other, the two images having been captured by a device comprising a light transmitting section that has two transmitting areas with mutually different spectral transmittance characteristics; and an image sensor that is arranged to receive the light that has been transmitted through the light transmitting section and that includes two kinds of pixels with mutually different spectral transmittance characteristics, both of the two kinds of pixels configured to detect at least a part of light rays that have been transmitted through one of the two transmitting areas and at least a part of light rays that have been transmitted through the other of the two transmitting areas, the processor comprising: an in-focus area extracting section that extracts an in-focus area of the two images; a color conversion matrix calculating section that obtains a color conversion matrix between the two images by reference to information about the colors of pixels that are only included in the in-focus area of the two images; and a color conversion section that converts the color of one of the two images by using the color conversion matrix. ### Claim 2 (depends on 1) The image processor of claim 1, further comprising a high frequency component calculating section that calculates the high frequency components of at least one of the two images, wherein the in-focus area extracting section extracts the in-focus areas based on the high frequency components that have been calculated. ### Claim 3 (depends on 2) The image processor of claim 2, wherein the in-focus area extracting section extracts, as the in-focus area, the vicinity of high frequency pixels in which the quantity of the high frequency components is greater than a predetermined threshold value. ### Claim 4 (depends on 3) The image processor of claim 3, wherein the in-focus area extracting section extracts, as the in-focus area, a rectangular area comprised of n pixels×m pixels (where n and m are integers that are equal to or greater than one) including the high frequency pixels. ### Claim 5 (depends on 3) The image processor of claim 3, wherein the in-focus area extracting section extracts, as the in-focus area, a rectangular area comprised of n pixels×m pixels (where n and m are integers that are equal to or greater than one) surrounding the high frequency pixels. ### Claim 6 (depends on 1) The image processor of claim 1, wherein the color conversion matrix calculating section obtains the color conversion matrix by linear computations by the minimum square method, the M estimation method or the RANSAC method. ### Claim 7 A 3D image capture device comprising: a light transmitting section that has two transmitting areas with mutually different spectral transmittance characteristics; an image sensor that is arranged to receive the light that has been transmitted through the light transmitting section and that includes two kinds of pixels with mutually different spectral transmittance characteristics, wherein both of the two kinds of pixels are configured to detect at least a part of light rays that have been transmitted through one of the two transmitting areas and at least a part of light rays that have been transmitted through the other of the two transmitting areas; and an image processing section that generates two images with parallax based on pixel signals supplied from the image sensor, and wherein the image processing section includes: an in-focus area extracting section that extracts an in-focus area of the two images; a color conversion matrix calculating section that obtains a color conversion matrix between the two images by reference to information about the colors of pixels that are only included in the in-focus area of the two images; and a color conversion section that converts the color of one of the two images by using the color conversion matrix. ### Claim 8 An image processing method for matching the colors of two images with parallax to each other, the two images having been captured by a device comprising a light transmitting section that has two transmitting areas with mutually different spectral transmittance characteristics; and an image sensor that is arranged to receive the light that has been transmitted through the light transmitting section and that includes two kinds of pixels with mutually different spectral transmittance characteristics, both of the two kinds of pixels configured to detect at least a part of light rays that have been transmitted through one of the two transmitting areas and at least a part of light rays that have been transmitted through the other of the two transmitting areas, the method comprising the steps of: extracting an in-focus area of the two images; obtaining a color conversion matrix between the two images by reference to information about the colors of pixels that are only included in the in-focus area of the two images; and converting the color of one of the two images by using the color conversion matrix. ### Claim 9 An image processing program stored on a non-transitory computer readable medium for matching the colors of two images with parallax to each other, the two images having been captured by a device comprising a light transmitting section that has two transmitting areas with mutually different spectral transmittance characteristics; and an image sensor that is arranged to receive the light that has been transmitted through the light transmitting section and that includes two kinds of pixels with mutually different spectral transmittance characteristics, both of the two kinds of pixels configured to detect at least a part of light rays that have been transmitted through one of the two transmitting areas and at least a part of light rays that have been transmitted through the other of the two transmitting areas, the program, when executed by a processor of a computer, causes the computer to perform the steps of: extracting an in-focus area of the two images; obtaining a color conversion matrix between the two images by reference to information about the colors of pixels that are only included in the in-focus area of the two images; and converting the color of one of the two images by using the color conversion matrix.