# US 11,115,581 B2 · Focus adjustment method and device using a determined reliability of a detected phase difference > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,115,581 B2 - Document ID: US11115581B2 - Status: Granted - Kind: B2 - Application number: 16/785,537 - Filed: 2020-02-07 - Published: 2020-09-17 - Granted: 2021-09-07 - Earliest claimed: 2019-03-15 - Assignees: Olympus Corporation - Applicants: Olympus Corporation - Inventors: Akira Ugawa; Tetsuo Kikuchi - Web page: https://patentgrep.com/patent/US11115581B2 ## CPC - H04N 23/672: {based on the phase difference signals} - H04N 25/11: Arrangement of colour filter arrays [CFA]; Filter mosaics - H04N 25/704: Pixels specially adapted for focusing, e.g. phase difference pixel sets - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An imaging device, comprising an image sensor having image pixels and phase difference pixels, a phase difference detection section that detects a phase difference based on pixel data of the phase difference pixels, a pixel data calculation section that calculates pixel data of virtual imaging pixels at positions of the phase difference pixels, a degree of coincidence calculation section that calculates a degree of coincidence between each pixel data of the virtual imaging pixels that has been calculated, a reliability determination section that determines reliability of the phase difference detection result in accordance with the degree of coincidence, and a focus adjustment section that performs focus adjustment based on the phase difference detection result and the reliability. ## Claims ### Claim 1 An imaging device, comprising: an image sensor having imaging pixels that receive light of a subject image though a photographing lens and perform photoelectric conversion, and paired phase difference pixels that respectively receive light flux corresponding to pupil regions that are paired with the photographing lens and perform photoelectric conversion on the light flux that has been received; and a processor having a phase difference detection section, pixel data calculation section, degree of coincidence calculation section, reliability determination section, and focus adjustment section, wherein the phase difference detection section detects a phase difference based on pixel data of the paired phase difference pixels; the pixel data calculation section calculates pixel data of virtual image pixels at positions of the phase difference pixels, or selects pixel data of image pixels around positions of the phase difference pixels; the degree of coincidence calculation section calculates degree of coincidence between each pixel data of the virtual image pixels that have been calculated, or calculates degree of coincidence of each pixel data of image pixels that have been selected for positions of paired phase difference pixels; the reliability determination section determines reliability of the phase difference detection result in accordance with the degree of coincidence; and the focus adjustment section performs focus adjustment based on the phase difference detection result and the reliability, wherein the pixel data calculation section includes a gain setting section that sets gain for pixel data of the phase difference pixels, and an interpolation section that interpolates pixel data of virtual imaging pixels corresponding to position of the phase difference pixels, based on pixel data of imaging pixels positioned around the phase difference pixels, and wherein, the pixel data calculation section calculates pixel data of virtual imaging pixels corresponding to positions of the phase difference pixels based on a value resulting from having applied the gain to pixel data of the phase difference pixels, and the pixel data that has been interpolated. ### Claim 2 (depends on 1) The imaging device of claim 1, wherein: the reliability determination section determines that reliability is low if the degree of coincidence is lower than a threshold value, and the phase difference detection section detects phase difference by excluding pixel data of the phase difference pixels for which it has been determined that the reliability is low. ### Claim 3 (depends on 1) The imaging device of claim 1, wherein: the phase difference detection section detects phase difference for every ranging area; the degree of coincidence calculation section calculates degree of coincidence for every ranging area; the reliability determination section determines reliability for every ranging area; and the focus adjustment section determines a ranging area for calculating defocus amount of the photographing lens by excluding ranging results for ranging areas of low reliability based on the reliability that has been determined for each ranging area. ### Claim 4 (depends on 1) The imaging device of claim 1, wherein: the image sensor has a color filter for every pixel, and the degree of coincidence calculation section calculates degree of coincidence based on pixel data of image pixels that have the same color filter. ### Claim 5 (depends on 4) The imaging device of claim 4, wherein: the degree of coincidence calculation section calculates respective degrees of coincidence of associated pixel data of image pixels that have different color filters, and the reliability determination section determines reliability based on a plurality of degrees of coincidence corresponding to the different color filters. ### Claim 6 (depends on 4) The imaging device of claim 4, wherein: the degree of coincidence calculation section calculates respective degrees of coincidence of associated pixel data of a plurality of image pixels that have the same color filter, and the reliability determination section determines reliability based on a plurality of degrees of coincidence for each of the plurality of color filters of the same color. ### Claim 7 A focus adjustment method, for an imaging device provided with an image sensor having imaging pixels that receive light of a subject image though a photographing lens and perform photoelectric conversion, and paired phase difference pixels that respectively receive light flux corresponding to pupil regions that are paired with the photographing lens and perform photoelectric conversion on the light flux that has been received, comprising: detecting a phase difference based on pixel data of the paired phase difference pixels; calculating pixel data of virtual image pixels at positions of the phase difference pixels, or selecting pixel data of image pixels around positions of the phase difference pixels; calculating degree of coincidence between each pixel data of the virtual image pixels that have been calculated, or calculating degree of coincidence of each pixel data of image pixels that have been selected for positions of paired phase difference pixels; determining reliability of the phase difference detection result in accordance with the degree of coincidence; performing focus adjustment based on the phase difference detection result and the reliability; and at the time of the pixel data calculation, setting gain for pixel data of the phase difference pixels; interpolating pixel data of virtual imaging pixels corresponding to position of the phase difference pixels, based on pixel data of imaging pixels positioned around the phase difference pixels; and calculating pixel data of virtual imaging pixels corresponding to positions of the phase difference pixels based on a value resulting from having applied the gain to pixel data of the phase difference pixels, and the pixel data that has been interpolated. ### Claim 8 (depends on 7) The focus adjustment method of claim 7, further comprising: determining that reliability is low if the degree of coincidence is lower than a threshold value, and detecting phase difference by excluding pixel data of the phase difference pixels for which it has been determined that the reliability is low. ### Claim 9 (depends on 7) The focus adjustment method of claim 7, further comprising: detecting phase difference for every ranging area; calculating degree of coincidence for every ranging area; determining reliability for every ranging area; and determining a ranging area for calculating defocus amount of the photographing lens by excluding ranging results for ranging areas of low reliability based on the reliability that has been determined for each ranging area. ### Claim 10 (depends on 7) The focus adjustment method of claim 7, wherein: the image sensor has a color filter for every pixel, and further comprising, calculating degree of coincidence based on pixel data of image pixels that have the same color filter. ### Claim 11 (depends on 10) The focus adjustment method of claim 10, further comprising: calculating respective degrees of coincidence of associated pixel data of image pixels that have different color filters; and determining reliability based on a plurality of degrees of coincidence corresponding to the different color filters. ### Claim 12 (depends on 10) The focus adjustment method of claim 10, further comprising: calculating respective degrees of coincidence of associated pixel data of image pixels that have a plurality of the same color filters; and determining reliability based on a plurality of degrees of coincidence for each of the plurality of color filters of the same color. ### Claim 13 A non-transitory computer-readable medium, storing a processor executable code, which when executed by at least one processor, the processor being provided within an imaging device provided with an image sensor having imaging pixels that receive light of a subject image though a photographing lens and perform photoelectric conversion, and paired phase difference pixels that respectively receive light flux corresponding to pupil regions that are paired with the photographing lens and perform photoelectric conversion on the light flux that has been received, performs a focus adjusting method, the focus adjusting method comprising: detecting a phase difference based on pixel data of the paired phase difference pixels; calculating pixel data of virtual image pixels at positions of the phase difference pixels, or selecting pixel data of image pixels around positions of the phase difference pixels; calculating degree of coincidence between each pixel data of the virtual image pixels that have been calculated, or calculating degree of coincidence of each pixel data of image pixels that have been selected for positions of paired phase difference pixels; determining reliability of the phase difference detection result in accordance with the degree of coincidence; performing focus adjustment based on the phase difference detection result and the reliability; and at the time of the pixel data calculation, setting gain for pixel data of the phase difference pixels; interpolating pixel data of virtual imaging pixels corresponding to position of the phase difference pixels, based on pixel data of imaging pixels positioned around the phase difference pixels; and calculating pixel data of virtual imaging pixels corresponding to positions of the phase difference pixels based on a value resulting from having applied the gain to pixel data of the phase difference pixels, and the pixel data that has been interpolated. ### Claim 14 (depends on 13) The non-transitory computer-readable medium of claim 13, storing further processor executable code, which when executed by the at least one processor, causes the at least one processor to perform a method further comprising: determining that reliability is low if the degree of coincidence is lower than a threshold value; and detecting phase difference by excluding pixel data of the phase difference pixels for which it has been determined that the reliability is low. ### Claim 15 (depends on 13) The non-transitory computer-readable medium of claim 13, storing further processor executable code, which when executed by the at least one processor, causes the at least one processor to perform a method further comprising: detecting phase difference for every ranging area; calculating degree of coincidence for every ranging area; determining reliability for every ranging area; and determining a ranging area for calculating defocus amount of the photographing lens by excluding ranging results for ranging areas of low reliability based on the reliability that has been determined for each ranging area. ### Claim 16 (depends on 13) The non-transitory computer-readable medium of claim 13, storing further processor executable code, which when executed by the at least one processor, causes the at least one processor to perform a method further comprising: the image sensor has a color filter for every pixel, and further comprising, calculating respective degrees of coincidence based on pixel data of image pixels that have the same color filter. ### Claim 17 (depends on 16) The non-transitory computer-readable medium of claim 16, storing further processor executable code, which when executed by the at least one processor, causes the at least one processor to perform a method further comprising: calculating respective degrees of coincidence of associated pixel data of image pixels that have different color filters; and determining reliability based on a plurality of degrees of coincidence corresponding to the different color filters. ### Claim 18 (depends on 16) The non-transitory computer-readable medium of claim 16, storing further processor executable code, which when executed by the at least one processor, causes the at least one processor to perform a method further comprising: calculating respective degrees of coincidence of associated pixel data of image pixels that have a plurality of the same color filters; and determining reliability based on a plurality of degrees of coincidence for each of the plurality of color filters of the same color.