# US 8,786,761 B2 · Continuous autofocus mechanisms for image capturing devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,786,761 B2 - Document ID: US8786761B2 - Status: Granted - Kind: B2 - Application number: 12/479,728 - Filed: 2009-06-05 - Published: 2010-12-09 - Granted: 2014-07-22 - Earliest claimed: 2009-06-05 - Assignees: Apple Inc. - Applicants: Ralph Brunner; David Hayward - Inventors: Ralph Brunner; David Hayward - Web page: https://patentgrep.com/patent/US8786761B2 ## CPC - G03B 13/36: Autofocus systems - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 23/673: {based on contrast or high frequency components of image signals, e.g. hill climbing method} - H04N 23/68: for stable pick-up of the scene, e.g. compensating for camera body vibrations - H04N 23/6812: {based on additional sensors, e.g. acceleration sensors} - H04M 2250/12: including a sensor for measuring a physical value, e.g. temperature or motion - H04M 2250/52: including functional features of a camera - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract At least certain embodiments described herein provide a continuous autofocus mechanism for an image capturing device. The continuous autofocus mechanism can perform an autofocus scan for a lens of the image capturing device and obtain focus scores associated with the autofocus scan. The continuous autofocus mechanism can determine an acceptable band of focus scores based on the obtained focus scores. Next, the continuous autofocus mechanism can determine whether a current focus score is within the acceptable band of focus scores. A refocus scan may be performed if the current focus score is outside of the acceptable band of focus scores. ## Claims ### Claim 1 A method to implement a continuous autofocus mechanism for an image capturing device, the method comprising: performing an autofocus scan that positions a lens of the image capturing device in a plurality of positions; obtaining a plurality of focus scores with each focus score being associated with a respective lens position of the autofocus scan; and determining an acceptable band of focus scores based on the obtained plurality of focus scores, wherein determining the acceptable band of focus scores comprises determining a lower limit and an upper limit of the acceptable band of focus scores, wherein determining the acceptable band of focus scores comprises determining a first derivative of a peak focus score value with respect to a first focus score value that is adjacent to the peak focus score value and determining a first derivative of the peak focus score value with respect to a second focus score value that is adjacent to the peak focus score value, wherein the first focus score value is associated with a different lens position than the second focus score value. ### Claim 2 (depends on 1) The method of claim 1, further comprising: determining whether a frame is stable; determining a current lens position and a current focus score associated with the frame if the frame is stable; and determining whether the current focus score associated with the frame is within the acceptable band of focus scores. ### Claim 3 (depends on 2) The method of claim 2, further comprising: setting the lens position to a new position in which the lens moves from the current position by a predetermined adjustment towards a lens position associated with the lens being focused near infinity if the current score is greater than the upper limit of the acceptable band of scores; and starting a refocus scan at the new position. ### Claim 4 (depends on 1) The method of claim 1, wherein determining each of the lower limit and the upper limit of the acceptable band of focus scores is based on the peak focus score value, the acceptable band of focus scores, and a largest first derivative of the peak focus score value with respect to one of a plurality of focus score values adjacent to the peak focus score value. ### Claim 5 (depends on 1) The method of claim 1, wherein determining the acceptable band of focus scores further comprises determining a first derivative of the peak focus score value with respect to a third focus score value that is adjacent to the peak focus score value and determining a first derivative of the peak focus score value with respect to a fourth focus score value that is adjacent to the peak focus score value. ### Claim 6 A method to implement a continuous autofocus mechanism for an image capturing device, the method comprising: performing an autofocus scan that positions a lens of the image capturing device in a plurality of positions; obtaining a plurality of focus scores with each focus score being associated with a respective lens position of the autofocus scan; determining an acceptable band of focus scores based on the obtained plurality of focus scores, wherein determining the acceptable band of focus scores comprises determining a lower limit and an upper limit of the acceptable band of focus scores; determining an intersection of the current score on a focus graph of focus scores versus lens positions if the current score is less than the lower limit of the acceptable band of scores; estimating a lens position based on the intersection; and starting a refocus scan, which is a new autofocus scan, at the lens position. ### Claim 7 A method to implement a continuous autofocus mechanism for an image capturing device, the method comprising: performing an autofocus scan that positions a lens of the image capturing device in a plurality of positions; obtaining a plurality of focus scores with each focus score being associated with a respective lens position of the autofocus scan; determining an acceptable band of focus scores based on the obtained plurality of focus scores; determining whether a lens is focused close to infinity; and setting a starting position that corresponds to the lens focused at infinity for a refocus scan if the lens is focused close to infinity. ### Claim 8 A machine readable medium containing executable computer program instructions which when executed by a data processing system cause said system to perform a method, the method comprising: performing an autofocus scan for a lens of the image capturing device; obtaining a plurality of focus scores associated with the autofocus scan; and determining an acceptable band of focus scores based on the obtained focus scores, wherein determining the acceptable band of focus scores comprises determining a lower limit and an upper limit of the acceptable band of focus scores, wherein determining the acceptable band of focus scores comprises determining a first derivative of a peak focus score value with respect to a first focus score value that is adjacent to the peak focus score value and determining a first derivative of the peak focus score value with respect to a second focus score value that is adjacent to the peak focus score value, wherein the first focus score value is associated with a different lens position than the second focus score value. ### Claim 9 (depends on 8) The medium of claim 8, the method further comprising: determining whether a frame is stable; determining a current lens position and a current focus score associated with the frame if the frame is stable; and determining whether the current focus score associated with the frame is within the acceptable band of focus scores. ### Claim 10 (depends on 8) The medium of claim 8, wherein determining each of the lower limit and the upper limit of the acceptable band of focus scores is based on the peak focus score value, the acceptable band of focus scores, and a largest first derivative of the peak focus score value with respect to one of a plurality of focus score values adjacent to the peak focus score value. ### Claim 11 (depends on 8) The medium of claim 8, the method further comprising: determining an intersection of the current score on a focus graph of focus scores versus lens positions if the current score is less than the lower limit of the acceptable band of scores; estimating a lens position based on the intersection; and starting a refocus scan, which is a new autofocus scan, at the lens position. ### Claim 12 A machine readable medium containing executable computer program instructions which when executed by a data processing system cause said system to perform a method, the method comprising: performing an autofocus scan for a lens of the image capturing device; obtaining a plurality of focus scores associated with the autofocus scan; and determining an acceptable band of focus scores based on the obtained focus scores, wherein determining the acceptable band of focus scores comprises determining a lower limit and an upper limit of the acceptable band of focus scores; determining whether a frame is stable; determining a current lens position and a current focus score associated with the frame if the frame is stable; determining whether the current focus score associated with the frame is within the acceptable band of focus scores; setting the lens position to a new position in which the lens moves from the current position by a predetermined adjustment towards a lens position associated with the lens being focused near infinity if the current score is greater than the upper limit of the acceptable band of scores; and starting a refocus scan at the new position. ### Claim 13 An image capturing device, comprising: a storage device to store a plurality of captured images; a lens to receive incident light associated with an image to be captured; and a processing system coupled to the storage device, the processing system is configured to perform an autofocus scan, to obtain a plurality of focus scores associated with the autofocus scan; and to determine an acceptable band of focus scores for the lens based on the obtained focus scores, wherein to determine the acceptable band of focus scores comprises determining a lower limit and an upper limit of the acceptable band of focus scores, wherein to determine the acceptable band of focus scores comprises determining a first derivative of a peak focus score value with respect to a first focus score value that is adjacent to the peak focus score value and determining a first derivative of the peak focus score value with respect to a second focus score value that is adjacent to the peak focus score value, wherein the first focus score value is associated with a different lens position than the second focus score value. ### Claim 14 (depends on 13) The device of claim 13, wherein the processing system is further configured: to determine whether a frame is stable; to determine a current lens position and a current focus score associated with the frame if the frame is stable; and to determine whether the current focus score associated with the frame is within the acceptable band of focus scores. ### Claim 15 (depends on 13) The device of claim 13, wherein determining each of the lower limit and the upper limit of the acceptable band of focus scores is based on the peak focus score value, the acceptable band of focus scores, and a largest first derivative of the peak focus score value with respect to one of a plurality of focus score values adjacent to the peak focus score value. ### Claim 16 (depends on 13) The device of claim 13, further comprising: a motion sensor to determine motion information for the device. ### Claim 17 (depends on 16) The device of claim 16, wherein the motion sensor comprises an accelerometer. ### Claim 18 (depends on 13) The device of claim 13, wherein the processing system is configured to determine whether a refocus scan is needed and to start a refocus scan. ### Claim 19 (depends on 18) The device of claim 18, wherein the processing system is configured to perform the refocus scan by positioning the lens in a plurality of positions. ### Claim 20 An image capturing device, comprising: a storage device to store a plurality of captured images; a lens to receive incident light associated with an image to be captured; and a processing system coupled to the storage device, the processing system is configured to perform an autofocus scan, to obtain a plurality of focus scores associated with the autofocus scan; and to determine an acceptable band of focus scores for the lens based on the obtained focus scores, wherein to determine the acceptable band of focus scores comprises determining a lower limit and an upper limit of the acceptable band of focus scores, wherein the processing system is configured to determine whether a refocus scan is needed and to start a refocus scan, wherein the processing system is configured to perform the refocus scan by positioning the lens in a plurality of positions, wherein the processing system is configured to detect that the lens has moved past a predetermined position and to abort the refocus scan without moving the lens to the remaining positions of the refocus scan. ### Claim 21 A method, comprising: determining motion information for an image capturing device using one or more motion sensors; determining whether the device is moving based on the motion information; and filtering a plurality of focus scores based on the motion information, wherein each focus score is filtered by applying a dampening factor to each focus score based on the associated motion information with the dampening factor indicating how fast a filter reacts to changes in the focus scores. ### Claim 22 (depends on 21) The method of claim 21, further comprising: performing an autofocus scan for a lens of the image capturing device; and obtaining the plurality of focus scores associated with the autofocus scan, wherein motion information for the device is associated with each focus score. ### Claim 23 (depends on 21) The device of claim 21, wherein the one or more motion sensors comprise an accelerometer. ### Claim 24 A method, comprising: determining motion information for an image capturing device using a motion sensor; determining whether the device is moving based on the motion information; starting or stopping an autofocus mechanism based on the motion information; and parking a lens position of a lens of the device at a hyperfocal position if the device is moving for a period of time that compares in a predetermined manner with a threshold value.