# US 2020/0404156 A1 · Focus adjustment operation detection device, focus adjustment operation detection method, focus adjustment operation detection program, imaging device main body, and imaging device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404156 A1
- Document ID: US20200404156A1
- Status: Published application
- Kind: A1
- Application number: 17/006,924
- Filed: 2020-08-31
- Published: 2020-12-24
- Earliest claimed: 2018-03-01
- Assignees: FUJIFILM Corporation
- Applicants: FUJIFILM Corporation
- Inventors: Takashi AOKI
- Web page: https://patentgrep.com/patent/US20200404156A1

## CPC

- H04N 23/67: Focus control based on electronic image sensor signals
- G03B 13/34: Power focusing
- G03B 13/36: Autofocus systems
- H04N 23/00: Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/663: for controlling interchangeable camera parts based on electronic image sensor signals
- H04N 23/672: {based on the phase difference signals}
- H04N 23/675: {comprising setting of focusing regions}
- H04N 25/704: Pixels specially adapted for focusing, e.g. phase difference pixel sets
- G03B 17/14: interchangeably
- H04N 23/687: {by shifting the lens or sensor position}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)

## Abstract

Provided are a focus adjustment operation detection device, a focus adjustment operation detection method, a focus adjustment operation detection program, an imaging device main body, and an imaging device capable of accurately detecting a focus adjustment operation of an imaging lens. An optical image passed through the imaging lens is received, and a phase difference of the received optical image is detected for each of a plurality of divided areas. Whether or not the focus adjustment operation of the imaging lens is performed is detected based on the amount of change in the phase difference for each divided area.

## Claims

### Claim 1

A focus adjustment operation detection device comprising:
an image sensor configured to image an optical image passed through an imaging lens, the image sensor having an imaging surface divided into a plurality of divided areas each of which includes a phase difference detection pixel; and
at least one processor configured to:
detect a phase difference for each divided area based on an output of the phase difference detection pixel;
detect a change in an angle of view; and
detect whether or not a focus adjustment operation of the imaging lens is performed based on an amount of change in the phase difference for each divided area, in a case where the detected angle of view is maintained at a constant value.

### Claim 2

A focus adjustment operation detection device comprising:
an image sensor configured to image an optical image passed through an imaging lens, the image sensor having an imaging surface divided into a plurality of divided areas each of which includes a first phase difference detection pixel and a second phase difference detection pixel; and
at least one processor configured to:
detect a phase difference for each divided area based on an output of the first phase difference detection pixel and an output of the second phase difference detection pixel;
calculate correlation between a signal of the first phase difference detection pixel and a signal of the second phase difference detection pixel when calculating the phase difference and determine that the phase difference is reliable in a case where the calculated correlation is equal to or greater than a threshold value; and
detect whether or not a focus adjustment operation of the imaging lens is performed based on an amount of the phase difference of each divided area whose phase difference is determined to be reliable.

### Claim 3

A focus adjustment operation detection device comprising:
an image sensor configured to image an optical image passed through an imaging lens, the image sensor having an imaging surface divided into a plurality of divided areas each of which includes a phase difference detection pixel; and
at least one processor configured to:
detect a phase difference for each divided area based on an output of the phase difference detection pixel;
analyze an image to be imaged by the imaging sensor and detect a moving body in a divided area to be imaged;
detect whether or not a focus adjustment operation of the imaging lens is performed based on an amount of change in the phase difference for each divided area, wherein the divided area in which the moving body is detected is excluded in the detection of whether or not the focus adjustment operation of the imaging lens is performed.

### Claim 4 (depends on 3)

The focus adjustment operation detection device according to claim 3,
wherein the at least one processor detects luminance for each divided area, and extracts a divided area in which an amount of change in the luminance is equal to or greater than a first threshold value to estimate the divided area in which a moving body is present, and
wherein in the detection of whether or not the focus adjustment operation of the imaging lens is performed, the at least one processor excludes: the divided area in which the moving body is detected; and the divided area which is estimated that the moving body is present therein.

### Claim 5

A focus adjustment operation detection device comprising:
an image sensor configured to image an optical image passed through an imaging lens, the image sensor having an imaging surface divided into a plurality of divided areas each of which includes a phase difference detection pixel; and
at least one processor configured to:
detect a phase difference for each divided area based on an output of the phase difference detection pixel;
detect luminance for each divided area;
extract a divided area in which a change in the luminance per unit time is equal to or greater than a first threshold value to estimate the divided area in which a moving body is present; and
detect whether or not a focus adjustment operation of the imaging lens is performed based on an amount of change in the phase difference for each divided area, wherein the divided area which is estimated that the moving body is present therein is excluded in the detection of whether or not the focus adjustment operation of the imaging lens is performed.

### Claim 6 (depends on 2)

The focus adjustment operation detection device according to claim 2,
wherein the at least one processor detects a change in an angle of view, and
wherein, in a case where the detected angle of view is maintained at a constant value, the at least one processor detects whether or not the focus adjustment operation of the imaging lens is performed.

### Claim 7 (depends on 1)

The focus adjustment operation detection device according to claim 1,
wherein the at least one processor detects luminance of an entire area to be imaged through the imaging lens,
wherein, in a case where a change in the luminance per unit time is equal to or less than a second threshold value, the at least one processor determines that a screen is changed, and
wherein the at least one processor stops the detection of the focus adjustment operation of the imaging lens, during when the change in the screen is detected.

### Claim 8 (depends on 1)

An imaging device main body comprising:
a mount which an imaging lens is attachable to and detachable from; and
the focus adjustment operation detection device according to claim 1.

### Claim 9 (depends on 1)

An imaging device comprising:
an imaging lens;
the focus adjustment operation detection device according to claim 1.

### Claim 10

A focus adjustment operation detection method comprising:
detecting a phase difference for each divided area of an image to be imaged by an image sensor which is configured to image an optical image passed through an imaging lens and has an imaging surface divided into a plurality of divided areas each of which includes a phase difference detection pixel, based on an output of the phase difference detection pixel;
detecting a change in an angle of view; and
detecting whether or not a focus adjustment operation of the imaging lens is performed based on an amount of change in the phase difference for each divided area, in a case where the detected angle of view is maintained at a constant value.

### Claim 11

A focus adjustment operation detection method comprising:
detecting a phase difference for each divided area of an image to be imaged by an image sensor which is configured to image an optical image passed through an imaging lens and has an imaging surface divided into a plurality of divided areas each of which includes a first phase difference detection pixel and a second phase difference detection pixel, based on an output of the phase difference detection pixel;
determining whether or not the phase difference for each divided area is reliable, wherein correlation between a signal of the first phase difference detection pixel and a signal of the second phase difference detection pixel is calculated and it is determined that the phase difference is reliable in a case where the calculated correlation is equal to or greater than a threshold value; and
detecting whether or not a focus adjustment operation of the imaging lens is performed based on an amount of the phase difference of each divided area whose phase difference is determined to be reliable.

### Claim 12

A focus adjustment operation detection method comprising:
detecting a phase difference for each divided area of an image to be imaged by an image sensor which is configured to image an optical image passed through an imaging les and has an imaging surface divided into a plurality of divided areas each of which includes a phase difference detection pixel, based on an output from the phase difference detection pixel; and
analyzing the image to be imaged by the imaging sensor to detect a moving body in a divided area to be imaged;
detecting whether or not a focus adjustment operation of the imaging lens is performed based on an amount of change in the phase difference for each divided area, wherein the divided area in which the moving body is detected is excluded in the detecting of whether or not the focus adjustment operation of the imaging lens is performed.

### Claim 13 (depends on 12)

The focus adjustment operation detection method according to claim 12, further comprising:
detecting luminance for each divided area; and
extracting a divided area in which an amount of change in the luminance is equal to or greater than a first threshold value to estimate the divided area in which a moving body is present,
wherein in the detecting of whether or not the focus adjustment operation of the imaging lens is performed, the divided area in which the moving body is detected and the divided area which is estimated that the moving body is present therein, are excluded.

### Claim 14

A focus adjustment operation detection method comprising:
detecting a phase difference for each divided area of an image to be imaged by an image sensor which is configured to image an optical image passed through an imaging les and has an imaging surface divided into a plurality of divided areas each of which includes a phase difference detection pixel, based on an output from the phase difference detection pixel; and
detecting luminance for each divided area;
extracting a divided area in which a change in the luminance per unit time is equal to or greater than a first threshold value to estimate the divided area in which a moving body is present; and
detecting whether or not a focus adjustment operation of the imaging lens is performed based on an amount of change in the phase difference for each divided area, wherein the divided area which is estimated that the moving body is present therein is excluded, in the detecting of whether or not the focus adjustment operation of the imaging lens is performed.

### Claim 15 (depends on 11)

The focus adjustment operation detection method according to claim 11, further comprising
detecting a change in an angle of view,
wherein, in a case where the detected angle of view is maintained at a constant value, it is detected whether or not the focus adjustment operation of the imaging lens is performed.

### Claim 16 (depends on 10)

The focus adjustment operation detection method according to claim 10, further comprising:
detecting luminance of an entire area to be imaged through the imaging lens; and
detecting whether or not a screen is changed based on a change in the luminance of the entire area to be imaged through the imaging lens, wherein, in a case where the change in the luminance per unit time is equal to or less than a second threshold value, it is determined that a screen is changed,
wherein the detection of the focus adjustment operation of the imaging lens is stopped during when the change in the screen is detected.

### Claim 17

A non-transitory computer-readable recording medium causing a computer to realize a focus adjustment operation detection function in a case where a command stored in the recording medium is read by the computer, the focus adjustment operation detection function comprising the functions of:
detecting a phase difference for each divided area of an image to be imaged by an image sensor which is configured to image an optical image passed through an imaging lens and has an imaging surface divided into a plurality of divided areas each of which includes a phase difference detection pixel, based on an output of the phase difference detection pixel;
detecting a change in an angle of view; and
detecting whether or not a focus adjustment operation of the imaging lens is performed based on an amount of change in the phase difference for each divided area, in a case where the detected angle of view is maintained at a constant value.

### Claim 18

A non-transitory computer-readable recording medium causing a computer to realize a focus adjustment operation detection function in a case where a command stored in the recording medium is read by the computer, the focus adjustment operation detection function comprising the functions of:
detecting a phase difference for each divided area of an image to be imaged by an image sensor which is configured to image an optical image passed through an imaging lens and has an imaging surface divided into a plurality of divided areas each of which includes a first phase difference detection pixel and a second phase difference detection pixel, based on an output of the phase difference detection pixel;
determining whether or not the phase difference for each divided area is reliable, wherein correlation between a signal of the first phase difference detection pixel and a signal of the second phase difference detection pixel is calculated and it is determined that the phase difference is reliable in a case where the calculated correlation is equal to or greater than a threshold value; and
detecting whether or not a focus adjustment operation of the imaging lens is performed based on an amount of the phase difference of each divided area whose phase difference is determined to be reliable.

### Claim 19

A non-transitory computer-readable recording medium causing a computer to realize a focus adjustment operation detection function in a case where a command stored in the recording medium is read by the computer, the focus adjustment operation detection function comprising the functions of:
detecting a phase difference for each divided area of an image to be imaged by an image sensor which is configured to image an optical image passed through an imaging les and has an imaging surface divided into a plurality of divided areas each of which includes a phase difference detection pixel, based on an output from the phase difference detection pixel; and
analyzing the image to be imaged by the imaging sensor to detect a moving body in a divided area to be imaged;
detecting whether or not a focus adjustment operation of the imaging lens is performed based on an amount of change in the phase difference for each divided area, wherein the divided area in which the moving body is detected is excluded in the detecting of whether or not the focus adjustment operation of the imaging lens is performed.

### Claim 20 (depends on 19)

The non-transitory computer-readable recording medium according to claim 19, causing a computer to realize a focus adjustment operation detection function further comprising the functions of:
detecting luminance for each divided area; and
extracting a divided area in which an amount of change in the luminance is equal to or greater than a first threshold value to estimate the divided area in which a moving body is present,
wherein in the detecting of whether or not the focus adjustment operation of the imaging lens is performed, the divided area in which the moving body is detected and the divided area which is estimated that the moving body is present therein, are excluded.

### Claim 21

A non-transitory computer-readable recording medium causing a computer to realize a focus adjustment operation detection function in a case where a command stored in the recording medium is read by the computer, the focus adjustment operation detection function comprising the functions of:
detecting a phase difference for each divided area of an image to be imaged by an image sensor which is configured to image an optical image passed through an imaging les and has an imaging surface divided into a plurality of divided areas each of which includes a phase difference detection pixel, based on an output from the phase difference detection pixel; and
detecting luminance for each divided area;
extracting a divided area in which a change in the luminance per unit time is equal to or greater than a first threshold value to estimate the divided area in which a moving body is present; and
detecting whether or not a focus adjustment operation of the imaging lens is performed based on an amount of change in the phase difference for each divided area, wherein the divided area which is estimated that the moving body is present therein is excluded, in the detecting of whether or not the focus adjustment operation of the imaging lens is performed.

### Claim 22 (depends on 18)

The non-transitory computer-readable recording medium according to claim 18, causing a computer to realize a focus adjustment operation detection function further comprising the function of
detecting a change in an angle of view,
wherein, in a case where the detected angle of view is maintained at a constant value, it is detected whether or not the focus adjustment operation of the imaging lens is performed.

### Claim 23 (depends on 17)

The non-transitory computer-readable recording medium according to claim 17, causing a computer to realize a focus adjustment operation detection function further comprising the functions of:
detecting luminance of an entire area to be imaged through the imaging lens; and
detecting whether or not a screen is changed based on a change in the luminance of the entire area to be imaged through the imaging lens, wherein, in a case where the change in the luminance per unit time is equal to or less than a second threshold value, it is determined that a screen is changed,
wherein the detection of the focus adjustment operation of the imaging lens is stopped during when the change in the screen is detected.
