# US 2020/0221014 A1 · Image pickup device and method of tracking subject thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0221014 A1
- Document ID: US20200221014A1
- Status: Published application
- Kind: A1
- Application number: 16/822,393
- Filed: 2020-03-18
- Published: 2020-07-09
- Earliest claimed: 2017-01-30
- Assignees: Maxell, Ltd.
- Applicants: Maxell, Ltd.
- Inventors: Hiroshi SHIMIZU; Kazuhiko YOSHIZAWA; Yasunobu HASHIMOTO; Nobuo MASUOKA
- Web page: https://patentgrep.com/patent/US20200221014A1

## CPC

- G03B 13/36: Autofocus systems
- G01S 3/00: Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic or electromagnetic waves, or particle emission, not having a directional significance, are being received (position-fixing by co-ordinating a plurality of determinations of direction or position lines G01S5/00)
- G06V 10/40: Extraction of image or video features
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/61: based on recognised objects
- H04N 23/63: by using electronic viewfinders
- H04N 23/675: {comprising setting of focusing regions}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H10D 30/0275: {forming single crystalline semiconductor source or drain regions resulting in recessed gates, e.g. forming raised source or drain regions}
- H10D 30/603: {having asymmetry in the channel direction, e.g. lateral high-voltage MISFETs having drain offset region or extended drain IGFETs [EDMOS]}
- H10D 30/605: {having significant overlap between the lightly-doped extensions and the gate electrode}
- H10D 30/608: {having non-planar bodies, e.g. having recessed gate electrodes}
- H10D 30/673: {characterised by the shapes, relative sizes or dispositions of the gate electrodes}
- H10D 64/025: {forming recessed gates, e.g. by using local oxidation}
- H10D 64/027: {by etching at gate locations}
- H10D 64/517: {characterised by the conducting layers}
- H10D 64/518: {characterised by their lengths or sectional shapes}
- H10D 64/519: {characterised by their top-view geometrical layouts}
- H10D 84/0142: {the gate conductors having different shapes or dimensions}
- H10D 84/038: {using silicon technology, e.g. SiGe}
- H10P 50/71: {using masks for conductive or resistive materials}
- H10P 95/00: Generic processes or apparatus for manufacture or treatments not covered by the other groups of this subclass
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H10D: INORGANIC ELECTRIC SEMICONDUCTOR DEVICES
- H10P: GENERIC PROCESSES OR APPARATUS FOR THE MANUFACTURE OR TREATMENT OF DEVICES COVERED BY CLASS H10

## Abstract

The present invention provides an image pickup device that recognizes the object that the user is attempting to capture as the subject, tracks the movement of that subject, and can continue tracking the movement of the subject even when the subject leaves the capturing area so that the subject can always be reliably brought into focus. The image pickup device includes a main camera that captures the subject; an EVF that displays the captured image captured by the main camera, a sub-camera that captures the subject using a wider capturing region than the main camera, and a processing unit that extracts the subject from the captured images captured by the main camera and the sub-camera, tracks the extracted subject, and brings the subject into focus when an image of the subject is actually captured. When the subject moves outside of a capturing region of the main camera, the processing unit tracks the subject extracted from the captured image captured by the sub-camera.

## Claims

### Claim 1

An image pickup apparatus comprising:
a camera having an aperture configured to capture a subject and obtain a captured image of the subject;
a display configured to display the captured image;
a processor configured to extract the subject from the captured image displayed on the display, track and focus the subject that is extracted; and
a memory interface configured to store the captured image on a memory,
wherein the processor is configured to control the aperture to change an aperture value of the aperture from a first aperture value to a second aperture value when the captured image is stored in the memory.

### Claim 2 (depends on 1)

The image pickup apparatus according to claim 1, wherein the processor is configured to control the aperture to set the aperture value of the aperture as the first aperture value when tracking and focusing the subject.

### Claim 3 (depends on 1)

The image pickup apparatus according to claim 1, further comprising a shutter button configured to receive a user operation for storing the captured image on the memory,
wherein, when the shutter button is partially pressed, the processor is configured to control the aperture to set the aperture value of the aperture as the first aperture value and track and focus the subject that is extracted.

### Claim 4 (depends on 3)

The image pickup apparatus according to claim 3, wherein when the shutter button is fully pressed, the processor is configured to control the aperture to set the aperture value of the aperture as the second aperture value and control the memory interface to store the captured image on the memory.

### Claim 5 (depends on 1)

The image pickup apparatus according to claim 1, wherein the first aperture value is larger than the second aperture value.

### Claim 6

A method, comprising:
capturing a subject using a camera to obtain a captured image of the subject;
displaying the captured image;
extracting the subject from the captured image displayed, and tracking and focusing the subject that is extracted;
storing the captured image in a memory; and
controlling an aperture of the camera to change an aperture value of the aperture from a first aperture value to a second aperture value when storing the captured image in the memory.

### Claim 7 (depends on 6)

The method according to claim 6, further comprising controlling the aperture to set the aperture value of the aperture as the first aperture value when tracking and focusing the subject.

### Claim 8 (depends on 6)

The method according to claim 6,
wherein the captured image is stored in the memory in response to an operation of a shutter button, and
the method further comprises, when the shutter button is partially pressed, controlling the aperture to set the aperture value of the aperture as the first aperture value, and tracking and focusing the subject that is extracted.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the method further comprises, when the shutter button is fully pressed, controlling the aperture to set the aperture value of the aperture as the second aperture value, and storing the captured image in the memory.

### Claim 10 (depends on 6)

The method according to claim 6, wherein the first aperture value is larger than the second aperture value.
