# US 2016/0241773 A1 · Lens module system, image sensor, and method of controlling lens module

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0241773 A1
- Document ID: US20160241773A1
- Status: Published application
- Kind: A1
- Application number: 14/965,353
- Filed: 2015-12-10
- Published: 2016-08-18
- Earliest claimed: 2015-02-18
- Assignees: Renesas Electronics Corporation
- Applicants: Renesas Electronics Corporation
- Inventors: Koji SHIDA; Shinya TANAKA
- Web page: https://patentgrep.com/patent/US20160241773A1

## CPC

- H04N 23/67: Focus control based on electronic image sensor signals
- G02B 7/102: {controlled by a microcomputer (cameras with interchangeable lenses G03B17/14)}
- G02B 15/143: {having three groups only}
- H04N 23/663: for controlling interchangeable camera parts based on electronic image sensor signals
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/75: by influencing optical camera components
- H04N 23/76: by influencing the image signals
- H04N 25/51: Control of the gain
- H04N 25/68: applied to defects
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

In an existing camera, a control program of a whole camera including a control program for controlling a lens group and a sensor needs to be entirely created by a camera manufacturer, which increases the number of man-hours of product development. According to one embodiment, in a lens module system, a lens module includes a lens group, an image sensor and a module control unit. Image feature information representing a feature of image information taken is output from the image sensor, and the module control unit controls a component of the lens group based on the image feature information.

## Claims

### Claim 1

A lens module system comprising:
a lens group with variable focus;
an image sensor that receives light entering through the lens group and outputs image information, and outputs image feature information representing a feature of the image information; and
a module control unit that controls at least one of focus of the lens group and exposure setting of the image sensor based on the image feature information output from the image sensor.

### Claim 2 (depends on 1)

The lens module system according to claim 1, wherein the module control unit changes a magnification of the lens group based on a zoom setting value specifying a zoom magnification from a system control unit that is provided separately from the module control unit and controls a whole camera system based on an instruction from a user, and controls focus at the changed magnification.

### Claim 3 (depends on 2)

The lens module system according to claim 2, wherein the module control unit controls exposure of the image information based on an exposure control value supplied from the system control unit.

### Claim 4 (depends on 3)

The lens module system according to claim 3, wherein
the image feature information contains histogram data of the image information, and
the module control unit controls exposure setting and gain setting of the image sensor based on the histogram data so that the histogram data of the image information matches the exposure control value.

### Claim 5 (depends on 1)

The lens module system according to claim 1, wherein
the image feature information contains resolution information indicating sharpness of an edge of the image information, and
the module control unit searches for a lens position where the resolution information reaches maximum by moving a lens included in the lens group, and sets the lens position where the resolution information reaches maximum as a position where focus is achieved.

### Claim 6 (depends on 2)

The lens module system according to claim 2, wherein the module control unit initializes the lens module system based on a power-on reset instruction supplied from the system control unit, and terminates the lens module system based on a power-off instruction supplied from the system control unit.

### Claim 7 (depends on 1)

The lens module system according to claim 1, wherein
the image sensor outputs a state display pulse indicating a period to perform analog-to-digital conversion that converts photoreceptor pixel information generated according to an amount of received light into a digital value, and
the module control unit stops controlling the lens group during a period where the state display pulse indicates the period to perform analog-to-digital conversion.

### Claim 8 (depends on 2)

The lens module system according to claim 2, wherein the module control unit calculates a control value of a lens actuator that controls a component included in the lens group based on an instruction from the system control unit.

### Claim 9 (depends on 1)

The lens module system according to claim 1, further comprising:
a pixel defect information storage unit that stores pixel defect information of the image sensor, wherein
the image sensor reads the pixel defect information from the pixel defect information storage unit at startup, and outputs the pixel information after making pixel correction based on the pixel defect information.

### Claim 10 (depends on 9)

The lens module system according to claim 9, wherein the pixel defect information is stored into the pixel defect information storage unit at shipment of the lens module system.

### Claim 11

An image sensor comprising:
a sensor unit that outputs photoreceptor pixel information generated according to an amount of light entering through a lens group with variable focus;
an analog-to-digital converter that converts the photoreceptor pixel information into a digital value and generates image information;
an image analysis unit that analyzes the image information output from the analog-to-digital converter and outputs image feature information representing a feature of the image information; and
a main path circuit that outputs the pixel information to outside.

### Claim 12 (depends on 11)

The image sensor according to claim 11, wherein the image analysis unit includes:
a resolution information generation unit that generates resolution information indicating sharpness of an edge of the image information.

### Claim 13 (depends on 12)

The image sensor according to claim 12, wherein the resolution information generation unit includes:
a high-pass filter that extracts pixels of a part serving as an edge in the image information;
a data integrator that integrates the number of pixels extracted by the high-pass filter; and
a resolution data storage register that stores the number of pixels integrated by the data integrator.

### Claim 14 (depends on 11)

The image sensor according to claim 11, wherein the image analysis unit includes:
a histogram generation unit that generates histogram data of the image information.

### Claim 15 (depends on 14)

The image sensor according to claim 14, wherein the histogram generation unit includes:
a luminance determination circuit that determines a luminance of each of pixels contained in the image information;
a luminance data counter that counts pixels whose luminance is determined by the luminance determination circuit on a luminance-by-luminance basis and generates histogram data; and
a histogram storage register that stores the histogram data.

### Claim 16 (depends on 11)

The image sensor according to claim 11, wherein the main path circuit performs gain control that changes a luminance resolution for each pixel according to a luminance of pixels in the image information based on an instruction from outside.

### Claim 17 (depends on 11)

The image sensor according to claim 11, comprising:
a state display pulse generation unit that generates a state display pulse indicating that the analog-to-digital converter is in a period of conversion.

### Claim 18 (depends on 11)

The image sensor according to claim 11, comprising:
a pixel defect correction circuit that reads pixel defect information at startup from a pixel defect information storage unit placed outside, and performs pixel defect correction that corrects a pixel defect contained in the image information based on the pixel defect information.

### Claim 19

A method of controlling a lens module including a lens group with variable focus and an image sensor that receives light entering through the lens group and outputs image information, the method comprising:
calculating a control value for determining a state of a component included in the lens group based on an instruction from a system control unit provided separately from the lens module;
acquiring image feature information representing a feature of the image information from the image sensor; and
controlling the component included in the lens group so that at least one of focus of the image information and exposure setting of the image sensor becomes an appropriate value based on the calculated control value and the acquired image feature information.
