# US 2010/0165145 A1 · Image pickup apparatus and method, image processing apparatus and method, image display system, recording medium and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0165145 A1
- Document ID: US20100165145A1
- Status: Published application
- Kind: A1
- Application number: 12/720,265
- Filed: 2010-03-09
- Published: 2010-07-01
- Earliest claimed: 2003-10-31
- Assignees: Sony Corporation
- Inventors: Yoshihiko Kuroki
- Web page: https://patentgrep.com/patent/US20100165145A1

## CPC

- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 5/2625: {for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect (sequence generated by event triggered capturing H04N7/188)}
- H04N 23/665: {involving internal camera communication with the image sensor, e.g. synchronising or multiplexing SSIS control signals}
- H04N 23/84: for processing colour signals
- H04N 25/41: {Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image pickup apparatus and method is disclosed by which moving pictures of a high frame rate can be displayed. The image pickup apparatus for picking up moving pictures, includes: a distribution section for distributing light incoming through an optical lens to n directions; n image pickup elements for converting the light distributed by the distribution section into signals at time intervals of 1/m second to pick up images; and a control section for controlling timings at which the light is to be converted into the signals by the image pickup elements; the control section controlling the n image pickup elements to convert the light into the signals at timings successively displaced by 1/m×n second to pick up images.

## Claims

### Claim 1

A program for causing a computer to execute a process of picking up moving pictures using n image pickup elements, comprising:
a distribution step of distributing light incoming through an optical lens to n directions;
a timing signal generation step of generating a timing signal to be used to control timings at which said n image pickup elements are to pick up images; and
an image pickup step of picking up the light distributed by the process at the distribution step to pick up images by means of said n image pickup elements based on the timing signal generated by the process at the timing signal generation step;
said image pickup elements being capable of converting the light into signals at time intervals of 1/m second to pick up images;
the timing signal generated by the process at the timing signal generation step being used to control said n image pickup elements so as to convert the light into signals to pick up images at timings successively displaced by 1/m×n second.

### Claim 2

An image processing apparatus for processing image signals to be displayed by n image display apparatus or one image display apparatus having n display processing sections, comprising:
a storage section for storing the image signals having a first frame rate of m Hz;
an output control section for controlling outputting of the image signals stored in said storage section; and
a display control section for controlling display of images corresponding to the image signals whose outputting is controlled by said output control section;
said output control section controlling outputting of the image signals of the first frame rate so that the image signals are successively outputted for each one frame from said storage section to said n image display apparatus or said n display processing sections;
said display control section controlling the display of the images corresponding to the image signals so that the image signals successively outputted to said n image display apparatus or said n display processing sections by said output control section are successively drawn dot-sequentially or line-sequentially in phases successively displaced by 1/m×n of a scanning time period of one frame so that the images are displayed on said image display apparatus at a second frame rate equal to n times the first frame rate.

### Claim 3 (depends on 2)

The image processing apparatus according to claim 2, further comprising a combination section for combining the image signals stored in said storage section.

### Claim 4 (depends on 2)

The image processing apparatus according to claim 2, wherein the first frame rate is 60 Hz, and the number of said image display apparatus or said display processing sections is at least four.

### Claim 5 (depends on 2)

The image processing apparatus according to claim 2, wherein the first frame rate is 120 Hz, and the number of said image display apparatus or said display processing sections is at least two.

### Claim 6 (depends on 2)

The image processing apparatus according to claim 2, wherein the first frame rate is 50 Hz, and the number of said image display apparatus or said display processing sections is at least five.

### Claim 7

An image processing method for an image processing apparatus for processing image signals to be displayed by n image display apparatus or one image display apparatus having n display processing sections, comprising:
an output control step of controlling outputting of the image signals having a first frame rate of m Hz; and
a display control step of controlling display of images corresponding to the image signals whose outputting is controlled by the process at the output control step;
the output control step controlling outputting of the image signals of the first frame rate so that the image signals are successively outputted for each one frame to said n image display apparatus or said n display processing sections;
the display control step controlling the display of the images corresponding to the image signals so that the image signals successively outputted to said n image display apparatus or said n display processing sections by the process at the output control step are successively drawn dot-sequentially or line-sequentially in phases successively displaced by 1/m×n of a scanning time period of one frame so that the images are displayed on said image display apparatus at a second frame rate equal to n times the first frame rate.

### Claim 8

A program for causing a computer to execute processing of image signals to be displayed by n image display apparatus or one image display apparatus having n display processing sections, comprising:
an output control step of controlling outputting of the image signals having a first frame rate of m Hz; and
a display control step of controlling display of images corresponding to the image signals whose outputting is controlled by the process at the output control step;
the output control step controlling outputting of the image signals of the first frame rate so that the image signals are successively outputted for each one frame to said n image display apparatus or said n display processing sections;
the display control step controlling the display of the images corresponding to the image signals so that the image signals successively outputted to said n image display apparatus or said n display processing sections by the process at the output control step are successively drawn dot-sequentially or line-sequentially in phases successively displaced by 1/m×n of a scanning time period of one frame so that the images are displayed on said image display apparatus at a second frame rate equal to n times the first frame rate.

### Claim 9

An image display system, comprising:
an image processing apparatus for processing image signals; and
an image display apparatus for displaying images corresponding to the image signals processed by said image processing apparatus;
said image processing apparatus including a storage section for storing the image signals having a first frame rate of m Hz, an output control section for controlling outputting of the image signals stored in said storage section, and a display control section for controlling display of images corresponding to the image signals whose outputting is controlled by said output control section;
said image display apparatus including at least n image display processing sections for drawing the images dot-sequentially or line-sequentially and a display section for displaying the images drawn by said image display processing sections;
said output control section controlling outputting of the image signals of the first frame rate so that the image signals are successively outputted for each one frame from said storage section to said n image display processing sections;
said display control section controlling the display of the images corresponding to the image signals so that the image signals successively outputted to said n image display processing sections by said output control section are successively drawn dot-sequentially or line-sequentially in phases successively displaced by 1/m×n of a scanning time period of one frame so that the images are displayed on said image display apparatus at a second frame rate equal to n times the first frame rate.

### Claim 10

An image display system, comprising:
an image processing apparatus for processing image signals; and
an image display apparatus for displaying images corresponding to the image signals processed by said image processing apparatus;
said image processing apparatus including a storage section for storing the image signals having a first frame rate of m Hz, an output control section for controlling outputting of the image signals stored in said storage section, and a display control section for controlling display of images corresponding to the image signals whose outputting is controlled by said output control section;
said image display apparatus including at least n image display processing sections for drawing the images dot-sequentially or line-sequentially;
said output control section controlling outputting of the image signals of the first frame rate so that the image signals are successively outputted for each one frame from said storage section to said n image display processing sections;
said display control section controlling the display of the images corresponding to the image signals so that the image signals successively outputted to said n image display processing sections by said output control section are successively drawn dot-sequentially or line-sequentially in phases successively displaced by 1/m×n of a scanning time period of one frame so that the images are displayed on said image display apparatus at a second frame rate equal to n times the first frame rate.

### Claim 11 (depends on 10)

The image display system according to claim 10, wherein said image display apparatus is formed from a projector for displaying the images by projection.

### Claim 12

An image pickup apparatus for picking up moving pictures, comprising:
an image pickup section for converting light incoming through an optical lens into a signal to pick up an image; and
a control section for controlling the timing at which the light is to be converted into the signal by said image pickup section and controlling said image pickup section so that the light receiving position at which said image pickup section receives the light is successively displaced by 1/n the pixel pitch of said image pickup section in a direction perpendicular to the path of the light.

### Claim 13 (depends on 12)

The image pickup apparatus according to claim 12, further comprising a pixel interpolation section for performing a pixel interpolation process in a spatial direction for a picture formed from the image picked up by said image pickup section.

### Claim 14

An image pickup method for an image pickup apparatus for picking up moving pictures, comprising:
a timing signal generation step of generating a timing signal for controlling the light receiving position at which light incoming through an optical lens is to be received is successively displaced by 1/n the pixel pitch in a direction perpendicular to the path of the light and controlling the timing at which the light is to be converted into a signal; and
an image pickup step of picking up an image based on the timing signal generated by the process at the timing signal generation step.

### Claim 15

A program for causing a computer to execute a process of picking up moving pictures, comprising:
a timing signal generation step of generating a timing signal for controlling the light receiving position at which light incoming through an optical lens is to be received is successively displaced by 1/n the pixel pitch in a direction perpendicular to the path of the light and controlling the timing at which the light is to be converted into a signal; and
an image pickup step of picking up an image based on the timing signal generated by the process at the timing signal generation step.

### Claim 16

An image pickup apparatus for picking up moving pictures, comprising:
a distribution section for distributing light incoming through an optical lens to n directions;
a first image pickup section for converting the light distributed by said distribution section into a signal having information of a plurality of colors to pick up images;
a second image pickup section for converting the light distributed by said distribution section into a signal having luminance information to pick up an image; and
an image information production section for combining the signals converted by said first image pickup section and having the color information and the signal converted by said second image pickup section and having the luminance information to produce image information.

### Claim 17 (depends on 16)

The image pickup apparatus according to claim 16, wherein a sampling frequency of the color information converted by said first image pickup section is lower than a sampling frequency of the luminance information converted by said second image pickup section.

### Claim 18

An image pickup method for an image pickup apparatus for picking up moving pictures, comprising:
a distribution step of distributing light incoming through an optical lens to n directions;
an image pickup step of converting the light distributed by the process at the distribution step into a signal having information of a plurality of colors to pick up images and converting the light distributed by the process at the distribution step into a signal having luminance information to pick up an image; and
an image processing step of combining the signals and having the color information and the signal having the luminance information to produce image information and both converted by the process at the image pickup step.

### Claim 19

A program for causing a computer to execute a process of picking up moving pictures, comprising:
a distribution step of distributing light incoming through an optical lens to n directions;
an image pickup step of converting the light distributed by the process at the distribution step into a signal having information of a plurality of colors to pick up images and converting the light distributed by the process at the distribution step into a signal having luminance information to pick up an image; and
an image processing step of combining the signals and having the color information and the signal having the luminance information to produce image information and both converted by the process at the image pickup step.
