# US 2021/0084221 A1 · Image processing system and image processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0084221 A1
- Document ID: US20210084221A1
- Status: Published application
- Kind: A1
- Application number: 16/953,373
- Filed: 2020-11-20
- Published: 2021-03-18
- Earliest claimed: 2015-03-10
- Assignees: Ricoh Company, Ltd.
- Applicants: Ricoh Company, Ltd.
- Inventors: Makoto MORIOKA
- Web page: https://patentgrep.com/patent/US20210084221A1

## CPC

- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 3/047: Fisheye or wide-angle transformations
- G06T 3/12: Panospheric to cylindrical image transformations
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 3/60: Rotation of whole images or parts thereof
- H04N 5/265: Mixing
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Two image processing systems and an image processing method are provided. One of the image processing systems includes a first unit configured to output a portion of input image data, a second unit configured to transform a coordinate of input image data, and a third unit configured to output the image data processed by the first unit and the second unit as video data to be displayed on a display. The other one of the image processing system further includes a fourth unit configured to combine input image data of a plurality of images to output one piece of image data. The image processing method includes outputting a portion of input image data, transforming a coordinate of input image data, and outputting the image data as video data to be displayed on a display.

## Claims

### Claim 1

An imaging system, comprising:
an imaging capturing device including a plurality of lens optical systems and a plurality of imaging devices;
a receiver configured to receive a signal; and
processing circuitry configured to
generate a spherical image based on the plurality of images captured by the imaging capturing device;
perform a coordinate transformation on the spherical image based on the signal;
crop a portion of the spherical image, on which the coordinate transformation has been performed, the portion including an area determined by the signal; and
output the portion of the spherical image to a display position.

### Claim 2 (depends on 1)

The imaging system according to claim 1, wherein each time signal changes
the processing circuitry performs the coordinate transformation, the portion of the spherical image is changed, and the processing circuitry outputs the portion of the spherical image for display at the display position.

### Claim 3 (depends on 1)

The imaging system according to claim 1, wherein the portion of the spherical image is cropped so as to include a center of the spherical image.

### Claim 4 (depends on 2)

The imaging system according to claim 2, wherein the portion of the spherical image is cropped so as to include a center of the spherical image.

### Claim 5 (depends on 1)

The imaging system according to claim 1, wherein the signal includes an attitude angle used to determine the area.

### Claim 6 (depends on 5)

The imaging system according to claim 5, wherein
the attitude angle is measured using a sensor, and
the sensor includes at least one of an acceleration sensor, a gyroscope sensor, and a geomagnetic sensor.

### Claim 7 (depends on 1)

The imaging system according to claim 1, further comprising an image acquisition circuit configured to obtain a plurality of images from the plurality of imaging devices.

### Claim 8 (depends on 1)

The imaging system according to claim 1, wherein the processing circuitry is further configured to obtain a plurality of images from the plurality of imaging devices.

### Claim 9 (depends on 1)

The imaging system according to claim 1, wherein
each one of the plurality of lens optical systems has a prescribed angle of view;
the angles of view are joined together to meet a solid angle of 4π steradian, and the spherical image is generated based on the plurality of images.

### Claim 10

A method of processing a spherical image that is based on a plurality of images captured by an imaging capturing device, the image capturing device including a plurality of lens optical systems and a plurality of imaging devices, the method comprising:
receiving a signal;
performing a coordinate transformation on the spherical image based on the signal;
cropping a portion of the spherical image, on which the coordinate transformation has been performed, the portion including an area determined by the signal and
outputting the portion of the spherical image to a display position.

### Claim 11 (depends on 10)

The method according to claim 10, further comprising:
performing the coordinate transformation each time the signal changes;
changing, each time the signal changes, the portion of the spherical image to be cropped on which the coordinate transformation has been performed; and
displaying the changed portion of the spherical image.

### Claim 12 (depends on 10)

The method according to claim 10, wherein the portion of the spherical image is cropped by the cropping so as to include a center of the spherical image.

### Claim 13 (depends on 10)

The method according to claim 10, wherein the signal includes an attitude angle used to determine the area.
