# US 2021/0344838 A1 · Information processing apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344838 A1
- Document ID: US20210344838A1
- Status: Published application
- Kind: A1
- Application number: 17/282,197
- Filed: 2018-10-02
- Published: 2021-11-04
- Earliest claimed: 2018-10-02
- Assignees: Maxell, Ltd.
- Applicants: Maxell, Ltd.
- Inventors: Naohisa TAKAMIZAWA; Sadao TSURUGA; Yasunobu HASHIMOTO; Yoshinori OKADA
- Web page: https://patentgrep.com/patent/US20210344838A1

## CPC

- G01C 9/06: Electric or photoelectric indication or reading means
- G11B 27/00: Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 5/91: Television signal processing therefor
- H04N 23/63: by using electronic viewfinders
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 23/81: for suppressing or minimising disturbance in the image signal generation
- G06T 2200/32: involving image mosaicing
- G06T 2207/20221: Image fusion; Image merging
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

When thumbnails of a wide-angle panorama image are displayed, by scrolling and displaying a thumbnail image in which distortion and tilt deviation are reduced, visibility is improved. An information processing apparatus includes an image correction information generating unit, a control unit, and a display unit. The image correction information generating unit is composed of an image distortion determination processing unit and a horizontal/vertical direction determination processing unit, and generate correction information for correcting a partial image composed of an arbitrary image area of the wide-angle panorama image. The control unit corrects the partial image on a basis of the correction information generated by the image correction information generating unit. The display unit 108 displays an image. Then, the control unit causes the display unit to display the corrected partial image as the thumbnail image.

## Claims

### Claim 1

An information processing apparatus comprising:
an image correction information generating unit configured to generate correction information for correcting a partial image, the partial image being composed of an arbitrary image area of a wide-angle panorama image;
a control unit configured to correct the partial image on a basis of the correction information generated by the image correction information generating unit; and
a display unit configured to display an image,
wherein the control unit is further configured to cause the display unit to scroll and display the corrected partial image as a thumbnail image.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1,
wherein the image correction information generating unit includes:
a horizontal/vertical direction determination processing unit configured to generate horizontal/vertical direction information for correcting deviation of each of a horizontal direction and a vertical direction of the partial image composed of the arbitrary image area of the wide-angle panorama image on a basis of first sensor information, the first sensor information indicating a tilt of each of a horizontal and a vertical direction of the wide-angle panorama image, the horizontal/vertical direction determination processing unit being configured to output the generated horizontal/vertical direction information to the control unit as the correction information; and
an image distortion determination processing unit configured to generate image distortion information for correcting image distortion of the partial image on a basis of second sensor information, the second sensor information indicating a state of photographing distortion caused by a lens for photographing, the image distortion determination processing unit being configured to output the generated image distortion information to the control unit as the correction information, and
wherein the control unit is configured to correct the deviation of each of the horizontal direction and the vertical direction of the partial image and the image distortion in accordance with the horizontal/vertical direction information generated by the horizontal/vertical direction determination processing unit and the image distortion information generated by the image distortion determination processing unit.

### Claim 3 (depends on 1)

The information processing apparatus according to claim 1,
wherein the control unit is configured to scroll and display the partial image corrected along a horizontal direction of the wide-angle panorama image.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2,
wherein each of the first sensor information and the second sensor information is photographing information accompanying image data of the wide-angle panorama image.

### Claim 5 (depends on 1)

The information processing apparatus according to claim 1,
wherein the thumbnail image that the control unit causes the display unit to display has an aspect ratio of 3:4 or an aspect ratio of 9:16.

### Claim 6 (depends on 2)

The information processing apparatus according to claim 2, further comprising:
a characteristic point determination processing unit configured to determine and extract a characteristic point set in advance from the wide-angle panorama image,
wherein the characteristic point determination processing unit is configured to generate characteristic point possessing partial image information indicating an image portion in which the characteristic point extracted from the wide-angle panorama image is possessed, and
wherein the control unit is configured to causes the display unit to scroll and display a plurality of partial images having the characteristic point in accordance with the characteristic point possessing partial image information generated by the characteristic point determination processing unit.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
an input operation unit to which operation information is inputted,
wherein the input operation unit inputs operation information by each of a first input operation and a second input operation,
wherein the first input operation is an input operation for selecting and specifying an arbitrary partial image thus scrolled and displayed,
wherein the second input operation is an input operation for enlarging and displaying the partial image selected by the first input operation, and
wherein the control unit is configured to enlarge and display an image in which an area according to a photographic subject is adjusted around a point specified by the input operation unit when the operation information by the second input operation is inputted from the input operation unit.

### Claim 8 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
an input operation unit configured to input operation information,
wherein the input operation unit inputs operation information by each of a first input operation and a second input operation,
wherein the first input operation is an input operation for selecting and specifying an arbitrary partial image thus scrolled and displayed,
wherein the second input operation is an input operation for enlarging and displaying the partial image selected by the first input operation, and
wherein the control unit is configured to enlarge an image of a photographic subject near a point specified by the input operation unit when the operation information by the second input operation is inputted from the input operation unit and cause the display unit to display the enlarged image.

### Claim 9

An information processing apparatus comprising:
a camera unit configured to photograph a wide-angle panorama image;
an acceleration sensor unit configured to detect a tilt of the camera unit in a vertical direction;
an image correction information generating unit configured to generate correction information for correcting a partial image, the partial image being composed of an arbitrary image area of the wide-angle panorama image;
a control unit configured to correct the partial image on a basis of the correction information generated by the image correction information generating unit; and
a display unit configured to display an image,
wherein the acceleration sensor unit is configured to generate first sensor information indicating a tilt of each of horizontal and vertical directions of the wide-angle panorama image when the camera unit photographs,
wherein the camera unit is configured to generate second sensor information that indicates photographing distortion caused by a lens for photographing included by the camera unit,
wherein the image correction information generating unit is configured to generate the correction information in accordance with the first sensor information and the second sensor information, and
wherein the control unit is further configured to cause the display unit to scroll and display the corrected partial image as a thumbnail image.

### Claim 10 (depends on 9)

The information processing apparatus according to claim 9,
wherein the image correction information generating unit includes:
a horizontal/vertical direction determination processing unit configured to generate horizontal/vertical direction information for correcting deviation of each of a horizontal direction and a vertical direction of the partial image composed of the arbitrary image area of the wide-angle panorama image on a basis of the first sensor information to output the generated horizontal/vertical direction information to the control unit as the correction information; and
an image distortion determination processing unit configured to generate image distortion information for correcting image distortion of the partial image on a basis of second sensor information to output the generated image distortion information to the control unit as the correction information, and
wherein the control unit is configured to correct the deviation of each of the horizontal direction and the vertical direction of the partial image and the image distortion in accordance with the horizontal/vertical direction information generated by the horizontal/vertical direction determination processing unit and the image distortion information generated by the image distortion determination processing unit.

### Claim 11 (depends on 9)

The information processing apparatus according to claim 9,
wherein the control unit is configured to scroll and display the partial image corrected along a horizontal direction of the wide-angle panorama image.

### Claim 12 (depends on 9)

The information processing apparatus according to claim 9,
wherein the thumbnail image that the control unit causes the display unit to display has an aspect ratio of 3:4 or an aspect ratio of 9:16.

### Claim 13 (depends on 10)

The information processing apparatus according to claim 10, further comprising:
a characteristic point determination processing unit configured to determine a characteristic point set in advance from the wide-angle panorama image,
wherein the characteristic point determination processing unit is configured to generate characteristic point possessing partial image information indicating an image portion in which the characteristic point extracted from the wide-angle panorama image is possessed, and
wherein the control unit is configured to causes the display unit to scroll and display a plurality of partial images having the characteristic point in accordance with the characteristic point possessing partial image information generated by the characteristic point determination processing unit.

### Claim 14 (depends on 9)

The information processing apparatus according to claim 9, further comprising:
an input operation unit configured to input operation information,
wherein the input operation unit inputs operation information by each of a first input operation and a second input operation,
wherein the first input operation is an input operation for selecting and specifying an arbitrary partial image thus scrolled and displayed,
wherein the second input operation is an input operation for enlarging and displaying the partial image selected by the first input operation, and
wherein the control unit is configured to enlarge an image of a photographic subject near a point specified by the input operation unit when the operation information by the second input operation is inputted from the input operation unit and cause the display unit to display the enlarged image.

### Claim 15 (depends on 9)

The information processing apparatus according to claim 9, further comprising:
an input operation unit configured to input operation information,
wherein the input operation unit inputs operation information by each of a first input operation and a third input operation,
wherein the first input operation is an input operation for selecting and specifying an arbitrary partial image thus scrolled and displayed,
wherein the third input operation is an input operation for enlarging and displaying the partial image selected by the first input operation, and
wherein the control unit is configured to enlarge an image of a photographic subject by using a point specified by the input operation unit as a center when the operation information by the third input operation is inputted from the input operation unit and cause the display unit to display the enlarged image.
