# US 2013/0155205 A1 · Image processing device, imaging device, and image processing method and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0155205 A1
- Document ID: US20130155205A1
- Status: Published application
- Kind: A1
- Application number: 13/819,238
- Filed: 2011-09-12
- Published: 2013-06-20
- Earliest claimed: 2010-09-22
- Assignees: Sony Corporation
- Inventors: Ryota Kosakai; Seijiro Inaba
- Web page: https://patentgrep.com/patent/US20130155205A1

## CPC

- G06T 15/205: {Image-based rendering}
- G03B 17/20: visible in viewfinder
- G03B 35/02: by sequential recording
- G03B 37/02: with scanning movement of lens or cameras
- H04N 13/211: using temporal multiplexing
- H04N 13/221: using the relative movement between cameras and objects
- H04N 13/286: having separate monoscopic and stereoscopic modes
- H04N 13/296: Synchronisation thereof; Control thereof
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In the configuration in which a two-dimensional panoramic image or images used for displaying a three-dimensional image are generated by connecting stripped areas cut out from a plurality of images, a composition image that can be generated is determined based on the movement of the camera, and the determined composition image is generated. In the configuration in which a two-dimensional panoramic image or left-eye and right-eye images used for a three-dimensional image are generated by connecting stripped areas cut out from a plurality of images, it is determined whether or not a two-dimensional panoramic image or a three-dimensional image can be generated by analyzing the movement of an imaging apparatus at the time of capturing images, and a composition image that can be generated is generated.

## Claims

### Claim 1

An image processing apparatus comprising:
an image composing unit that generates a composition image by connecting stripped areas that are cut out from each image of a plurality of images captured from mutually different positions,
wherein the image composing unit determines one processing aspect based on movement information of an imaging apparatus at the time of capturing an image from among (a) a composition image generating process of a left-eye composition image and a right-eye composition image that are used for displaying a three-dimensional image, (b) a composition image generating process of a two-dimensional panoramic image, and (c) stopping composition image generating and performs the determined process.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, further comprising:
a turning momentum detecting unit that acquires or calculates turning momentum (θ) of the imaging apparatus at the time of capturing an image; and
a translational momentum detecting unit that acquires or calculates translational momentum (t) of the imaging apparatus at the time of capturing an image; and
wherein the image composing unit determines the processing aspect based on the turning momentum (θ) detected by the turning momentum detecting unit and the translational momentum (t) detected by the translational momentum detecting unit.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, further comprising an output unit that presents a warning or a notification to a user in accordance with information of the determination of the image composing unit.

### Claim 4 (depends on 2)

The image processing apparatus according to claim 2, wherein the image composing unit stops the composition image generating process of the three-dimensional image and the two-dimensional panoramic image in a case where the turning momentum (θ) detected by the turning momentum detecting unit is zero.

### Claim 5 (depends on 2)

The image processing apparatus according to claim 2, wherein the image composing unit performs one of the composition image generating process of a two-dimensional panoramic image and the stopping composition image generating in a case where the turning momentum (θ) detected by the turning momentum detecting unit is not zero, and the translational momentum (t) detected by the translational momentum detecting unit is zero.

### Claim 6 (depends on 2)

The image processing apparatus according to claim 2, wherein the image composing unit performs one of the composition image generating process of a three-dimensional image and the composition image generating process of a two-dimensional panoramic image in a case where the turning momentum (θ) detected by the turning momentum detecting unit is not zero, and the translational momentum (t) detected by the translational momentum detecting unit is not zero.

### Claim 7 (depends on 6)

The image processing apparatus according to claim 6, wherein, in a case where case where the turning momentum (θ) detected by the turning momentum detecting unit is not zero, and the translational momentum (t) detected by the translational momentum detecting unit is not zero, the image composing unit performs a process in which LR images of the 3D image, which are to be generated, are reversely set in a case where θ·t<0 and in a case where θ·t>0.

### Claim 8 (depends on 2)

The image processing apparatus according to claim 2, wherein the turning momentum detecting unit is a sensor that detects the turning momentum of the image processing apparatus.

### Claim 9 (depends on 2)

The image processing apparatus according to claim 2, wherein the translational momentum detecting unit is a sensor that detects the translational momentum of the image processing apparatus.

### Claim 10 (depends on 2)

The image processing apparatus according to claim 2, wherein the turning momentum detecting unit is an image analyzing unit that detects the turning momentum at the time of capturing an image by analyzing captured images.

### Claim 11 (depends on 2)

The image processing apparatus according to claim 2, wherein the translational momentum detecting unit is an image analyzing unit that detects the translational momentum at the time of capturing an image by analyzing captured images.

### Claim 12 (depends on 1)

An imaging apparatus comprising:
an imaging unit; and
an image processing unit that performs the image processing according to claim 1.

### Claim 13

An image processing method that is performed in an image processing apparatus, the image processing method comprising:
generating a composition image by connecting stripped areas that are cut out from each image of a plurality of images captured from mutually different positions by using an image composing unit,
wherein, in the generating of a composition image, one processing aspect is determined based on movement information of an imaging apparatus at the time of capturing an image from among (a) a composition image generating process of a left-eye composition image and a right-eye composition image that are used for displaying a three-dimensional image, (b) a composition image generating process of a two-dimensional panoramic image, and (c) stopping composition image generating, and the determined process is performed.

### Claim 14

A non-transitory computer readable medium including computer executable instructions that cause an image processing apparatus to perform image processing, the program causing an image composing unit to perform generating a composition image by connecting stripped areas that are cut out from each of a plurality of images captured from mutually different positions,
wherein, in the generating of a composition image, one processing aspect is determined based on movement information of an imaging apparatus at the time of capturing an image from among (a) a composition image generating process of a left-eye composition image and a right-eye composition image that are used for displaying a three-dimensional image, (b) a composition image generating process of a two-dimensional panoramic image, and (c) stopping composition image generating, and the determined process is performed.
