# US 2018/0322611 A1 · Image processing apparatus and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322611 A1
- Document ID: US20180322611A1
- Status: Published application
- Kind: A1
- Application number: 15/971,467
- Filed: 2018-05-04
- Published: 2018-11-08
- Earliest claimed: 2017-05-04
- Assignees: Electronics and Telecommunications Research Institute
- Applicants: Electronics and Telecommunications Research Institute
- Inventors: Gun BANG; Hui Yong KIM; Jin Soo CHOI; Jung Won KANG
- Web page: https://patentgrep.com/patent/US20180322611A1

## CPC

- G06T 3/12: Panospheric to cylindrical image transformations
- G06T 3/067: Reshaping or unfolding three-dimensional [3D] tree structures onto two-dimensional [2D] planes
- G06T 3/16: Spatio-temporal transformations, e.g. video cubism
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed is an apparatus and method of providing an image processing. An image processing method according to the present disclosure includes: obtaining at least one of image information and depth information of an omni-directional video; and mapping the obtained information to a three-dimensional coordinate system based on a particular three-dimensional figure.

## Claims

### Claim 1

An image processing method comprising:
obtaining at least one of image information and depth information of an omni-directional video; and
mapping the obtained information to a three-dimensional coordinate system based on a particular three-dimensional figure.

### Claim 2 (depends on 1)

The method of claim 1, wherein the three-dimensional figure is at least one of a sphere, a cube, a cuboid, and a cylinder.

### Claim 3 (depends on 1)

The method of claim 1, wherein when the three-dimensional figure is a sphere, the three-dimensional coordinate system based on the particular three-dimensional figure is a spherical coordinate system.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
mapping the image information to a pixel value on a surface of the spherical coordinate system when the obtained information is the image information of the omni-directional video.

### Claim 5 (depends on 3)

The method of claim 3, further comprising:
mapping the depth information to a distance in an inward direction or an outward direction from a surface of the spherical coordinate system when the obtained information is the depth information of the omni-directional video.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
mapping the obtained information to multiple three-dimensional coordinate systems based on a particular three-dimensional figure.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
mapping the obtained information to a multilayered spherical coordinate system when the three-dimensional figure is a sphere.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
transforming the information mapped to the multilayered spherical coordinate system into information on a two-dimensional plane; and
generating a common projection format by using the transformed information.

### Claim 9 (depends on 7)

The method of claim 7, further comprising:
based on the obtained information, setting different spacing between spherical coordinate systems that are at least part of the multilayered spherical coordinate system.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
obtaining parameter information of the omni-directional video.

### Claim 11 (depends on 10)

The method of claim 10, wherein when the three-dimensional coordinate system based on the particular three-dimensional figure is a multilayered spherical coordinate system, the parameter information is at least one selected from a group of the image information, the depth information, visible direction information, a number of spheres constituting the multilayered spherical coordinate system, a size of a sphere, distance scale information, and a projection manner to a two-dimensional plane.

### Claim 12

An image processing apparatus configured to:
obtain at least one of image information and depth information of an omni-directional video; and
map the obtained information to a three-dimensional coordinate system based on a particular three-dimensional figure.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the three-dimensional figure is at least one of a sphere, a cube, a cuboid, and a cylinder.

### Claim 14 (depends on 12)

The apparatus of claim 12, wherein when the three-dimensional figure is a sphere, the three-dimensional coordinate system based on the particular three-dimensional figure is a spherical coordinate system.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein when the obtained information is the image information of the omni-directional video, the image information is mapped to a pixel value on a surface of the spherical coordinate system.

### Claim 16 (depends on 14)

The apparatus of claim 14, wherein when the obtained information is the depth information of the omni-directional video, the depth information is mapped to a distance in an inward direction or an outward direction from a surface of the spherical coordinate system.

### Claim 17 (depends on 12)

The apparatus of claim 12, wherein the obtained information is mapped to multiple three-dimensional coordinate systems based on a particular three-dimensional figure.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein when the three-dimensional figure is a sphere, the obtained information is mapped to a multilayered spherical coordinate system.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the information mapped to the multilayered spherical coordinate system is transformed into information on a two-dimensional plane, and a common projection format is generated by using the transformed information.

### Claim 20 (depends on 12)

The apparatus of claim 12, wherein parameter information of the omni-directional video is obtained, and
when the three-dimensional coordinate system based on the particular three-dimensional figure is a multilayered spherical coordinate system, the parameter information is at least one selected from a group of the image information, the depth information, visible direction information, a number of spheres constituting the multilayered spherical coordinate system, a size of a sphere, distance scale information, and a projection manner to a two-dimensional plane.
