# US 2018/0322685 A1 · Methods of compressing a texture image and image data processing system and methods of generating a 360 degree panoramic video thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322685 A1
- Document ID: US20180322685A1
- Status: Published application
- Kind: A1
- Application number: 15/599,838
- Filed: 2017-05-19
- Published: 2018-11-08
- Earliest claimed: 2017-05-05
- Assignees: Via Alliance Semiconductor Co., Ltd.
- Applicants: VIA Alliance Semiconductor Co., Ltd.
- Inventors: Yiting YI; Gong CHEN; Rong XIE
- Web page: https://patentgrep.com/patent/US20180322685A1

## CPC

- G06T 15/04: Texture mapping
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 13/261: with monoscopic-to-stereoscopic image conversion
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of compressing a texture image for use in generating a 360 degree panoramic video is provided. The method including the steps of: receiving an original texture image for a sphere model, wherein the original texture image is an image with a rectangular shape and includes a plurality of pixel lines and each of the pixels lines has a corresponding spherical position on the sphere model; determining a compression ratio of each of the pixel lines according to the corresponding spherical position of each of the pixel lines; and compressing the pixel lines with the compression ratios corresponding thereto to generate a compressed texture image with a non-rectangular shape, wherein the compressed texture image is further being mapped to the sphere model to generate the 360 degree panoramic video.

## Claims

### Claim 1

A method of compressing a texture image for use in generating a 360 degree panoramic video, comprising:
receiving an original texture image for a sphere model, wherein the original texture image is an image with a rectangular shape and includes a plurality of pixel lines and each of the pixels lines has a corresponding spherical position on the sphere model;
determining a corresponding compression ratio of each of the pixel lines according to the corresponding spherical position of each of the pixel lines; and
compressing the pixel lines with the compression ratios corresponding thereto to generate a compressed texture image with a non-rectangular shape,
wherein the compressed texture image is further being mapped to the sphere model to generate the 360 degree panoramic video.

### Claim 2 (depends on 1)

The method of compressing a texture image of claim 1, wherein the pixel lines comprise at least one first pixel line whose corresponding spherical position is close to one of two poles of the sphere model and one second pixel line whose corresponding spherical position is far away from the two poles of the sphere model, and the corresponding compression ratio of the first pixel line is greater than the corresponding compression ratio of the second pixel line.

### Claim 3 (depends on 1)

The method of compressing a texture image of claim 1, wherein the original texture image has a height value and a width value and the sphere model is divided into a plurality of rings of latitude line along the latitude line direction, and the step of determining the corresponding compression ratio of each of the pixel lines according to the corresponding spherical position of each of the pixel lines further comprises, for each pixel line:
determining a corresponding ring of latitude line among the rings of latitude line according to the corresponding spherical position of each pixel line;
determining the number of pixels based on the height value, the width value, and the circumference of the corresponding ring of latitude line; and
determining the corresponding compression ratio of each pixel line according to the number of pixels of each pixel line and the width value, wherein the corresponding compression ratio of each pixel line is inversely proportional to the number of pixels of each pixel line.

### Claim 4 (depends on 3)

The method of compressing a texture image of claim 3, further comprising:
determining a start index value for each pixel line based on the number of pixels of each pixel line and the width value;
determining an end index value for each pixel line based on the number of pixels and the start index value of each pixel line,
wherein each pixel line has a corresponding pixel line in the compressed texture image, and the start index value and the end index value for each pixel line represent a start pixel position and an end pixel position of effective pixels stored in the corresponding pixel line, respectively.

### Claim 5 (depends on 4)

The method of compressing a texture image of claim 4, wherein the corresponding pixel line for each pixel line comprises a plurality of pixels and each pixel has a respective pixel position, and the method further comprises:
determining a pixel value for the respective pixel position of each pixel in the corresponding pixel lines based on the start index value and the end index value of each pixel line and the respective pixel position of the pixel.

### Claim 6 (depends on 5)

The method of compressing a texture image of claim 5, wherein the step of determining the pixel value for the respective pixel position of each pixel in the corresponding pixel lines based on the start index value and the end index value of each pixel line and the respective pixel position of the pixel further comprises, for the respective pixel position of each pixel:
setting the pixel value as a black pixel value when a value of the respective pixel position is smaller than the start index value or the value of the respective pixel position is greater than the end index value.

### Claim 7 (depends on 6)

The method of compressing a texture image of claim 6, further comprising:
performing a grouping procedure to divide the pixel line corresponding to the start index value into a plurality of groups based on the corresponding compression ratio of the pixel line corresponding to the start index value and setting the pixel value as a pixel value of a specified pixel position in a corresponding one of the groups when the value of the respective pixel position is a value between the start index value and the end index value.

### Claim 8

An image data processing system, at least comprising:
a storage unit, configured to store at least one original texture image for a sphere model, wherein the original texture image is an image with a rectangular shape and includes a plurality of pixel lines and each of the pixels lines has a corresponding spherical position on the sphere model; and
a processor coupled to the storage unit, configured to receive the original texture image, determine a corresponding compression ratio of each of the pixel lines according to the corresponding spherical position of each of the pixel lines, and compress the pixel lines with the compression ratios corresponding thereto to generate a compressed texture image with a non-rectangular shape and store the compressed texture image into the storage unit.

### Claim 9 (depends on 8)

The image data processing system of claim 8, further comprising a graphics processing unit coupled to the storage unit for obtaining the compressed texture image from the storage unit and mapping the compressed texture image into the sphere model to generate a 360 degree panoramic video.

### Claim 10 (depends on 9)

The image data processing system of claim 9, further comprising a display device coupled to the graphics processing unit, wherein the graphics processing unit further determines a current viewing image of the 360 degree panorama video based on a user's viewing angle selection, and displays the determined viewing image on the display device.

### Claim 11 (depends on 8)

The image data processing system of claim 8, wherein the pixel lines comprise at least one first pixel line whose corresponding spherical position is close to one of two poles of the sphere model and one second pixel line whose corresponding spherical position is far away from the two poles of the sphere model, and the corresponding compression ratio of the first pixel line is greater than the corresponding compression ratio of the second pixel line.

### Claim 12 (depends on 8)

The image data processing system of claim 8, wherein the original texture image has a height value and a width value and the sphere model is divided into a plurality of rings of latitude line along the latitude line direction, and the processor further determines the corresponding compression ratio of each of the pixel lines according to the corresponding spherical position of each of the pixel lines by: determining, for each pixel line, a corresponding ring of latitude line among the rings of latitude line according to the corresponding spherical position of each pixel line; determining the number of pixels based on the height value, the width value, and the circumference of the corresponding ring of latitude line; and determining the corresponding compression ratio of each pixel line according to the number of pixels of each pixel line and the width value, wherein the corresponding compression ratio of each pixel line is inversely proportional to the number of pixels of each pixel line.

### Claim 13 (depends on 12)

The image data processing system of claim 12, wherein the processor further determines a start index value for each pixel line based on the number of pixels of each pixel line and the width value and determines an end index value for each pixel line based on the number of pixels and the start index value of each pixel line, wherein each pixel line has a corresponding pixel line in the compressed texture image, and the start index value and the end index value for each pixel line represent a start pixel position and an end pixel position of effective pixels stored in the corresponding pixel line, respectively.

### Claim 14 (depends on 13)

The image data processing system of claim 13, wherein the corresponding pixel line for each pixel line comprises a plurality of pixels and each pixel has a respective pixel position, and the processor further determines a pixel value for the respective pixel position of each pixel in the corresponding pixel lines based on the start index value and the end index value of each pixel line and the respective pixel position of the pixel.

### Claim 15 (depends on 14)

The image data processing system of claim 14, wherein the processor further determines the pixel value for the respective pixel position of each pixel in the corresponding pixel lines based on the start index value and the end index value of each pixel line and the respective pixel position of the pixel by: setting, for the respective pixel position of each pixel, the pixel value as a black pixel value when a value of the respective pixel position is smaller than the start index value or the value of the respective pixel position is greater than the end index value.

### Claim 16 (depends on 15)

The image data processing system of claim 15, wherein the processor further performs a grouping procedure to divide the pixel line corresponding to the start index value into a plurality of groups based on the corresponding compression ratio of the pixel line corresponding to the start index value and sets the pixel value as a pixel value of a specified pixel position in a corresponding one of the groups when the value of the respective pixel position is a value between the start index value and the end index value.

### Claim 17

A method of generating a 360 degree panoramic video, comprising:
receiving a compressed texture image, wherein the compressed texture image has a plurality of pixel lines i, each of the pixel lines i comprising a first number of pixels and each of the pixel lines i having a plurality of parameter values, wherein the parameter values of each pixel line i comprise the number of pixels being sampled, a first index value, and a second index value for the pixel line i;
performing a texture coordinate mapping according to the parameter values of each pixel line i to obtain mapping texture coordinates of the pixel line i;
configuring attributes of texture coordinates of each subdivided triangle on a sphere model based on the parameter values for each pixel line i; and
mapping each pixel line i of the compressed texture image to a corresponding position on the sphere model based on the parameter values and the mapping texture coordinates for the pixel line i to generate the 360 degree panoramic video.