# US 10,770,032 B2 · Method and apparatus for processing image in virtual reality system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,770,032 B2
- Document ID: US10770032B2
- Status: Granted
- Kind: B2
- Application number: 15/998,936
- Filed: 2017-02-17
- Published: 2019-06-27
- Granted: 2020-09-08
- Earliest claimed: 2016-02-17
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Eric Yip; Byeong-Doo Choi
- Web page: https://patentgrep.com/patent/US10770032B2

## CPC

- G09G 5/14: Display of multiple viewports
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G09G 5/373: for modifying the size of the graphic pattern
- H04N 5/262: Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects}
- H04N 5/265: Mixing
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 23/60: Control of cameras or camera modules
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 5/20: using local operators
- G06T 5/70: Denoising; Smoothing
- G06T 5/73: Deblurring; Sharpening
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20192: Edge enhancement; Edge preservation
- G09G 2320/0276: for the purpose of adaptation to the characteristics of a display device, i.e. gamma correction
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G09G 2320/0686: with two or more screen areas displaying information with different brightness or colours
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure proposes a solution in which an electronic device configures at least one view window existing in an image frame including a plurality of post-processing areas, identifies a plurality of division areas obtained by dividing the configured view window by the plurality of post-processing areas, obtains a compensation parameter on the basis of the plurality of identified division areas, and processes an image in the view window using the obtained compensation parameter.

## Claims

### Claim 1

A method for processing an image frame for a virtual reality content in an electronic device, comprising:
setting a view window in an image frame corresponding to a 360 degree image, the image frame including a plurality of first areas;
identifying at least one second area in an image which is a part of the image frame within the view window, wherein each of the at least one second area corresponds to a part of an area among the plurality of first areas, and the part of the area among the plurality of areas is within the view window;
obtaining at least one compensation parameter based on the at least one second area; and
processing the image within the view window using the obtained at least one compensation parameter,
wherein the at least one compensation parameter is based on at least one parameter set for each of the at least one second areas and a ratio of a size of each of the at least one second areas with respect to a size of the view window.

### Claim 2 (depends on 1)

The method of claim 1, wherein the obtaining of the at least one compensation parameter comprises:
detecting a first area which overlaps the view window from the plurality of first areas; and
setting a parameter of a target second area which is a part of the detected first area within the view window, based on a parameter which is preset for the detected first area.

### Claim 3 (depends on 2)

The method of claim 2, wherein the obtaining of the at least one compensation parameter comprises:
calculating the ratio which each of the at least one second area has within the view window.

### Claim 4 (depends on 3)

The method of claim 3, wherein the obtaining of the at least one compensation parameter for the view window comprises obtaining a weight to be applied to parameters which are set for each of the at least one second area by considering the ratio which is calculated for each of the at least one second area.

### Claim 5 (depends on 1)

The method of claim 1,
wherein the at least one compensation parameter is one of a parameter value of an area which is located at a center of the view window, a parameter value of an area with a largest proportion among areas included in the view window, and a predetermined parameter value, and
wherein the at least one compensation parameter includes at least one of illumination, a deblocking filter parameter, a sharpening parameter, an unsharpening parameter, a blurring parameter, a denoising parameter, a color, a gamma correction parameter, and light.

### Claim 6 (depends on 1)

The method of claim 1, wherein the processing of the image within the view window comprises:
determining a size of an edge area which exists in the at least one second area;
calculating a compensation parameter to be applied to the edge area by considering the determined size of the edge area; and
processing an image of the edge area using the calculated compensation parameter.

### Claim 7 (depends on 6)

The method of claim 6, wherein the size of the edge area is determined by considering a weight which is determined based on at least one of a random value, a zoom level of the view window, a height of the view window, and a width of the view window.

### Claim 8 (depends on 6)

The method of claim 6, wherein the processing of the image within the view window comprises processing an image of a remaining part except for the edge area within the view window using a parameter set for the remaining part.

### Claim 9 (depends on 1)

The method of claim 1, wherein the at least one compensation parameter is one of a parameter value of an area which is located at a center of the view window, a parameter value of an area with a largest proportion among areas included in the view window, and a predetermined parameter value.

### Claim 10 (depends on 1)

The method of claim 1, wherein the at least one compensation parameter includes at least one of illumination, a deblocking filter parameter, a sharpening parameter, an unsharpening parameter, a blurring parameter, a denoising parameter, a color, a gamma correction parameter, and light.

### Claim 11

An electronic device for processing an image frame for a virtual reality content, comprising:
a controller configured to:
set a view window in an image frame corresponding to a 360 degree image, the image frame including a plurality of first areas,
identify at least one second area in an image which is a part of the image frame within the view window, wherein the at least one second area corresponds to a part of an area among the plurality of first areas, and the part of the area among the plurality of areas is within the view window,
obtain at least one compensation parameter based on the at least one second area, and
process the image within the view window using the obtained at least one compensation parameter; and
a display unit configured to display the processed image,
wherein the at least one compensation parameter is based on at least one parameter set for each of the at least one second area and a ratio of a size of each of the at least one second area with respect to a size of the view window.

### Claim 12 (depends on 11)

The electronic device of claim 11, wherein the controller is further configured to:
detect a first area which overlaps the view window from the plurality of first areas, and
set a parameter of a target second area which is a part of the detected first area within the view window, based on a parameter which is preset for the detected first area.

### Claim 13 (depends on 12)

The electronic device of claim 12, wherein the controller is further configured to:
calculate the ratio which each of the at least one second area has within the view window.

### Claim 14 (depends on 13)

The electronic device of claim 13, wherein the controller is further configured to obtain a weight to be applied to parameters which are set for each of the at least one second area by considering the ratio which is calculated for each of the at least one second area.

### Claim 15 (depends on 11)

The electronic device of claim 11,
wherein the at least one compensation parameter is one of a parameter value of an area which is located at a center of the view window, a parameter value of an area with a largest proportion among areas included in the view window, and a predetermined parameter value, and
wherein the at least one compensation parameter includes at least one of illumination, a deblocking filter parameter, a sharpening parameter, an unsharpening parameter, a blurring parameter, a denoising parameter, a color, a gamma correction parameter, and light.

### Claim 16 (depends on 11)

The electronic device of claim 11, wherein the controller is further configured to:
determine a size of an edge area which exists in the at least one second areas,
calculate a compensation parameter to be applied to the edge area by considering the determined size of the edge area, and
process an image of the edge area using the calculated compensation parameter.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein the controller is further configured to process an image of a remaining part except for the edge area within the view window using a parameter set for the remaining part.

### Claim 18 (depends on 11)

The electronic device of claim 11, wherein the at least one compensation parameter is one of a parameter value of an area which is located at a center of the view window, a parameter value of an area with a largest proportion among areas included in the view window, and a predetermined parameter value.

### Claim 19 (depends on 11)

The electronic device of claim 11, wherein the at least one compensation parameter includes at least one of illumination, a deblocking filter parameter, a sharpening parameter, an unsharpening parameter, a blurring parameter, a denoising parameter, a color, a gamma correction parameter, and light.

### Claim 20 (depends on 16)

The electronic device of claim 16, wherein the size of the edge area is determined by considering a weight which is determined based on at least one of a random value, a zoom level of the view window, a height of the view window, and a width of the view window.