# US 10,504,259 B2 · Separately processing regions or objects or interest from a render engine to a display engine or a display panel

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,504,259 B2
- Document ID: US10504259B2
- Status: Granted
- Kind: B2
- Application number: 15/494,594
- Filed: 2017-04-24
- Published: 2018-10-25
- Granted: 2019-12-10
- Earliest claimed: 2017-04-24
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Joydeep Ray
- Web page: https://patentgrep.com/patent/US10504259B2

## CPC

- G06F 3/1438: {using more than one graphics controller}
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 7/254: involving subtraction of images
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 15/00: Three-dimensional [3D] image rendering
- G06T 15/005: {General purpose rendering architectures}
- G09G 5/39: Control of the bit-mapped memory
- G06T 2200/28: involving image processing hardware
- G09G 5/001: {Arbitration of resources in a display system, e.g. control of access to frame buffer by video controller and/or main processor}
- G09G 2340/0435: Change or adaptation of the frame rate of the video stream
- G09G 2352/00: Parallel handling of streams of display data
- G09G 2360/06: Use of more than one graphics processor to process data before displaying to one or more screens
- G09G 2360/08: Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs
- G09G 2360/121: using a cache memory
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Video or graphics, received by a render engine within a graphics processing unit, may be segmented into a region of interest such as foreground and a region of less interest such as background. In other embodiments, an object of interest may be segmented from the rest of the depiction in a case of a video game or graphics processing workload. Each of the segmented portions of a frame may themselves make up a separate surface which is sent separately from the render engine to the display engine of a graphics processing unit. In one embodiment, the display engine combines the two surfaces and sends them over a display link to a display panel. The display controller in the display panel displays the combined frame. The combined frame is stored in a buffer and refreshed periodically. In accordance with another embodiment, video or graphics may be segmented by a render engine into regions of interest or objects of interest and objects not of interest and again each of the separate regions or objects may be transferred to the display engine as a separate surface. Then the display engine may transfer the separate surfaces to a display controller of a display panel over a display link. At the display panel, a separate frame buffer may be used for each of the separate surfaces.

## Claims

### Claim 1

A method comprising:
determining whether a display panel is capable of buffering display surfaces separately;
segmenting a portion of a frame into two separate surfaces in a render engine of a graphics processing unit; and
transmitting the surfaces separately to a display engine in the graphics processing unit.

### Claim 2 (depends on 1)

The method of claim 1 including recombining the surfaces in the display engine.

### Claim 3 (depends on 1)

The method of claim 1 including sending the separate surfaces separately out over a display link.

### Claim 4 (depends on 3)

The method of claim 3 including exchanging information with the display panel to enable the display panel to combine the surfaces.

### Claim 5 (depends on 3)

The method of claim 3 including separately refreshing the surfaces over the display link.

### Claim 6 (depends on 1)

The method of claim 1 including refreshing the two surfaces at different rates.

### Claim 7 (depends on 1)

The method of claim 1 including segmenting based on how much each pixel changes from frame to frame.

### Claim 8 (depends on 1)

The method of claim 1 including segmenting objects or regions of a frame based on whether they are foreground or background pixels.

### Claim 9 (depends on 1)

The method of claim 1 including increasing the sampling rate of foreground pixels without changing the sampling rate for background pixels.

### Claim 10 (depends on 1)

The method of claim 1 including enabling an application to identify objects of interest and segmenting those objects of interest from a remainder of a frame.

### Claim 11

One or more non-transitory computer readable media storing instructions to perform a sequence comprising:
determining whether a display panel is capable of buffering display surfaces separately;
segmenting a portion of a frame into two separate surfaces in a render engine of a graphics processing unit; and
transmitting the surfaces separately to a display engine in the graphics processing unit.

### Claim 12 (depends on 11)

The media of claim 11, further storing instructions to perform a sequence including recombining the surfaces in the display engine.

### Claim 13 (depends on 11)

The media of claim 11, further storing instructions to perform a sequence including sending the separate surfaces separately out over a display link.

### Claim 14 (depends on 13)

The media of claim 13, further storing instructions to perform a sequence including exchanging information with the display panel to enable the display panel to combine the surfaces.

### Claim 15 (depends on 13)

The media of claim 13, further storing instructions to perform a sequence including separately refreshing the surfaces over the display link.

### Claim 16 (depends on 11)

The media of claim 11, further storing instructions to perform a sequence including refreshing the two surfaces at different rates.

### Claim 17 (depends on 11)

The media of claim 11, further storing instructions to perform a sequence including segmenting based on how much each pixel changes from frame to frame.

### Claim 18 (depends on 11)

The media of claim 11, further storing instructions to perform a sequence including enabling an application to identify objects of interest and segmenting those objects of interest from a remainder of a frame.

### Claim 19

An apparatus comprising:
a graphics processing unit to determine whether a display panel is capable of buffering display surfaces separately, segment a portion of a frame into two separate surfaces in a render engine of the graphics processing unit, transmit the surfaces separately to a display engine in the graphics processing unit; and
a memory coupled to said graphics processing unit.

### Claim 20 (depends on 19)

The apparatus of claim 19, said graphics processing unit to recombine the surfaces in the display engine.

### Claim 21 (depends on 19)

The apparatus of claim 19, said graphics processing unit to send the separate surfaces separately out over a display link.

### Claim 22 (depends on 21)

The apparatus of claim 21, said graphics processing unit to exchange information with the display panel to enable the display panel to combine the surfaces.

### Claim 23 (depends on 21)

The apparatus of claim 21, said graphics processing unit to separately refresh the surfaces over the display link.

### Claim 24 (depends on 19)

The apparatus of claim 19, said graphics processing unit to refresh the two surfaces at different rates.

### Claim 25 (depends on 19)

The apparatus of claim 19, said graphics processing unit to segment based on how much each pixel changes from frame to frame.

### Claim 26 (depends on 19)

The apparatus of claim 19, said graphics processing unit to segment objects or regions of a frame based on whether they are foreground or background pixels.

### Claim 27 (depends on 21)

The apparatus of claim 21, said graphics processing unit to increase the sampling rate of foreground pixels without changing the sampling rate for background pixels.