# US 2021/0263755 A1 · Apparatus and method for a virtualized display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0263755 A1
- Document ID: US20210263755A1
- Status: Published application
- Kind: A1
- Application number: 17/256,204
- Filed: 2018-11-30
- Published: 2021-08-26
- Earliest claimed: 2018-11-30
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Kun TIAN; Ankur SHAH; David COWPERTHWAITE; Zhi WANG; Zhenyu WANG; Kalyan KONDAPALLY; Jonathan BLOOMFIELD; Wei ZHANG
- Web page: https://patentgrep.com/patent/US20210263755A1

## CPC

- G06F 9/45558: {Hypervisor-specific management and integration aspects}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06F 3/1407: {General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros}
- G06F 9/4411: {Configuring for operating with peripheral devices; Loading of device drivers}
- G06F 9/452: {Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131)}
- G06F 9/455: Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G09G 5/001: {Arbitration of resources in a display system, e.g. control of access to frame buffer by video controller and/or main processor}
- G09G 5/006: {Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04)}
- G09G 5/363: {Graphics controllers}
- G06F 2009/45562: {Creating, deleting, cloning virtual machine instances}
- G06F 2009/45595: {Network integration; Enabling network access in virtual machine instances}
- G09G 5/393: Arrangements for updating the contents of the bit-mapped memory
- G09G 5/395: Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen (G09G5/399 takes precedence)
- G09G 2370/022: Centralised management of display operation, e.g. in a server instead of locally
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Apparatus and method for implementing a virtual display. For example, one embodiment of a graphics processing apparatus comprises at least one configuration register to store framebuffer descriptor information for a first guest running on a first virtual machine (VM) in a virtualized execution environment of a host processor, the framebuffer descriptor information to indicate one or more display pipes assigned to the first guest; and execution circuitry to execute a first driver assigned to the first guest, the first guest to use the first driver to display a framebuffer in a plane associated with one of the display pipes in accordance with the framebuffer descriptor information.

## Claims

### Claim 1

A graphics processing apparatus comprising:
at least one configuration register to store framebuffer descriptor information for a first guest running on a first virtual machine (VM) in a virtualized execution environment of a host processor, the framebuffer descriptor information to indicate one or more display pipes assigned to the first guest; and
execution circuitry to execute a first driver assigned to the first guest, the first guest to use the first driver to display a framebuffer in a plane associated with one of the display pipes in accordance with the framebuffer descriptor information.

### Claim 2 (depends on 1)

The graphics processing apparatus of claim 1 wherein the first driver comprises a virtual display driver (VDD) associated with the first VM, and wherein a request to display the framebuffer is to be trapped by a hypervisor and sent to a physical function (PF) driver of a second VM, wherein the PF driver is to cause the framebuffer to be displayed in accordance with the framebuffer descriptor information.

### Claim 3 (depends on 2)

The graphics processing apparatus of claim 2 wherein the PF driver is to identify a storage location of the framebuffer from the framebuffer descriptor information.

### Claim 4 (depends on 1)

The graphics processing apparatus of claim 1 wherein the framebuffer descriptor information includes indications of display pipes and planes associated with a particular virtual function (VF) assigned to the first guest.

### Claim 5 (depends on 4)

The graphics processing apparatus of claim 4 further comprising:
virtual display management hardware logic to manage pipe and plane assignment for each VF, the virtual display management hardware logic to associate each VF with one or more virtual display pipes and planes.

### Claim 6 (depends on 5)

The graphics processing apparatus of claim 5 wherein the virtual display management hardware logic is to store the association between each VF and one or more virtual display pipes and planes in the framebuffer descriptor.

### Claim 7 (depends on 2)

The graphics processing apparatus of claim 2 wherein the VDD is to generate a page flip operation to directly post the framebuffer to a local display.

### Claim 8 (depends on 1)

The graphics processing apparatus of claim 1 wherein the PF driver is to cause the framebuffer to be displayed on a remote display in accordance with the framebuffer descriptor information.

### Claim 9 (depends on 1)

The graphics processing apparatus of claim 1 wherein the host processor and execution circuitry are integral to an in-vehicle information (IVI) system and wherein the first VM comprises an instrument cluster VM, wherein a second VM comprises an infotainment VM.

### Claim 10

A method comprising:
generating framebuffer descriptor information for a first guest running on a first virtual machine (VM) in a virtualized execution environment of a host processor, the framebuffer descriptor information to indicate one or more display pipes assigned to the first guest;
storing the framebuffer descriptor information in a configuration register; and
displaying by a first driver associated with the first guest a framebuffer in a plane associated with one of the display pipes in accordance with the framebuffer descriptor information.

### Claim 11 (depends on 10)

The method of claim 10 wherein the first driver comprises a virtual display driver (VDD) associated with the first VM, and wherein a request to display the framebuffer is to be trapped by a hypervisor and sent to a physical function (PF) driver of a second VM, wherein the PF driver is to cause the framebuffer to be displayed in accordance with the framebuffer descriptor information.

### Claim 12 (depends on 11)

The method of claim 11 wherein the PF driver is to identify a storage location of the framebuffer from the framebuffer descriptor information.

### Claim 13 (depends on 10)

The method of claim 10 wherein the framebuffer descriptor information includes indications of display pipes and planes associated with a particular virtual function (VF) assigned to the first guest.

### Claim 14 (depends on 13)

The method of claim 13 further comprising:
associating each VF with one or more virtual display pipes and planes.

### Claim 15 (depends on 14)

The method of claim 14 further comprising:
storing the association between each VF and one or more virtual display pipes and planes in the framebuffer descriptor.

### Claim 16 (depends on 11)

The method of claim 11 wherein the VDD is to generate a page flip operation to directly post the framebuffer to a local display.

### Claim 17 (depends on 10)

The method of claim 10 wherein the PF driver is to cause the framebuffer to be displayed on a remote display in accordance with the framebuffer descriptor information.

### Claim 18 (depends on 10)

The method of claim 10 wherein the host processor and execution circuitry are integral to an in-vehicle information (IVI) system and wherein the first VM comprises an instrument cluster VM, wherein a second VM comprises an infotainment VM.

### Claim 19

A machine-readable medium having program code stored thereon which, when executed by a machine, causes the machine to perform the operations of:
generating framebuffer descriptor information for a first guest running on a first virtual machine (VM) in a virtualized execution environment of a host processor, the framebuffer descriptor information to indicate one or more display pipes assigned to the first guest;
storing the framebuffer descriptor information in a configuration register; and
displaying by a first driver associated with the first guest a framebuffer in a plane associated with one of the display pipes in accordance with the framebuffer descriptor information.

### Claim 20 (depends on 19)

The machine-readable medium of claim 19 wherein the first driver comprises a virtual display driver (VDD) associated with the first VM, and wherein a request to display the framebuffer is to be trapped by a hypervisor and sent to a physical function (PF) driver of a second VM, wherein the PF driver is to cause the framebuffer to be displayed in accordance with the framebuffer descriptor information.

### Claim 21 (depends on 20)

The machine-readable medium of claim 20 wherein the PF driver is to identify a storage location of the framebuffer from the framebuffer descriptor information.

### Claim 22 (depends on 19)

The machine-readable medium of claim 19 wherein the framebuffer descriptor information includes indications of display pipes and planes associated with a particular virtual function (VF) assigned to the first guest.

### Claim 23 (depends on 22)

The machine-readable medium of claim 22 further comprising program code to cause the machine to perform the operations of:
associating each VF with one or more virtual display pipes and planes.

### Claim 24 (depends on 23)

The machine-readable medium of claim 23 further comprising program code to cause the machine to perform the operations of:
storing the association between each VF and one or more virtual display pipes and planes in the framebuffer descriptor.

### Claim 25 (depends on 20)

The machine-readable medium of claim 20 wherein the VDD is to generate a page flip operation to directly post the framebuffer to a local display.

### Claim 26 (depends on 19)

The machine-readable medium of claim 19 wherein the PF driver is to cause the framebuffer to be displayed on a remote display in accordance with the framebuffer descriptor information.

### Claim 27 (depends on 19)

The machine-readable medium of claim 19 wherein the host processor and execution circuitry are integral to an in-vehicle information (IVI) system and wherein the first VM comprises an instrument cluster VM, wherein a second VM comprises an infotainment VM.
