# US 2021/0241724 A1 · Display system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241724 A1
- Document ID: US20210241724A1
- Status: Published application
- Kind: A1
- Application number: 17/238,023
- Filed: 2021-04-22
- Published: 2021-08-05
- Earliest claimed: 2017-12-28
- Assignees: Texas Instruments Incorporated
- Applicants: Texas Instruments Incorporated
- Inventors: Jeff Kempf; Dan Morgan
- Web page: https://patentgrep.com/patent/US20210241724A1

## CPC

- G09G 5/391: Resolution modifying circuits, e.g. variable screen formats
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G09G 5/363: {Graphics controllers}
- G09G 3/2051: {with use of a spatial dither pattern}
- G09G 2320/0242: Compensation of deficiencies in the appearance of colours
- G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G 2340/0435: Change or adaptation of the frame rate of the video stream
- G09G 2350/00: Solving problems of bandwidth in display systems
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/18: Use of a frame buffer in a display terminal, inclusive of the display panel
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and method for image generation in a gaze tracking display. A gaze tracking display system includes a graphics processor and display circuitry. The graphics processor is configured to perform foveated rendering of image data, and to output foveated image data. The display circuitry is coupled to the graphics processor. The display circuitry includes a display device and a display controller. The display device is configured to produce a viewable image. The display controller is configured to drive the display device. The display controller includes foveated data reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data received from the graphics processor.

## Claims

### Claim 1

A processor configured to:
perform foveated rendering of image data, to produce foveated image data;
produce a foveation header for the foveated image data, the header comprising spatial replication information for blocks of the foveated image data; and
output the foveated image data with the foveation header.

### Claim 2 (depends on 1)

The processor of claim 1, wherein the foveation header comprises information associated with blocks of the foveated image data.

### Claim 3 (depends on 2)

The processor of claim 2, wherein the information indicates a spatial decimation pattern applied in a block and whether the spatial decimation pattern is to be applied to an adjacent block.

### Claim 4 (depends on 2)

The processor of claim 2, wherein the information indicates whether a block is to be written to a frame buffer.

### Claim 5 (depends on 2)

The processor of claim 2, wherein the foveation header comprises a field specifying pixel format.

### Claim 6 (depends on 1)

The processor of claim 1, wherein outputting the foveation header comprises transmitting the foveation header in a vertical blanking time.

### Claim 7 (depends on 1)

The processor of claim 1, wherein outputting the foveated image data with the foveation header comprises transmitting the foveated image data with the foveation header over a display serial interface.

### Claim 8 (depends on 1)

The processor of claim 1, wherein performing foveated rendering of the image data comprises producing the foveated image data having:
a first resolution a first distance from a focal point of the user's gaze; and
a second resolution a second distance from the focal point of the user's gaze, the first distance less than the second distance and the first resolution higher than the second resolution.

### Claim 9 (depends on 1)

The processor of claim 1, wherein the foveated image data is a quarter or less an amount of data than the image data.

### Claim 10

A display controller configured to:
obtain foveated image data;
obtain a foveation header; and
reconstruct the foveated image data responsive to the foveation header to produce reconstructed image data.

### Claim 11 (depends on 10)

The display controller of claim 10, wherein the display controller is further configured to:
obtain foveated image data in YCrCb format; and
convert the foveated image data to produce the foveated image data in an RBG format.

### Claim 12 (depends on 10)

The display controller of claim 10, wherein reconstructing the foveated image data comprises performing spatial replication of the foveated image data.

### Claim 13 (depends on 10)

The display controller of claim 10, wherein reconstructing the foveated image data comprises performing temporal replication of the foveated image data.

### Claim 14 (depends on 10)

The display controller of claim 10, wherein converting the foveated image data comprises using a look-up table.

### Claim 15 (depends on 10)

The display controller of claim 10, wherein the reconstruction circuitry is configured to use a foveation header associated with the foveated image data to reconstruct the RGB format foveated data.

### Claim 16 (depends on 10)

The display controller of claim 10, wherein the frame buffer is configured to double buffer the foveated image data.

### Claim 17 (depends on 10)

The display controller of claim 10, further configured to transmit the reconstructed image data to a display device multiple times.

### Claim 18

A display controller comprising:
a frame buffer having a buffer input and a buffer output;
foveated image data reconstruction circuitry coupled to the buffer output, the foveated image data reconstruction circuitry comprising a pixel spatial replicator;
up-conversion circuitry coupled to the foveated image data reconstruction circuitry; and
display interface circuitry coupled to the up-conversion circuitry.

### Claim 19 (depends on 18)

The display controller of claim 18, wherein the foveated image data reconstructions circuitry further comprises:
a replication buffer coupled to the pixel spatial replicator;
color space conversion circuitry coupled to the replication buffer and to the frame buffer;
foveation map memory coupled to the buffer output and to the replication buffer; and
replication control coupled to the pixel spatial replicator and to the foveation map memory.

### Claim 20 (depends on 18)

The display controller of claim 18, wherein the pixel spatial replicator comprises:
flip-flops in a column buffer, the flip-flops configured to store pixel data of a display column; and
multiplexers coupled to the flip-flops, the multiplexers configured to route pixel values to the flip-flops.
