Display system
AssigneeTexas Instruments Incorporated
InventorsJeff Kempf, Dan Morgan
Life of this patent
Estimating the term…
Abstract
Systems and method for image generation in a gaze tracking display. A gaze tracking display system includes a graphics processor and display circuitry. The graphics processor is configured to perform foveated rendering of image data, and to output foveated image data. The display circuitry is coupled to the graphics processor. The display circuitry includes a display device and a display controller. The display device is configured to produce a viewable image. The display controller is configured to drive the display device. The display controller includes foveated data reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data received from the graphics processor.
Claims15
A gaze tracking display system, comprising:
- a graphics processor configured to:
- perform foveated rendering of image data;
- and
- output foveated image data;
- display circuitry coupled to the graphics processor, the display circuitry including:
- a display device configured to produce a viewable image;
- and
- a display controller configured to drive the display device, the display controller including foveated data reconstruction circuitry and a frame buffer coupled to the foveated data reconstruction circuitry;
- the foveated data reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data from the graphics processor;
- and
- the frame buffer configured to store the foveated image data from the graphics processor, provide the stored foveated image data to the foveated data reconstruction circuitry, and store no more than one-quarter of the pixel data of the image at the resolution of the display device.
A gaze tracking display system, comprising:
- a graphics processor configured to:
- perform foveated rendering of image data;
- and
- output foveated image data;
- display circuitry coupled to the graphics processor, the display circuitry including:
- a display device configured to produce a viewable image;
- and
- a display controller configured to drive the display device, the display controller including foveated data reconstruction circuitry and a frame buffer coupled to the foveated data reconstruction circuitry;
- the foveated data reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data from the graphics processor;
- the frame buffer configured to store the foveated image data from the graphics processor, provide the stored foveated image data to the foveated data reconstruction circuitry, and store no more than one-sixth of the pixel data of the image at the resolution of the display device.
A gaze tracking display system, comprising:
- a graphics processor configured to:
- perform foveated rendering of image data;
- and
- output foveated image data;
- display circuitry coupled to the graphics processor, the display circuitry including:
- a display device configured to produce a viewable image;
- and
- a display controller configured to drive the display device, the display controller including foveated data reconstruction circuitry and a frame buffer coupled to the foveated data reconstruction circuitry;
- the foveated data reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data from the graphics processor;
- the frame buffer configured to store the foveated image data from the graphics processor and provide the stored foveated image data to the foveated data reconstruction circuitry;
- and
- the display controller configured to convert the foveated image data stored in the frame buffer as values of luminance and chrominance to red-green-blue encoded data before transferring the foveated image data to the foveated data reconstruction circuitry.
A gaze tracking display system, comprising:
- a graphics processor configured to:
- perform foveated rendering of image data;
- and
- output foveated image data;
- display circuitry coupled to the graphics processor, the display circuitry including:
- a display device configured to produce a viewable image;
- and
- a display controller configured to drive the display device, the display controller including foveated data reconstruction circuitry and a frame buffer coupled to the foveated data reconstruction circuitry;
- the foveated data reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data from the graphics processor;
- the frame buffer configured to store the foveated image data from the graphics processor and provide the stored foveated image data to the foveated data reconstruction circuitry;
- the graphics processor configured to:
- generate a foveation header for the foveated image data, the foveation header including spatial replication information for each block of the foveated image data;
- and
- provide the foveation header to the display controller in conjunction with the foveated image data;
- and
- the display controller configured to apply the spatial replication information to reconstruct the image at the resolution of the display device from the foveated image data.
A gaze tracking display system, comprising:
- a graphics processor configured to:
- perform foveated rendering of image data;
- and
- output foveated image data;
- display circuitry coupled to the graphics processor, the display circuitry including:
- a display device configured to produce a viewable image;
- and
- a display controller configured to drive the display device, the display controller including foveated data reconstruction circuitry and a frame buffer coupled to the foveated data reconstruction circuitry;
- the foveated data reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data from the graphics processor;
- the frame buffer configured to store the foveated image data from the graphics processor and provide the stored foveated image data to the foveated data reconstruction circuitry;
- and
- the foveated data reconstruction circuitry configured to:
- receive the foveated image data from the graphics processor;
- perform pixel replication to produce the image at the resolution of the display device;
- and
- store the image at the resolution of the display device in the frame buffer.
A method for generating an image display, the method comprising:
- performing, by a graphics processor, foveated rendering of image data to produce foveated image data;
- transferring the foveated image data from the graphics processor to a display controller that drives a display device;
- generating, by the display controller, an output image at a resolution of the display device from the foveated image data from the graphics processor;
- displaying, by the display device, the output image;
- storing the foveated image data in a frame buffer at an input of the display controller, and providing the foveated data from the frame buffer to be processed as input to the generating;
- and
- converting the foveated image data stored in the frame buffer as values of luminance and chrominance to red-green-blue encoded data before the generating.
A method for generating an image display, the method comprising:
- performing, by a graphics processor, foveated rendering of image data to produce foveated image data;
- transferring the foveated image data from the graphics processor to a display controller that drives a display device;
- generating, by the display controller, an output image at a resolution of the display device from the foveated image data from the graphics processor;
- displaying, by the display device, the output image;
- storing the foveated image data in a frame buffer at an input of the display controller, and providing the foveated data from the frame buffer to be processed as input to the generating;
- generating, by the graphics processor, a foveation header for the foveated image data, the foveation header including spatial replication information for each pixel of the foveated image data;
- providing, by the graphics processor, the foveation header to the display controller in conjunction with the foveated image data;
- and
- applying, by the display controller, the spatial replication information to reconstruct the output image at the resolution of the display device from the foveated image data.
A display system, comprising:
- a display device configured to produce a viewable image;
- and
- a display controller configured to drive the display device, the display controller including:
- a frame buffer configured to store foveated image data from a graphics processor;
- and
- foveated data reconstruction circuitry coupled to an output of the frame buffer, the foveated data reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data stored in the frame buffer;
- the display controller configured to convert the foveated image data stored in the frame buffer as values of luminance and chrominance to red-green-blue encoded data before transferring the foveated image data to the foveated data reconstruction circuitry.
A display system, comprising:
- a display device configured to produce a viewable image;
- and
- a display controller configured to drive the display device, the display controller including:
- a frame buffer configured to store foveated image data from a graphics processor;
- and
- foveated data reconstruction circuitry coupled to an output of the frame buffer, the foveated data reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data stored in the frame buffer;
- the display controller configured to:
- receive a foveation header in conjunction with the foveated image data, the foveation header including:
- spatial replication information for each block of the foveated image data;
- and
- temporal replication information for each block of the foveated image data;
- and
- apply the spatial replication information to reconstruct the image at the resolution of the display device from the foveated image data;
- and
- apply the temporal replication information to control writing of the foveated image data to the frame buffer.
Dependencies are inferred from the claim text.