# US 2015/0177822 A1 · Application-transparent resolution control by way of command stream interception

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0177822 A1
- Document ID: US20150177822A1
- Status: Published application
- Kind: A1
- Application number: 14/576,248
- Filed: 2014-12-19
- Published: 2015-06-25
- Earliest claimed: 2008-08-20
- Assignees: Lucidlogix Technologies Ltd.
- Applicants: Lucidlogix Technologies Ltd.
- Inventors: Yoel Shoshan
- Web page: https://patentgrep.com/patent/US20150177822A1

## CPC

- G06F 1/3293: by switching to a less power-consuming processor, e.g. sub-CPU
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 15/005: {General purpose rendering architectures}
- G09G 5/363: {Graphics controllers}
- G06T 2200/04: involving 3D image data
- G06T 2210/36: Level of detail
- G09G 2360/06: Use of more than one graphics processor to process data before displaying to one or more screens
- G09G 2360/08: Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A method for controlling image resolution in graphics systems at runtime is provided. In use, the stream of commands and Shaders of the running application is intercepted and analyzed at run time. In the event that an on-the-fly change of resolution is required, the change is made by modification of the Shader assembly code or of the graphics library commands.

## Claims

### Claim 1

A computer-implemented method of optimizing the rendering and display of frames being rendered in a graphics systems based on user experience factors, comprising the steps of:
receiving one or more frames from the graphics system;
receiving and storing user experience factors;
defining threshold values based on one or more frame's user experience factors;
analyzing one or more of frame native factors and systems factors based on the defined threshold values;
providing an adjusting module and using that module to adjust the frame's user experience factors;
optionally rendering an adjusted back buffer based on the adjusted frame's user experience factors;
determining if a screen is available for display;
if a screen is available for display, transmitting the adjusted or unadjusted back buffer contents to the front frame for displaying the contents of the back buffer.

### Claim 2 (depends on 1)

The method of claim 1, wherein if a screen is not available, the contents of the back buffer are placed in a graphic pipeline queue.

### Claim 3 (depends on 1)

The method of claim 1, wherein the step of transmitting the adjusted back buffer to the frame buffer includes one of a present command or a swapBuffers command is sent to cause display of the adjusted back buffer.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
assessing in advance screen availability upon completion of a back buffer; and if the back buffer has a chance to be displayed, activating a data collector module such that the data collector module monitors internal frame's user experience factors and user inputs.

### Claim 5 (depends on 4)

The method of claim 4, wherein the monitored factors include one or more of: frame native factors, system factors and user inputs.

### Claim 6 (depends on 5)

The method of claim 5 wherein the frame native factors include one or more of: frame rate, image resolution, GPU utilization, GPU frequency, CPU utilization and backlight.

### Claim 7 (depends on 5)

The method of claim 5, wherein the systems factors include one or more of: response lag time, asset load time, heat, power consumption, temperature, charger availability, and battery level.

### Claim 8 (depends on 5)

The method of claim 5, wherein the user inputs include inputs coming from one or more of: a mouse, keyboard, joystick, any type of controller, and a headset tracking device.

### Claim 9 (depends on 4)

The method of claim 4, wherein the data collector module decouples frame native factors from their associated frame and the step of defining threshold values includes setting values defining the lowest allowable levels to at least one factor.

### Claim 10 (depends on 1)

The system of claim 1 wherein the step of analyzing includes comparing the frame native factors with threshold values to determine permitted ranges for adjusting frame native factors.

### Claim 11 (depends on 1)

The method of claim 1, wherein the adjusting module adjusts the frame native factors within the permitted ranges into a set of adjusted factors.

### Claim 12 (depends on 1)

The method of claim 1, wherein the data collector module further receives an input to reduce latency in the display of the frames of the back buffer.

### Claim 13

A system for optimimizing the rendering and display of frames being rendered in a graphics system based on user experience factors, the system comprising:
a graphics processing unit which provides one or more frames to be rendered;
a non-transitory memory for receiving and storing user experience factors;
the non-transitory memory containing instructions which, when the one or more frames are received from the graphics system, provides instructions to:
define threshold values based on one or more frame's user experience factors;
analyze one or more of frame native factors and systems factors based on the defined threshold values;
provide an adjusting module and using that module to adjust the frame's user experience factors;
optionally render an adjusted back buffer based on the adjusted frame's user experience factors;
determine if a screen is available for display; and,
if a screen is available for display, transmit the adjusted or unadjusted back buffer contents to the front frame for displaying the contents of the back buffer.

### Claim 14 (depends on 13)

The system of claim 13, wherein if a screen is not available, the contents of the back buffer are placed in a graphic pipeline queue.

### Claim 15 (depends on 13)

The system of claim 13, wherein the transmission of the adjusted or unadjusted back buffer to the front frame includes one of a present command or a swapBuffers command sent to cause display of the adjusted or unadjusted back buffer.

### Claim 16 (depends on 13)

The system of claim 13, further comprising:
assessing in advance screen availability upon completion of a back buffer; and
if the back buffer has a chance to be displayed, activating a data collector module such that the data collector module monitors internal frame's user experience factors and user inputs.

### Claim 17 (depends on 16)

The system of claim 16, wherein the monitored factors include one or more of: frame native factors, system factors and user inputs.

### Claim 18 (depends on 17)

The system of claim 17 wherein the frame native factors include one or more of: frame rate, image resolution, GPU utilization, GPU frequency, CPU utilization and backlight.

### Claim 19 (depends on 17)

The system of claim 17, wherein the systems factors include one or more of: response lag time, asset load time, heat, power consumption, temperature, charger availability, and battery level.

### Claim 20 (depends on 17)

The system of claim 17, wherein the user inputs include inputs coming from one or more of: a mouse, keyboard, joystick, any type of controller, and a headset tracking device.

### Claim 21 (depends on 16)

The system of claim 16, wherein the data collector decouples frame native factors from their associated frame and the step of defining threshold values includes setting values defining the lowest allowable levels to at least one factor.

### Claim 22 (depends on 13)

The system of claim 13, wherein the frame native factors are compared with threshold values to determine permitted ranges for adjusting frame native factors.

### Claim 23 (depends on 13)

The system of claim 13, wherein the adjusting module adjusts the frame native factors within the permitted ranges into a set of adjusted factors.

### Claim 24 (depends on 16)

The system of claim 16, wherein the data collector module further receives an input to reduce latency in the display of the frames of the back buffer.

### Claim 25

A non-transitory computer readable medium storing a program causing a graphics processing unit to execute image processing and to provide instructions which, when the one or more frames are received from the graphics processing unit, include the steps of:
defining threshold values based on one or more frame's user experience factors;
analyzing one or more of frame native factors and systems factors based on the defined threshold values;
providing an adjusting module and using that module to adjust the frame's user experience factors;
optionally rendering an adjusted back buffer based on the adjusted frame's user experience factors;
determining if a screen is available for display; and,
if a screen is available for display, transmitting the adjusted or unadjusted back buffer contents to the front frame for displaying the contents of the back buffer.

### Claim 26 (depends on 25)

The computer readable medium of claim 25, wherein if a screen is not available, the contents of the back buffer are placed in a graphic pipeline queue.

### Claim 27 (depends on 25)

The computer readable medium of claim 25, wherein the step of transmitting the adjusted back buffer to the frame buffer includes one of a present command or a swapBuffers command is sent to cause display of the adjusted back buffer.

### Claim 28 (depends on 25)

The computer readable medium of claim 25, further comprising:
assessing in advance screen availability upon completion of a back buffer; and,
if the back buffer has a chance to be displayed, activating a data collector module such that the data collector module monitors internal frame's user experience factors and user inputs.

### Claim 29 (depends on 28)

The computer readable medium of claim 28, wherein the monitored factors include one or more of: frame native factors, system factors and user inputs.

### Claim 30 (depends on 29)

The computer readable medium of claim 29 wherein the frame native factors include one or more of: frame rate, image resolution, GPU utilization, GPU frequency, CPU utilization and backlight.

### Claim 31 (depends on 29)

The computer readable medium of claim 29, wherein the systems factors include one or more of: response lag time, asset load time, heat, power consumption, temperature, charger availability, and battery level.

### Claim 32 (depends on 29)

The computer readable medium of claim 29, wherein the user inputs include inputs coming from one or more of: a mouse, keyboard, joystick, any type of controller, and a headset tracking device.

### Claim 33 (depends on 28)

The computer readable medium of claim 28, wherein the data collector decouples frame native factors from their associated frame and the step of defining threshold values includes setting values defining the lowest allowable levels to at least one factor.

### Claim 34 (depends on 25)

The computer readable medium of claim 25 wherein the step of analyzing includes comparing the frame native factors with threshold values to determine permitted ranges for adjusting frame native factors.

### Claim 35 (depends on 25)

The computer readable medium of claim 25, wherein the adjusting module adjusts the frame native factors within the permitted ranges into a set of adjusted factors.

### Claim 36 (depends on 28)

The computer readable medium of claim 28, wherein the data collector module further receives an input to reduce latency in the display of the frames of the back buffer.
