# US 10,769,747 B2 · Intermediate frame generation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,769,747 B2
- Document ID: US10769747B2
- Status: Granted
- Kind: B2
- Application number: 15/476,585
- Filed: 2017-03-31
- Published: 2018-10-04
- Granted: 2020-09-08
- Earliest claimed: 2017-03-31
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Ravindra A. Babu; Satyanantha R. Musunuri; Sashank Ms; Sagar C. Pawar; Kalyan K. Kaipa
- Web page: https://patentgrep.com/patent/US10769747B2

## CPC

- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G02B 27/017: {Head mounted}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G02B 2027/014: {comprising information/image processing systems}
- G09G 2340/0435: Change or adaptation of the frame rate of the video stream
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Systems, apparatuses and methods may provide for technology that includes a microcontroller to control a workload of a graphics processor, to determine if at least one predetermined condition is met, and instruct, if the at least one predetermined condition is met, the graphics processor to transform an initial frame into an intermediate frame.

## Claims

### Claim 1

A computing system comprising:
a display device to present a displayable frame;
a graphics processor to provide the displayable frame to the display device; and
a microcontroller to:
control a workload of the graphics processor,
determine if a plurality of predetermined conditions is met, wherein the microcontroller is to determine that a first condition of the plurality of predetermined conditions is met when a time until a next vertical blank interval of the display device is less than a render time estimate for a frame, and a second condition of the plurality of predetermined conditions is met if a target application frames per second is greater than a frames per second rendered by the graphics processor,
instruct, in response to an identification that each of the plurality of predetermined conditions is met, the graphics processor to transform an initial frame into an intermediate frame to be provided as the displayable frame to the display device, and
determine that the plurality of predetermined conditions is unmet in response to an identification that one or more of the first condition or the second condition is unmet.

### Claim 2 (depends on 1)

The system of claim 1, wherein the microcontroller includes an internal timer that is to reset if a frame has been received by the microcontroller and then begin to count, and wherein the microcontroller is to determine that a third condition of the plurality of predetermined conditions is met if the internal timer has reached a predetermined value and the microcontroller has not received another frame.

### Claim 3 (depends on 1)

The system of claim 1, wherein the microcontroller is to detect whether the plurality of predetermined conditions is met based on sensor data of the display device.

### Claim 4 (depends on 3)

The system of claim 3, wherein the microcontroller is to determine that:
a third condition of the plurality of predetermined conditions is met if the sensor data indicates that a movement of the display device corresponds to a rotational movement;
the plurality of predetermined conditions is met in response to an identification that each of the first, second and third conditions are met; and
the plurality of predetermined conditions is unmet in response to an identification that the third condition is unmet.

### Claim 5 (depends on 4)

The system of claim 4, wherein the initial frame was previously presented on the display device.

### Claim 6 (depends on 1)

The system of claim 1, wherein the microcontroller is to determine that a third condition of the plurality of predetermined conditions is met if display device frame rotation sensor data, corresponding to a generation of the initial frame, is not the same as display device latest rotation sensor data.

### Claim 7 (depends on 6)

The system of claim 6, wherein the initial frame was not presented by the display device.

### Claim 8 (depends on 1)

The system of claim 1, wherein the microcontroller is a part of the graphics processor.

### Claim 9

An apparatus, comprising:
a microcontroller to:
control a workload of a graphics processor,
determine if a plurality of predetermined conditions is met, wherein the microcontroller is to determine that a first condition of the plurality of predetermined conditions is met when a time until a next vertical blank interval of a display device is less than a render time estimate for a frame, and a second condition of the plurality of predetermined conditions is met if a target application frames per second is greater than a frames per second rendered by the graphics processor,
instruct in response to an identification that each of the plurality of predetermined conditions is met, the graphics processor to transform an initial frame into an intermediate frame, and
determine that the plurality of predetermined conditions is unmet in response to an identification that one or more of the first condition or the second condition is unmet.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the microcontroller includes an internal timer that is to reset if a frame has been received by the microcontroller and then begin to count, and wherein the microcontroller is to determine that a third condition of the plurality of predetermined conditions is met if the internal timer has reached a predetermined value, and the microcontroller has not received another frame.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the microcontroller is to detect whether the plurality of predetermined conditions is met based on sensor data of the display device.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the microcontroller is to determine that:
a third condition of the plurality of predetermined conditions is met if the sensor data indicates that a movement of the display device corresponds to a rotational movement;
the plurality of predetermined conditions is met in response to an identification that each of the first, second and third conditions are met; and
the plurality of predetermined conditions is unmet in response to an identification that the third condition is unmet.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the initial frame was previously presented on the display device.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein the microcontroller is to determine that a third condition of the plurality of predetermined conditions is met if display device frame rotation sensor data, corresponding to a generation of the initial frame, is not the same as display device latest rotation sensor data.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the initial frame was not presented by the display device.

### Claim 16 (depends on 9)

The apparatus of claim 9, wherein the microcontroller is a part of the graphics processor.

### Claim 17

A method of controlling frame generation, comprising:
controlling, with a microcontroller, a workload of a graphics processor;
determining, with the microcontroller, if a plurality of predetermined conditions is met, wherein the determining includes determining that a first condition of the plurality of predetermined conditions is met when a time until a next vertical blank interval of a display device is less than a render time estimate for a frame, and a second condition of the plurality of predetermined conditions is met if a target application frames per second is greater than a frames per second rendered by the graphics processor;
instructing with the microcontroller, in response to an identification that each of the plurality of predetermined conditions is met, the graphics processor to transform an initial frame into an intermediate frame; and
determining that the plurality of predetermined conditions is unmet in response to an identification that one or more of the first condition or the second condition is unmet.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
if a frame has been received by the microcontroller, resetting an internal timer of the microcontroller and then starting the internal timer,
wherein the determining includes determining that a third condition of the plurality of predetermined conditions is met if the internal timer has reached a predetermined value, and the microcontroller has not received another frame.

### Claim 19 (depends on 17)

The method of claim 17, wherein the determining if the plurality of predetermined conditions is met includes the microcontroller detecting whether the plurality of predetermined conditions is met based on-sensor data of the display device.

### Claim 20 (depends on 19)

The method of claim 19, wherein the determining includes:
detecting that a third condition of the plurality of predetermined conditions is met if the sensor data indicates that a movement of the display device corresponds to a rotational movement;
determining that the plurality of predetermined conditions is met in response to an identification that each of the first, second and third conditions are met; and
determining that the plurality of predetermined condition is unmet in response to an identification that the third condition is unmet.

### Claim 21 (depends on 20)

The method of claim 20, further comprising displaying the initial frame on the display device before the determining if the plurality of predetermined conditions is met.

### Claim 22 (depends on 17)

The method of claim 17, wherein the determining if the plurality of predetermined conditions is met includes the microcontroller detecting that a third condition of the plurality of predetermined conditions is met if display device frame rotation sensor data, corresponding to a generation of the initial frame, is not the same as display device latest rotation sensor data.

### Claim 23 (depends on 22)

The method of claim 22, wherein the initial frame was not presented by the display device.

### Claim 24 (depends on 17)

The method of claim 17, wherein the microcontroller is a part of the graphics processor.
