# US 10,504,417 B2 · Low latency display system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,504,417 B2
- Document ID: US10504417B2
- Status: Granted
- Kind: B2
- Application number: 15/088,916
- Filed: 2016-04-01
- Published: 2017-07-06
- Granted: 2019-12-10
- Earliest claimed: 2015-12-31
- Assignees: OmniVision Technologies, Inc.
- Applicants: OmniVision Technologies, Inc.
- Inventors: Sunny Yat-san Ng
- Web page: https://patentgrep.com/patent/US10504417B2

## CPC

- G09G 3/2096: {Details of the interface to the display terminal specific for a flat panel (suitable for both CRT and flat panel G09G5/006; specific for a CRT G09G1/167)}
- G09G 3/2003: {Display of colours (specific for liquid crystal displays G09G3/3607)}
- G09G 5/022: {using memory planes}
- G09G 5/393: Arrangements for updating the contents of the bit-mapped memory
- G09G 3/3413: {Details of control of colour illumination sources}
- G09G 5/399: using two or more bit-mapped memories, the operations of which are switched in time, e.g. ping-pong buffers
- G09G 2310/0235: Field-sequential colour display
- G09G 2310/04: Partial updating of the display screen
- G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen
- G09G 2340/0428: Gradation resolution change
- G09G 2340/0464: Positioning
- G09G 2360/16: Calculation or use of calculated indices related to luminance levels in display data
- G09G 2360/18: Use of a frame buffer in a display terminal, inclusive of the display panel
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A novel display system includes a host and a display. In a particular embodiment the host includes a data scaler and a dual frame buffer. Frames of image data are down-scaled before being transferred to the display, and is up-scaled while being loaded into the frame buffer or the display. The down-scaled frames of image data include less data than the frames of image data. In another embodiment, the process of loading the image data into the display begins before an entire frame of data is loaded into the frame buffer. Increasingly sized portions of the image data, each corresponding to a different color field, are asserted on the display and displayed one at a time. The portions of the frame that were not previously displayed are displayed along with the initial portions of a subsequent frame.

## Claims

### Claim 1

A display system, comprising:
a display including a plurality of individual pixels; and
a display driver coupled to receive sequential frames of image data and to assert at least a portion of said image data on said pixels of said display; and wherein
said display driver asserts at least some data corresponding to a frame of said image data on said pixels of said display within a predetermined amount of time after receiving a first portion of said frame of said image data; and
said predetermined amount of time is less than an amount of time required for said display driver to receive a full frame of said image data; and
an image data buffer electrically coupled to receive said sequential frames of image data and to provide said sequential frames of image data to said display; and wherein
said display driver is operative to
assert a portion of a frame of image data on a first set of said pixels of said display,
assert a portion of a subsequent frame of image data on a second set of pixels of said display while said portion of said frame of image data is being asserted on said first set of pixels, and
cause said display to be illuminated with light of a first color while said portion of said frame of image data and said portion of said subsequent frame of image data are being simultaneously asserted on said pixels of said display and before all of said subsequent frame of image data is received in said image data buffer;
one of said first set of pixels and said second set of pixels includes some, but not all, of said pixels of said display; and
the other of said first set of pixels and said second set of pixels includes the remainder of said pixels of said display.

### Claim 2 (depends on 1)

The display system of claim 1, further comprising:
an image data scaler electrically coupled to receive said frames of image data each including a particular amount of data, operative to reduce the size of said image data to generate down-scaled frames of image data each including less than said particular amount of data, and operative to provide said down scaled frames of image data to said display driver; and wherein
said display driver is electrically coupled to receive said down-scaled frames of image data from said image data scalar, is operative to increase the size of said down-scaled frames of image data to generate up-scaled frames of image data, and is operative to assert at least some data from each of said up-scaled frames of image data on pixels of said display before receiving an amount of data corresponding to said particular amount of data.

### Claim 3 (depends on 2)

The display system of claim 2, wherein said down-scaled image data includes no more than 75% of the amount of image data in a frame of said originally formatted image data.

### Claim 4 (depends on 3)

The display system of claim 3, wherein said down-scaled image data includes no more than 50% of the amount of image data in a frame of said originally formatted image data.

### Claim 5 (depends on 2)

The display system of claim 2, wherein said image data scaler is operative to generate said down-scaled image data by omitting data values associated with particular pixels of said display from said originally formatted image data.

### Claim 6 (depends on 2)

The display system of claim 2, wherein said image data scaler is operative to generate said down-scaled image data by omitting data values associated with predefined rows of pixels of said display from said originally formatted image data.

### Claim 7 (depends on 2)

The display system of claim 2, further comprising an electronic controller configured to provide control signals to dynamically transition said image data scaler between an on-state and an off-state.

### Claim 8 (depends on 7)

The display system of claim 7, further comprising:
a sensor; and wherein
said controller, responsive to data from said sensor, transitions said image data scaler between said on-state and said off-state.

### Claim 9 (depends on 8)

The display system of claim 8, wherein said sensor is an image sensor.

### Claim 10 (depends on 8)

The display system of claim 8, wherein said sensor is a motion sensor.

### Claim 11 (depends on 8)

The display system of claim 8, wherein said sensor is an orientation sensor.

### Claim 12 (depends on 1)

The display system of claim 1, wherein said portion of said frame of image data is larger than said portion of said subsequent frame of image data.

### Claim 13 (depends on 1)

The display system of claim 1, wherein said display driver is further operative to:
assert a second portion of said frame of image data on a third set of said pixels of said display;
assert a second portion of said subsequent frame of image data on a fourth set of pixels of said display while said second portion of said frame of image data is being asserted on said third set of pixels; and
cause said display to be illuminated with light of a second color while said second portion of said frame of image data and said second portion of said subsequent frame of image data are being simultaneously asserted on said pixels of said display.

### Claim 14 (depends on 13)

The display system of claim 13, wherein said second portion of said frame of image data is smaller than said second portion of said subsequent frame of image data.

### Claim 15 (depends on 13)

The display system of claim 13, wherein said display driver is further operative to:
assert a third portion of said subsequent frame of image data on all of said pixels of said display; and
cause said display to be illuminated with light of a third color while said third portion of said subsequent frame of image data is asserted on all of said pixels of said display.

### Claim 16 (depends on 1)

The display system of claim 1, wherein:
said one of said first set of pixels and said second set of pixels includes one-third of said pixels of said display; and
the other of said first set of pixels and said second set of pixels includes two-thirds of said pixels of said display.

### Claim 17 (depends on 1)

The display system of claim 1, wherein said one of said first set of pixels and said second set of pixels includes a middle one-third of said pixels of said display.

### Claim 18 (depends on 1)

The display system of claim 1, wherein:
said one of said first set of pixels and said second set of pixels includes one-fourth of said pixels of said display; and
the other of said first set of pixels and said second set of pixels includes three-fourths of said pixels of said display.

### Claim 19 (depends on 1)

The display system of claim 1, wherein said display driver asserts at least some data corresponding to a current frame of said image data on said pixels of said display while other data of said current frame is still being received.

### Claim 20 (depends on 1)

The display system of claim 1, wherein:
each frame of said image data is received during a corresponding frame time; and
said at least some data corresponding to each frame is asserted on said pixels of said display during said corresponding frame time.

### Claim 21 (depends on 1)

The display system of claim 1, wherein:
one of said first set of pixels and said second set of pixels includes one-fourth of said pixels of said display; and
said first set of pixels and said second set of pixels together include all of said pixels of said display.

### Claim 22

In a digital display system, a method for displaying digital data, said method comprising:
receiving sequential frames of image data;
asserting at least some data corresponding to a frame of said image data on pixels of a display within a predetermined amount of time after receiving a first portion of said frame of said image data;
asserting a portion of a frame of image data on a first set of said pixels of said display;
asserting a portion of a subsequent frame of image data on a second set of said pixels of said display while said portion of said frame of image data is being asserted on said first set of pixels, and
causing said display to be illuminated with light of a first color while said portion of said frame of image data and said portion of said subsequent frame of image data are being simultaneously asserted on said pixels of said display and before all of said subsequent frame of image data is received in said image data buffer;
wherein said predetermined amount of time is less than an amount of time required to receive each full frame of said image data;
one of said first set of pixels and said second set of pixels includes some, but not all, of said pixels of said display; and
the other of said first set of pixels and said second set of pixels includes the remainder of said pixels of said display.

### Claim 23 (depends on 22)

The method of claim 22, further comprising:
receiving frames of originally formatted image data each including a particular amount of data;
reducing the size of said image data to generate frames of down-scaled image data each including less than said particular amount of data;
providing said frames of down-scaled image data to a display;
increasing the size of said frames of down-scaled image data to generate frames of up-scaled image data; and
asserting at least some data from each of said frames of up-scaled image data on pixels of said display before receiving an amount of data corresponding to said particular amount of data.

### Claim 24 (depends on 23)

The method of claim 23, further comprising:
asserting at least some data of each frame of said up-scaled image data on said pixels of said display within a certain amount of time after receiving a first portion of each frame of said down-scaled image data; and wherein
said certain amount of time is less than an amount of time required for said display to receive a frame of said originally formatted image data.

### Claim 25 (depends on 23)

The method of claim 23, wherein said step of reducing the size of said image data to generate frames of down-scaled image data includes generating frames of down-scaled image data each including no more than 75% of the amount of image data in a frame of said originally formatted image data.

### Claim 26 (depends on 25)

The method of claim 25, wherein said step of reducing the size of said image data to generate frames of down-scaled image data includes generating frames of down-scaled image data including no more than 50% of the amount of image data in a frame of said originally formatted image data.

### Claim 27 (depends on 23)

The method of claim 23, wherein said step of reducing the size of said image data to generate frames of down-scaled image data includes omitting data values associated with particular pixels of said display from said originally formatted data.

### Claim 28 (depends on 23)

The method of claim 23, wherein said step of reducing the size of said image data to generate frames of down-scaled image data includes omitting data values associated with predefined rows of pixels of said display from said originally formatted data.

### Claim 29 (depends on 23)

The method of claim 23, wherein said step of reducing the size of said image data includes:
reducing the size of said image data when a predefined condition is met; and
not reducing the size of said image data when said predefined condition is not met.

### Claim 30 (depends on 29)

The method of claim 29, wherein said step of reducing the size of said image data includes:
receiving data from a sensor;
determining whether said condition is met based at least in part on said data from said sensor.

### Claim 31 (depends on 30)

The method of claim 30, wherein said step of receiving data from a sensor includes receiving data from an image sensor.

### Claim 32 (depends on 30)

The method of claim 30, wherein said step of receiving data from a sensor includes receiving data from a motion sensor.

### Claim 33 (depends on 30)

The method of claim 30, wherein said step of receiving data from a sensor includes receiving data from an orientation sensor.

### Claim 34 (depends on 22)

The method of claim 22, wherein said portion of said frame of image data is larger than said portion of said subsequent frame of image data.

### Claim 35 (depends on 22)

The method of claim 22, further comprising:
asserting a second portion of said frame of image data on a third set of said pixels of said display;
asserting a second portion of said subsequent frame of image data on a fourth set of said pixels of said display while said second portion of said frame of image data is being asserted on said third set of pixels; and
causing said display to be illuminated with light of a second color while said second portion of said frame of image data and said second portion of said subsequent frame of image data are being simultaneously asserted on said pixels of said display.

### Claim 36 (depends on 35)

The method of claim 35, wherein said second portion of said frame of image data is smaller than said second portion of said subsequent frame of image data.

### Claim 37 (depends on 35)

The method of claim 35, further comprising:
asserting a third portion of said frame of image data on a fifth set of said pixels of said display;
asserting a third portion of said subsequent frame of image data on a sixth set of said pixels of said display while said third portion of said frame of image data is being asserted on said fifth set of pixels; and
causing said display to be illuminated with light of a third color while said third portion of said frame of image data and said third portion of said subsequent frame of image data are being simultaneously asserted on said pixels of said display.

### Claim 38 (depends on 37)

The method of claim 37, wherein:
said third portion of said frame of image data includes 0% of said frame of image data;
said third portion of said subsequent frame of image data includes 100% of said subsequent frame of image data;
said fifth set of said pixels of said display includes none of said pixels of said display; and
said sixth set of said pixels of said display includes all of said pixels of said display.

### Claim 39 (depends on 22)

The method of claim 22, wherein:
one of said first set of pixels and said second set of pixels includes one-third of said pixels of said display; and
the other of said first set of pixels and said second set of pixels includes two-thirds of said pixels of said display.

### Claim 40 (depends on 22)

The method of claim 22, wherein one of said first set of pixels and said second set of pixels includes a middle one-third of said pixels of said display.

### Claim 41 (depends on 22)

The method of claim 22, wherein:
one of said first set of pixels and said second set of pixels includes one-fourth of said pixels of said display; and
the other of said first set of pixels and said second set of pixels includes three-fourths of said pixels of said display.

### Claim 42 (depends on 22)

The method of claim 22, wherein said step of asserting at least some data corresponding to each frame of image data on pixels of a display includes asserting at least some data corresponding to a current frame of said image data on said pixels of said display while other data of said current frame is still being received.

### Claim 43 (depends on 22)

The method of claim 22, wherein:
receiving sequential frames of image data includes receiving each frame of said image data during a corresponding frame time; and
said step of asserting at least some data corresponding to each frame of image data on pixels of a display includes asserting said at least some data corresponding to each frame on said pixels of said display during said corresponding frame time.

### Claim 44 (depends on 22)

The method of claim 22, wherein:
one of said first set of pixels and said second set of pixels includes one-fourth of said pixels of said display; and
said first set of pixels and said second set of pixels together include all of said pixels of said display.

### Claim 45

In a digital video driver, a method for displaying digital video data, said method comprising:
loading sequential frames of video data into a data buffer, each frame of video data including a plurality of color fields;
loading a first portion of a first color field of a frame of said video data into a display after said first portion of said first color field is loaded into said data buffer and before an entirety of said frame is loaded into said data buffer;
illuminating said display with a first colored light corresponding to said first color field;
loading a first portion of a second color field of said frame of said video data into said display after said first portion of said second color field is loaded into said data buffer and before said entirety of said frame is loaded into said data buffer;
illuminating said display with a second colored light corresponding to said second color field;
loading a first portion of a third color field of said frame of said video data into said display after said first portion of said third color field is loaded into said data buffer;
illuminating said display with a third colored light corresponding to said third color field;
loading a first portion of said first color field of a subsequent frame of video data and a remaining portion of said first color field of said frame of video data into said display after said first portion of said first color field of said subsequent frame of video data is loaded into said data buffer and before an entirety of said subsequent frame is loaded into said data buffer;
illuminating said display with said first colored light;
loading a first portion of said second color field of said subsequent frame of video data and a remaining portion of said second color field of said frame of video data into said display after said first portion of said second color field of said subsequent frame of video data is loaded into said data buffer and before said entirety of said subsequent frame is loaded into said data buffer;
illuminating said display with said second colored light;
loading a first portion of a third color field of said subsequent frame of video data and any remaining portion of said third color field of said frame of video data into said display after said first portion of said third color field of said subsequent frame of video data is loaded into said data buffer; and
illuminating said display with said third colored light.