# US 2018/0007371 A1 · Dynamic fidelity updates for encoded displays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0007371 A1
- Document ID: US20180007371A1
- Status: Published application
- Kind: A1
- Application number: 15/200,420
- Filed: 2016-07-01
- Published: 2018-01-04
- Earliest claimed: 2016-07-01
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Paul S. Diefenbaugh; Jason Tanner; Kristoffer D. Fleming; Vishal R. Sinha; Karthik Veeramani
- Web page: https://patentgrep.com/patent/US20180007371A1

## CPC

- H04N 21/4122: {additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423)}
- H04N 9/646: {for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters}
- H04N 21/4363: Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N 21/440227: {by decomposing into layers, e.g. base layer and one or more enhancement layers}
- H04N 23/84: for processing colour signals
- G09G 2320/0242: Compensation of deficiencies in the appearance of colours
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Sink devices are provided that increase quality of displayed images by dynamically integrating higher fidelity update frames into a base stream encoded using an encoding technique (e.g., chroma-subsampling and/or another lossless encoding technique). Use of base image frames enables backward compatibility with existing technology and serves as a baseline for bandwidth scaling. The fidelity update frames may include raw image data, lossy, or losslessly compressed image data, and/or additional subsampled image data. The image data included in the fidelity update frames may apply to the entire base image frame or a portion thereof. The fidelity update frames may include incremental data or complete, high fidelity image data for a portion of an entire image. The sink devices may store and implement fidelity management policies that control operation of the devices to balance resource consumption against fidelity to meet the needs of specific operational environments.

## Claims

### Claim 1

A sink device comprising:
a display buffer;
an interface configured to couple to a data link; and
at least one processor coupled to the interface and the display buffer and configured to receive, via the interface and the data link, a plurality of frames of image data, the plurality of frames including at least one fidelity update frame; to identify the at least one fidelity update frame within the plurality of frames; to parse the at least one fidelity update frame to identify at least one chroma value stored in the at least one fidelity update frame; and to store image data based on the at least one chroma value in the display buffer.

### Claim 2 (depends on 1)

The sink device of claim 1, further comprising a display coupled to the display buffer and configured to render an output image based on the image data stored in the display buffer.

### Claim 3 (depends on 1)

The sink device of claim 1, wherein the plurality of frames includes at least one base frame distinct from and corresponding to the at least one fidelity update frame.

### Claim 4 (depends on 3)

The sink device of claim 3, wherein the at least one processor is configured to integrate the at least one fidelity update frame with the at least one base frame to produce the image data based on the at least one chroma value.

### Claim 5 (depends on 4)

The sink device of claim 4, wherein the at least one fidelity update frame has higher resolution than the at least one base frame and the at least one processor is configured to integrate the at least one fidelity update frame with the at least one base frame at least in part by extracting, from the at least one fidelity update frame, a plurality of chroma values of an individual pixel within the at least one base frame.

### Claim 6 (depends on 4)

The sink device of claim 4, wherein the at least one processor is configured to integrate the at least one fidelity update frame with the at least one base frame at least in part by replacing chroma values of a plurality of pixels within the at least one base frame with corresponding chroma values stored in the least one fidelity update frame.

### Claim 7 (depends on 4)

The sink device of claim 4, wherein the at least one fidelity update frame includes at least one partial base frame and the at least one processor is configured to integrate the at least one partial base frame with the at least one base frame at least in part by replacing a portion of the at least one base frame with the at least one partial base frame.

### Claim 8 (depends on 4)

The sink device of claim 4, wherein the at least one processor is configured to integrate the at least one fidelity update frame with the at least one base frame at least in part by replacing a chroma value of a pixel within the at least one base frame with a chroma value stored in the at least one partial fidelity update frame.

### Claim 9 (depends on 4)

The sink device of claim 4, wherein the at least one fidelity update frame includes at least one partial fidelity update frame and the at least one processor is configured to integrate the at least one partial fidelity update frame with the at least one base frame at least in part by replacing a chroma value of a pixel within the at least one base frame with a chroma value stored in the at least one partial fidelity update frame.

### Claim 10 (depends on 4)

The sink device of claim 4, wherein the at least one fidelity update frame includes at least one partial fidelity update frame and at least one partial base frame and the at least one processor is configured to:
integrate the at least one partial base frame with the at least one base frame at least in part by replacing a portion of the at least one base frame with the at least one partial base frame; and
integrate the at least one partial fidelity update frame with the at least one base frame at least in part by replacing a chroma value of a pixel within the at least one base frame with a chroma value stored in the at least one partial fidelity update frame.

### Claim 11 (depends on 1)

The sink device of claim 1, wherein the at least one fidelity update frame includes at least one partial fidelity update frame and at least one partial base frame and the at least one processor is configured to:
integrate the at least one partial base frame with a base frame at least in part by replacing a luma value of a pixel within the base frame with a luma value stored in the at least one partial base frame; and
integrate the at least one partial fidelity update frame with the base frame at least in part by replacing a chroma value of a pixel within the base frame with a chroma value stored in the at least one partial fidelity update frame.

### Claim 12 (depends on 1)

The sink device of claim 1, further comprising a memory storing one or more fidelity management policies applicable to determine whether to integrate the at least one fidelity update frame with a base frame, wherein the at least one processor is coupled to the memory and configured to identify at least one fidelity management policy from the one or more fidelity management policies and to apply the at least one fidelity management policy in response to receipt of at least one frame of the plurality of frames.

### Claim 13 (depends on 12)

The sink device of claim 12, wherein the one or more fidelity management policies include at least one of a latency-biased policy and a fidelity-biased policy.

### Claim 14 (depends on 13)

The sink device of claim 13, wherein the latency-biased policy specifies that a metric indicative of frame activity must transgress a threshold prior to identifying the at least one fidelity update frame.

### Claim 15 (depends on 13)

The sink device of claim 13, wherein the fidelity-biased policy specifies that that a metric indicative of frame activity must not transgress a threshold prior to identifying the at least one fidelity update frame.

### Claim 16 (depends on 1)

The sink device of claim 1, wherein the sink device includes at least one of a wireless display, a wired display, a media box, and a smart phone.

### Claim 17

A method of increasing image fidelity using a sink device including a display buffer, the method comprising:
receiving, at the sink device, a plurality of frames of image data, the plurality of frames including at least one fidelity update frame;
identifying the at least one fidelity update frame within the plurality of frames;
parsing the at least one fidelity update frame to identify at least one chroma value stored in the at least one fidelity update frame; and
storing image data based on the at least one chroma value in the display buffer.

### Claim 18 (depends on 17)

The method of claim 17, further comprising rendering an output image based on the image data stored in the display buffer.

### Claim 19 (depends on 17)

The method of claim 17, wherein receiving the plurality of frames includes receiving at least one base frame distinct from and corresponding to the at least one fidelity update frame.

### Claim 20 (depends on 19)

The method of claim 19, further comprising integrating the at least one fidelity update frame with the at least one base frame to produce the image data based on the at least one chroma value.

### Claim 21 (depends on 20)

The method of claim 20, wherein the at least one fidelity update frame has higher resolution than the at least one base frame and the method further comprises integrating the at least one fidelity update frame with the at least one base frame at least in part by extracting, from the at least one fidelity update frame, a plurality of chroma values of an individual pixel within the at least one base frame.

### Claim 22

A non-transient computer program product encoded with instructions that when executed by one or more processors cause a process for increasing image fidelity to be carried out, the process comprising:
receiving a plurality of frames of image data, the plurality of frames including at least one fidelity update frame;
identifying the at least one fidelity update frame within the plurality of frames;
parsing the at least one fidelity update frame to identify at least one chroma value stored in the at least one fidelity update frame; and
storing image data based on the at least one chroma value in a display buffer.

### Claim 23 (depends on 22)

The computer program product of claim 22, further comprising rendering an output image based on the image data stored in the display buffer.

### Claim 24 (depends on 22)

The computer program product of claim 22, wherein receiving the plurality of frames includes receiving at least one base frame distinct from and corresponding to the at least one fidelity update frame.

### Claim 25 (depends on 24)

The computer program product of claim 24, further comprising integrating the at least one fidelity update frame with the at least one base frame to produce the image data based on the at least one chroma value.
