# US 2022/0068236 A1 · Curvature interpolation for lookup table

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0068236 A1
- Document ID: US20220068236A1
- Status: Published application
- Kind: A1
- Application number: 17/494,344
- Filed: 2021-10-05
- Published: 2022-03-03
- Earliest claimed: 2020-08-26
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Jian Zhou
- Web page: https://patentgrep.com/patent/US20220068236A1

## CPC

- G09G 5/06: using colour palettes, e.g. look-up tables
- G09G 5/026: {Control of mixing and/or overlay of colours in general (G09G5/022 and G09G5/024 take precedence)}
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

An electronic device includes an electronic display configured to present an image based on image data and a display pipeline having image processing circuitry to process the image data for display on the electronic display by receiving the image data, referencing a lookup table (LUT) to determine output values based on a plurality of input value sets associated with the image data, the LUT including entries respectively mapping an output value to a defined input value set, determining whether an input value set of the plurality of input value sets is represented by the entries of the LUT, performing curvature interpolation to determine an interpolated output value associated with the input value set in response to determining the input value set of the image data is not represented by the entries of the LUT, and applying the interpolated output value to the input value set to generate updated image data.

## Claims

### Claim 1

A display pipeline, comprising:
a memory configured to store a lookup table (LUT) comprising a plurality of entries that map a respective defined input value set to output values, wherein the respective defined input value sets correspond to pixel locations in a frame of image data; and
processing circuitry configured to process pixel data of the image data at least in part by:
determining an input value set corresponding to a pixel location of the pixel data;
performing curvature interpolation based on the output values of a subset of the plurality of entries of the LUT to obtain an interpolated output value for the input value set corresponding to the pixel location of the pixel data; and
applying the interpolated output value to the pixel data to generate updated pixel data.

### Claim 2 (depends on 1)

The display pipeline of claim 1, wherein the processing circuitry is configured to process the pixel data at least in part by:
determining that the input value set corresponding to the pixel location of the pixel data is not represented by the plurality of entries of the LUT; and
performing the curvature interpolation in response to determining that the input value set corresponding to the pixel location of the pixel data is not represented by the plurality of entries of the LUT.

### Claim 3 (depends on 1)

The display pipeline of claim 1, wherein the processing circuitry is configured to perform the curvature interpolation by applying a regression equation to the input value set corresponding to the pixel location of the pixel data, and wherein the regression equation associates resultant respective output values to corresponding input value sets.

### Claim 4 (depends on 3)

The display pipeline of claim 3, wherein the processing circuitry is configured to determine the regression equation based at least in part on the output values corresponding to a subset of the respective defined input value sets, and wherein the subset of the respective defined input value sets correspond to a subset of the plurality of entries.

### Claim 5 (depends on 1)

The display pipeline of claim 1, wherein the LUT is a multi-dimensional LUT.

### Claim 6 (depends on 1)

The display pipeline of claim 1, wherein the output values of the LUT comprise a color adjustment value, a geometry adjustment value, a scaling value, or any combination thereof

### Claim 7 (depends on 1)

The display pipeline of claim 1, wherein the processing circuitry is configured to process the pixel data at least in part by:
determining an additional input value set corresponding to an additional pixel location of the pixel data, wherein the additional input value set is represented by an entry of the plurality of entries of the LUT;
referencing the LUT to obtain a defined output value corresponding to the additional input value set based on the entry of the plurality of entries; and
applying the defined output value to the pixel data to generate the updated pixel data.

### Claim 8

An electronic device, comprising:
an electronic display configured to present an image based at least in part on image data; and
processing circuitry configured to process the image data for display on the electronic display at least in part by:
performing curvature interpolation based on output values of a plurality of entries of a lookup table (LUT) to determine an interpolated output value associated with an interpolated entry representing an input value set for the image data, wherein each entry of the plurality of entries maps a corresponding output value and a defined input value set to one another; and
applying the interpolated output value to the image data to update the image data used by the electronic display to present the image.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the output values of the plurality of entries have a non-linear relationship with one another.

### Claim 10 (depends on 8)

The electronic device of claim 8, comprising a memory configured to store the LUT, wherein the processing circuitry is configured to reference the LUT stored in the memory to perform the curvature interpolation.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein the plurality of entries of the LUT comprises information associated with pixels of the image data.

### Claim 12 (depends on 8)

The electronic device of claim 8, wherein the interpolated entry is disposed between a subset of the plurality of entries of the LUT.

### Claim 13

One or more tangible, non-transitory, computer-readable media comprising instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to process data at least in part by:
obtaining an interpolated output value for an input value set of the data by performing curvature interpolation based on output values of a plurality of entries of a lookup table (LUT), wherein the plurality of entries respectively map the output values to defined input value sets; and
applying the interpolated output value to the data to generate updated data.

### Claim 14 (depends on 13)

The one or more non-transitory, computer-readable media of claim 13, wherein the input value set of the data is not represented by any single one of the plurality of entries of the LUT.

### Claim 15 (depends on 13)

The one or more non-transitory, computer-readable media of claim 13, wherein the instructions, when executed by the processing circuitry, are configured to cause the processing circuitry to process the data at least in part by:
obtaining a defined output value mapped to an additional input value set of the data via an entry of the plurality of entries of the LUT, wherein the additional input value set of the data is represented by the entry of the plurality of entries; and
applying the defined output value to the data to generate the updated data.

### Claim 16 (depends on 13)

The one or more non-transitory, computer-readable media of claim 13, wherein the instructions, when executed by the processing circuitry, are configured to cause the processing circuitry to perform the curvature interpolation by applying an equation that associates a corresponding interpolated output value with respective output values of a subset of the plurality of entries, step sizes between entries of the subset of the plurality of entries, and a phase between an interpolated entry representing the input value set and an entry of the subset of the plurality of entries.

### Claim 17 (depends on 13)

The one or more non-transitory, computer-readable media of claim 13, wherein the instructions, when executed by the processing circuitry, are configured to cause the processing circuitry to perform a plurality of iterations of the curvature interpolation to determine the interpolated output value.

### Claim 18 (depends on 17)

The one or more non-transitory, computer-readable media of claim 17, wherein the plurality of iterations of the curvature interpolation comprises a plurality of initial iterations of the curvature interpolation performed on a subset of the plurality of entries to determine a set of virtual entries and an additional iteration of the curvature interpolation performed on the set of virtual entries to determine the interpolated output value.

### Claim 19 (depends on 18)

The one or more non-transitory, computer-readable media of claim 18, wherein the instructions, when executed by the processing circuitry, are configured to cause the processing circuitry to process the data at least in part by:
performing the plurality of iterations of the curvature interpolation on a plurality of rows of the subset of the plurality of entries to determine a column of virtual entries; and
performing the additional iteration of the curvature interpolation on the column of virtual entries.

### Claim 20 (depends on 18)

The one or more non-transitory, computer-readable media of claim 18, wherein the instructions, when executed by the processing circuitry, are configured to cause the processing circuitry to process the data at least in part by:
performing the plurality of iterations of the curvature interpolation on a plurality of columns of the subset of the plurality of entries to determine a row of virtual entries; and
performing the additional iteration of the curvature interpolation on the row of virtual entries.
