# US 2021/0342989 A1 · Hue preservation post processing with early exit for highlight recovery

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342989 A1
- Document ID: US20210342989A1
- Status: Published application
- Kind: A1
- Application number: 17/373,362
- Filed: 2021-07-12
- Published: 2021-11-04
- Earliest claimed: 2018-09-04
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Touraj Tajbakhsh; Chihsin Wu; Frederic Cao
- Web page: https://patentgrep.com/patent/US20210342989A1

## CPC

- G06T 5/92: based on global image properties
- G06T 5/90: Dynamic range modification of images or parts thereof
- G06T 7/90: Determination of colour characteristics
- H04N 9/643: {Hue control means, e.g. flesh tone control}
- G06T 2207/10024: Color image
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

## Claims

### Claim 1

An apparatus for processing image signal data, comprising:
a hue target circuit configured to generate a plurality of target hues for a plurality of color channels of a pixel in an image using candidate hue values for the color channels of the pixel;
an intensity value calculator circuit coupled to the hue target circuit, the intensity value calculator circuit configured to determine an intensity value for a color channel of the plurality of color channels of the pixel, using corresponding ratios of the target hues for the plurality of color channels of the pixel; and
a hue processor coupled to the hue target circuit and the intensity value calculator circuit, the hue processor configured to select the intensity value as a recovered hue value for the color channel of the pixel, when a target hue of the plurality of target hues for the color channel is the largest among the target hues.

### Claim 2 (depends on 1)

The apparatus of claim 1, further comprising a hue preservation post processing circuit coupled to the hue processor and the intensity value calculator circuit, the hue preservation post processing circuit being disabled for performing a hue preservation post processing for the color channel of the pixel upon selecting the intensity value as the recovered hue value.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the hue processor is further configured to:
compare, for each color channel, the target hues for the plurality of color channels of the pixel to select the intensity value as the recovered hue value.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the hue processor is further configured to:
determine values of the target hues for the plurality of color channels of the pixel,
generate a signal for the color channel, in response to determining that the target hue for the color channel is the largest among the target hues, and
configure a demultiplexer circuit using the signal as a select signal of the demultiplexer circuit to output the intensity value for the color channel of the pixel as the recovered hue value for the color channel of the pixel, the demultiplexer circuit coupled to the hue processor and the intensity value calculator circuit.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the hue processor is further configured to:
generate a signal for another color channel of the plurality of color channels of the pixel, in response to determining that the target hue for the color channel is the largest among the target hues, and
configure a demultiplexer circuit coupled to the hue processor using the signal as a select signal of the demultiplexer circuit to pass another intensity value for the other color channel of the pixel from the intensity value calculator circuit to a hue preservation post processing circuit coupled to the intensity value calculator circuit for computing another recovered hue value for the other color channel of the pixel.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the intensity value calculator circuit is further configured to:
determine a first ratio between a first of the target hues for the color channel and a second of the target hues for another color channel of the plurality of color channels,
determine a second ratio between the first target hue for the color channel and a third of the target hues for a remaining color channel of the plurality of color channels, and
determine the intensity value for the color channel of the pixel using the first ratio and the second ratio.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the intensity value calculator circuit is further configured to:
determine the intensity value for the color channel of the pixel by applying a clipping to a processed version of a pixel value for the color channel of the pixel.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the intensity value calculator circuit is further configured to:
limit the processed version of the pixel value to be within a defined maximum hue level of the color channel when applying the clipping.

### Claim 9 (depends on 7)

The apparatus of claim 7, wherein the intensity value calculator circuit is further configured to:
apply a piecewise linear curve to the processed version of the pixel value when applying the clipping, the piecewise linear curve represented as values in a look-up table stored at a computer readable storage medium coupled to the intensity value calculator circuit.

### Claim 10

A method, comprising:
generating a plurality of target hues for a plurality of color channels of a pixel in an image using candidate hue values for the color channels of the pixel;
determining an intensity value for a color channel of the plurality of color channels of the pixel, using corresponding ratios of the target hues for the plurality of color channels of the pixel; and
selecting the intensity value as a recovered hue value for the color channel of the pixel, when a target hue of the plurality of target hues for the color channel is the largest among the target hues.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
disabling a hue preservation post processing for the color channel of the pixel upon selecting the intensity value as the recovered hue value.

### Claim 12 (depends on 10)

The method of claim 10, further comprising:
comparing, for each color channel, the target hues for the plurality of color channels of the pixel to select the intensity value as the recovered hue value.

### Claim 13 (depends on 10)

The method of claim 10, further comprising:
determining values of the target hues for the plurality of color channels of the pixel;
generating a signal for the color channel, in response to determining that the target hue for the color channel is the largest among the target hues; and
using the signal to output the intensity value for the color channel of the pixel as the recovered hue value for the color channel of the pixel.

### Claim 14 (depends on 10)

The method of claim 10, further comprising:
generating a signal for another color channel of the plurality of color channels of the pixel, in response to determining that the target hue for the color channel is the largest among the target hues; and
using the signal to pass another intensity value for the other color channel of the pixel for a hue preservation post processing to compute another recovered hue value for the other color channel of the pixel.

### Claim 15 (depends on 10)

The method of claim 10, further comprising:
determining a first ratio between a first of the target hues for the color channel and a second of the target hues for another color channel of the plurality of color channels;
determining a second ratio between the first target hue for the color channel and a third of the target hues for a remaining color channel of the plurality of color channels; and
determining the intensity value for the color channel of the pixel using the first ratio and the second ratio.

### Claim 16 (depends on 10)

The method of claim 10, further comprising:
determining the intensity value for the color channel of the pixel by applying a clipping to a processed version of a pixel value for the color channel of the pixel.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
limiting the processed version of the pixel value to be within a defined maximum hue level of the color channel when applying the clipping.

### Claim 18

An electronic device, comprising:
an image sensor configured to capture an image comprising a pixel with hue information having at least one color channel of a plurality of color channels with an intensity above a predetermined threshold; and
an image signal processor coupled to the image sensor, the image signal processor configured to perform raw processing of the image to obtain a raw processed version of the image having the plurality of color channels, the image signal processor including:
a hue target circuit configured to generate a plurality of target hues for a plurality of color channels of a pixel in the image using candidate hue values for the color channels of the pixel,
an intensity value calculator circuit coupled to the hue target circuit, the intensity value calculator circuit configured to determine an intensity value for a color channel of the plurality of color channels of the pixel, using corresponding ratios of the target hues for the plurality of color channels of the pixel, and
a hue processor coupled to the hue target circuit and the intensity value calculator circuit, the hue processor configured to select the intensity value as a recovered hue value for the color channel of the pixel, when a target hue of the plurality of target hues for the color channel is the largest among the target hues.

### Claim 19 (depends on 18)

The electronic device of claim 18, wherein the image signal processor further comprises a hue preservation post processing circuit coupled to the hue processor and the intensity value calculator circuit, the hue preservation post processing circuit being disabled for performing a hue preservation post processing for the color channel of the pixel upon selecting the intensity value as the recovered hue value.

### Claim 20 (depends on 18)

The electronic device of claim 18, wherein the hue processor is further configured to:
determine values of the target hues for the plurality of color channels of the pixel,
generate a signal for the color channel, in response to determining that the target hue for the color channel is the largest among the target hues, and
configure a demultiplexer circuit using the signal as a select signal of the demultiplexer circuit to output the intensity value for the color channel of the pixel as the recovered hue value for the color channel of the pixel, the demultiplexer circuit coupled to the hue processor and the intensity value calculator circuit.
