# US 10,504,263 B2 · Adaptive high dynamic range (HDR) tone mapping with overlay indication

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,504,263 B2
- Document ID: US10504263B2
- Status: Granted
- Kind: B2
- Application number: 16/005,474
- Filed: 2018-06-11
- Published: 2019-02-07
- Granted: 2019-12-10
- Earliest claimed: 2017-08-01
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Yeong-Taeg Kim; Seongnam Oh; Soojung Hyun; Li Tao
- Web page: https://patentgrep.com/patent/US10504263B2

## CPC

- G06T 5/92: based on global image properties
- G06T 5/40: using histogram techniques
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/90: Dynamic range modification of images or parts thereof
- G06T 5/94: based on local image properties, e.g. for local contrast enhancement
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10024: Color image
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method for video tone mapping includes receiving an overlay indication from an input data stream indicating whether a graphic is being overlaid on image data for a High Dynamic Range (HDR) scene. Based on the overlay indication, a hardware processor processes a video stream using a first tone mapping function to generate a first tone mapped video, or a second tone mapping function to generate a second tone mapped video.

## Claims

### Claim 1

A method for video tone mapping, comprising:
receiving, by a hardware processor, an overlay indication from an input data stream;
determining, by the hardware processor, whether or not the overlay indication indicates that a graphic is being overlaid on image data for a High Dynamic Range (HDR) scene in an HDR video stream; and
based on the overlay indication, processing, by the hardware processor, the HDR video stream using: 1) a first tone mapping function to generate a first tone mapped video when the overlay indication is determined to indicate that the graphic is not being overlaid, or 2) a second tone mapping function to generate a second tone mapped video when the overlay indication is determined to indicate that the graphic is being overlaid.

### Claim 2 (depends on 1)

The method for video tone mapping of claim 1, wherein the first tone mapping function uses tone mapping metadata for only the HDR scene without the overlaid graphic.

### Claim 3 (depends on 1)

The method for video tone mapping of claim 1, wherein the second tone mapping function uses tone mapping metadata for the HDR scene with the overlaid graphic.

### Claim 4 (depends on 3)

The method for video tone mapping of claim 3, wherein the tone mapping metadata for the HDR scene with the overlaid graphic is obtained by estimating a maximum luminance for all values of the HDR video stream that includes the graphic overlaid on the HDR scene.

### Claim 5 (depends on 4)

The method for video tone mapping of claim 4, wherein the maximum luminance represents a maximum value of max(R,G,B) of pixels in the HDR video stream.

### Claim 6 (depends on 1)

The method for video tone mapping of claim 1, wherein the overlay indication comprises an overlay flag that specifies whether the graphic is being overlaid on the image data for the HDR scene.

### Claim 7 (depends on 1)

The method for video tone mapping of claim 1, wherein the graphic being overlaid corresponds to image data for a picture-in-picture data stream.

### Claim 8

An apparatus comprising:
a memory storing instructions; and
at least one processor executing the instructions including a process configured to:
receive an overlay indication from an input data stream;
determine whether or not the overlay indication indicates that a graphic is being overlaid on image data for a High Dynamic Range (HDR) scene in an HDR video stream; and
based on the overlay indication, process the HDR video stream using: 1) a first tone mapping function to generate a first tone mapped video when the overlay indication is determined to indicate that the graphic is not being overlaid, or 2) a second tone mapping function to generate a second tone mapped video when the overlay indication is determined to indicate that the graphic is being overlaid.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the first tone mapping function uses tone mapping metadata for only the HDR scene without the overlaid graphic.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the second tone mapping function uses tone mapping metadata for the HDR scene with the overlaid graphic.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the tone mapping metadata for the HDR scene with the overlaid graphic is obtained by estimating a maximum luminance for all values of the HDR video stream that includes the graphic overlaid on the HDR scene.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the maximum luminance represents a maximum value of max(R,G,B) of pixels in the HDR video stream.

### Claim 13 (depends on 8)

The apparatus of claim 8, wherein the overlay indication comprises an overlay flag that specifies whether the graphic is being overlaid on the image data for the HDR scene.

### Claim 14 (depends on 8)

The apparatus of claim 8, wherein the graphic being overlaid corresponds to image data for a picture-in-picture data stream.

### Claim 15

A non-transitory processor-readable medium that includes a program that when executed by a processor performs a method comprising:
receiving, by a hardware processor, an overlay indication from an input data stream;
determining, by the hardware processor, whether or not the overlay indication indicates that a graphic is being overlaid on image data for a High Dynamic Range (HDR) scene in an HDR video stream; and
based on the overlay indication, processing, by the hardware processor, the HDR video stream using: 1) a first tone mapping function to generate a first tone mapped video when the overlay indication is determined to indicate that the graphic is not being overlaid, or 2) a second tone mapping function to generate a second tone mapped video when the overlay indication is determined to indicate that the graphic is being overlaid.

### Claim 16 (depends on 15)

The non-transitory processor-readable medium of claim 15, wherein the first tone mapping function uses tone mapping metadata for only the HDR scene without the overlaid graphic.

### Claim 17 (depends on 15)

The non-transitory processor-readable medium of claim 15, wherein:
the second tone mapping function uses tone mapping metadata for the HDR scene with the overlaid graphic; and
the tone mapping metadata for the HDR scene with the overlaid graphic is obtained by estimating a maximum luminance for all values of the HDR video stream that includes the graphic overlaid on the HDR scene.

### Claim 18 (depends on 17)

The non-transitory processor-readable medium of claim 17, wherein the maximum luminance represents a maximum value of max(R,G,B) of pixels in the HDR video stream.

### Claim 19 (depends on 15)

The non-transitory processor-readable medium of claim 15, wherein the overlay indication comprises an overlay flag that specifies whether the graphic is being overlaid on the image data for the HDR scene.

### Claim 20 (depends on 15)

The non-transitory processor-readable medium of claim 15, wherein the graphic being overlaid corresponds to image data for a picture-in-picture data stream.
