# US 2019/0320189 A1 · Systems and methods for region-of-interest tone remapping

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0320189 A1
- Document ID: US20190320189A1
- Status: Published application
- Kind: A1
- Application number: 16/314,846
- Filed: 2017-07-07
- Published: 2019-10-17
- Earliest claimed: 2016-07-08
- Assignees: Vid Scale, Inc.
- Applicants: Vid Scale, Inc.
- Inventors: Jeffrey Allen Cooper; Kumar Ramaswamy; Ralph Neff
- Web page: https://patentgrep.com/patent/US20190320189A1

## CPC

- H04N 19/20: using video object coding
- H04N 19/115: Selection of the code volume for a coding unit prior to coding
- H04N 19/162: User input
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/182: the unit being a pixel
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 21/23439: {for generating different versions}
- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods are described for providing viewers of adaptive bit rate (ABR) streaming video with the option to view alternative streams in which an alternative tone mapping is applied to one or more regions of interest. The availability of streams with alternative tone mappings may be identified in a media presentation description (MPD) in an MPEG-DASH system. In some embodiments, the streaming video is divided into slices, and alternative tone mappings are applied to regions of interest within the slices. When a server receives a request from a client device for alternative tone mappings of different regions, slices with the appropriate mapping may be assembled on demand and delivered to the requestor as a single video stream. Tone mappings may be used, for example, to highlight particular players in a sporting event.

## Claims

### Claim 1

A method of providing user selectable tone mapping for regions of interest in video content, the method comprising:
sending to a video client (i) a default video stream generated using a first tone mapping of the video content, and (ii) information identifying a set of at least one available region of interest in the video content;
receiving, from the video client, an indication of a selected region of interest from among the set of available regions of interest;
in response to receiving the indication of the selected region of interest, sending, to the client, an alternative video stream of the video content, wherein:
an area outside the selected region of interest is generated using the first tone mapping; and
an area inside the selected region of interest is generated using a second tone mapping different from the first tone mapping.

### Claim 2 (depends on 1)

The method of claim 1, wherein the generation of the alternative stream is performed in advance of receiving the indication of the selected region of interest.

### Claim 3 (depends on 1)

The method of claim 1, further comprising generating the alternative video stream by a method comprising:
storing a plurality of default slices of the default stream;
storing a plurality of alternative slices in which the tone mapping is applied to areas within the region of interest; and
merging a plurality of the default slices and a plurality of the alternative slices to generate the alternative video stream.

### Claim 4 (depends on 3)

The method of claim 3, wherein the storing of default slices and alternative slices is performed before receiving the indication of the selected region of interest, and wherein the merging is performed after receiving the indication.

### Claim 5 (depends on 1)

The method of any of claim 1, wherein the first tone mapping is a default tone mapping and the second tone mapping is selected by a user from among a plurality of available tone mappings.

### Claim 6 (depends on 1)

The method of claim 1, further comprising tracking the location of at least one object in the video content, wherein a location of at least one region of interest is based on the location of the tracked object.

### Claim 7 (depends on 1)

The method of claim 1, wherein information identifying the location of at least one of the regions of interest is provided in-band in the default video stream.

### Claim 8 (depends on 7)

The method of claim 7, wherein information identifying the location of at least one of the regions of interest is provided in supplemental enhancement information (SEI) messages in the default video stream.

### Claim 9 (depends on 1)

The method of claim 1, wherein the location of the selected region of interest changes on a frame-by-frame basis.

### Claim 10 (depends on 1)

The method of claim 1, wherein the location of the selected region of interest changes on a segment-by-segment basis.

### Claim 11 (depends on 1)

The method of claim 1, wherein the information identifying the set of at least one available region of interest in the video content is sent in a manifest.

### Claim 12 (depends on 1)

The method of claim 1, wherein the second tone mapping is a gamma correction.

### Claim 13 (depends on 1)

The method of claim 1, wherein the second tone mapping sigmoidal mapping.

### Claim 14 (depends on 1)

The method of claim 1, wherein the region of interest is a border, and wherein an area enclosed by the border in the alternative video stream is generated using the first tone mapping.

### Claim 15

A system for providing user selectable tone mapping for regions of interest in video content, the system comprising a processor and a non-transitory computer-readable storage medium, the storage medium storing instructions operative, when executed on the processor, to perform functions comprising:
sending to a video client (i) a default video stream generated using a first tone mapping of the video content, and (ii) information identifying a set of at least one available region of interest in the video content;
receiving, from the video client, an indication of a selected region of interest from among the set of available regions of interest;
in response to receiving the indication of the selected region of interest, sending, to the client, an alternative video stream of the video content, wherein:
an area outside the selected region of interest is generated using the first tone mapping; and
an area inside the selected region of interest is generated using a second tone mapping different from the first tone mapping.
