# US 12,505,639 B2 · Enhancing image data for different types of displays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,505,639 B2
- Document ID: US12505639B2
- Status: Granted
- Kind: B2
- Application number: 18/246,886
- Filed: 2021-10-01
- Published: 2023-11-16
- Granted: 2025-12-23
- Earliest claimed: 2020-10-02
- Assignees: IMAX Corporation
- Applicants: IMAX Corporation
- Inventors: Ning Zhang; Samuel Ziheng Zhou
- Web page: https://patentgrep.com/patent/US12505639B2

## CPC

- G06V 10/42: Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
- G09G 5/005: {Adapting incoming signals to the display format of the display terminal}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G09G 5/06: using colour palettes, e.g. look-up tables
- G09G 5/363: {Graphics controllers}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23439: {for generating different versions}
- H04N 21/23614: {Multiplexing of additional data and video streams (arrangements for simultaneous broadcast of plural pieces of information H04H20/28)}
- H04N 21/25825: {involving client display capabilities, e.g. screen resolution of a mobile phone (optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06)}
- H04N 21/26603: {for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques}
- H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)}
- H04N 21/4348: {Demultiplexing of additional data and video streams}
- H04N 21/440227: {by decomposing into layers, e.g. base layer and one or more enhancement layers}
- H04N 21/440263: {by altering the spatial resolution, e.g. for displaying on a connected PDA}
- H04N 21/45455: {applied to a region of the image}
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence)
- G09G 2320/066: for control of contrast
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G09G 2360/02: Graphics controller able to handle multiple formats, e.g. input or output formats
- G09G 2370/042: for monitor identification
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method is provided for generating enhanced image data for display on different types of display platforms. The method can include receiving a first format of display image data mastered to be displayed on a first type of display system. The method can include receiving a second format of display image data mastered to be displayed on a second type of display system that is different than the first type of display system. The method can include detecting one or more corresponding pixels in image segments among the first format of display image data and the second format of display image data. The method can include using attributes from the one or more corresponding pixel to generate enhanced image data for display.

## Claims

### Claim 1

A method of enhancing image data for display on a third type of display platform based on a first format of display image data and a second format of display image data, comprising:
receiving the first format of display image data mastered to be displayed on a first type of display platform;
receiving the second format of display image data mastered to be displayed on a second type of display platform that is different than the first type of display platform;
detecting one or more corresponding pixels in image segments among the first format of display image data and the second format of display image data;
converting, by a processor, the first format of display image data to be enhanced image data by:
transferring attributes of one or more corresponding pixels from the second format of display image data into the first format of display image data; and
using information that defines characteristics of the third type of display platform that are different from the first type of display platform to generate enhanced image data from the first format of display image data for display on the third type of display platform.

### Claim 2 (depends on 1)

The method of claim 1, wherein transferring attributes of the one or more corresponding pixels from the second format of display image data into the first format of display image data comprises:
generating segmented image data by comparing the first format of display image data and the second format of display image data to determine a plurality of image data similarities and a plurality of image data differences;
determining, based on spatial correspondence or temporal correspondence, a corresponding pixel pair between the first format of display image data and the second format of display image data from the segmented image data;
defining a local mask sequence using the corresponding pixel pair; and
outputting the local mask sequence as a mask file for generating enhanced image data to be displayed.

### Claim 3 (depends on 2)

The method of claim 2, wherein the local mask sequence includes at least one of a local dark area mask, a local highlight area mask, or a local high saturation area mask.

### Claim 4 (depends on 1)

The method of claim 1, wherein the characteristics of the third type of display platform are based on a specification from a manufacturer of the third type of display platform.

### Claim 5 (depends on 1)

The method of claim 1, wherein the characteristics of the third type of display platform are based on measurements of the third type of display platform under certain viewing conditions.

### Claim 6

A method of image enhancement for a third type of display platform, comprising:
receiving a first format of display image data mastered to be displayed on a first type of display platform;
receiving a second format of display image data mastered to be displayed on a second type of display platform that is different than the first type of display platform;
generating segmented image data by comparing the first format of display image data and the second format of display image data to determine a plurality of image data similarities and a plurality of image data differences;
determining, based on spatial correspondence or temporal correspondence, a corresponding pixel pair between the first format of display image data and the second format of display image data from the segmented image data;
defining a local mask sequence using the corresponding pixel pair;
using the local mask sequence as a mask file and information that defines characteristics of the third type of display platform for generating enhanced image data to be displayed on the third type of display platform.

### Claim 7 (depends on 6)

The method of claim 6, wherein the local mask sequence includes at least one of a local dark area mask, a local highlight area mask, or a local high saturation area mask.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
determining, based on a global feature, a related pixel group between the first format of display image data and the second format of display image data for the segmented image data based on a global feature;
determining a global feature transform by analyzing the related pixel group with the global feature; and
outputting the global feature transform.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
generating a metadata file based on the mask file and the global feature transform, the metadata file formatted to generate the enhanced image data.

### Claim 10 (depends on 8)

The method of claim 8, further comprising:
applying the global feature transform to modify the first format of display image data to produce enhanced first format of display image data;
creating a base layer and a detailed layer by applying layer decomposition to the enhanced first format of display image data;
modifying the base layer and the detailed layer using at least one mask to create a new base layer and a new detailed layer; and
reconstructing the new base layer and the new detailed layer to create new enhanced image data for display.

### Claim 11 (depends on 8)

The method of claim 8, further comprising:
modifying a parameter in the global feature transform based on the third type of display platform having a third display specification with a third display format to create transformation information;
modifying the first format of display image data using the transformation information to create an enhanced first format image display data;
decomposing the enhanced first format image display data to create a base layer and a detailed layer;
modifying the base layer and the detailed layer with at least one mask to produce a new base layer and a new detailed layer; and
reconstructing the new base layer and the new detailed layer to create new enhanced image data for display.

### Claim 12 (depends on 11)

The method of claim 11, wherein the third type of display platform is a large format display and the first type of display platform is a small format display.

### Claim 13 (depends on 11)

The method of claim 11, wherein the third type of display platform is configured to display different brightness images than the first type of display platform.

### Claim 14 (depends on 11)

The method of claim 11, wherein the third type of display platform is configured to display a different field of view than the first type of display platform.

### Claim 15 (depends on 8)

The method of claim 8, further comprising:
analyzing and modifying a local highlight area mask based on a third display characteristics, the local highlight area mask as modified is further categorized as a sparse local highlight mask or a spot local highlight mask;
modifying a parameter in the global feature transform based on a third display specification with a third display format and creating transformation information based on the parameter as modified;
modifying the first format of display image data using the transformation information, the sparse local highlight mask or the spot local highlight mask to create an enhanced first format image display data;
decomposing the enhanced first format data image data to create a base layer and a detailed layer;
modifying the base layer and the detailed layer with at least one mask to produce a new base layer and a new detailed layer; and
reconstructing the new base layer and the new detailed layer to create new enhanced image for display.

### Claim 16 (depends on 6)

The method of claim 6, wherein the first format of display image data is cinema image data.

### Claim 17

A system for enhancing image data for display on a third display platform based on a first format of display image data and a second format of display image data, the system comprising:
a processing device; and
a non-transitory computer-readable memory comprising instructions that are executable by the processing device for causing the processing device to:
receive a first format of display image data mastered to be displayed on a first type of display platform;
receive a second format of display image data mastered to be displayed on a second type of display system that is different than the first type of display platform;
detect one or more corresponding pixels in image segments among the first format of display image data and the second format of display image data;
convert the first format of display image data to be enhanced image data by:
transferring attributes of one or more corresponding pixels from the second format of display image data into the first format of display image data; and
using information that defines characteristics of the third display platform that are different from the first type of display platform to generate enhanced image data from the first format of display image data for display on the third display platform.

### Claim 18 (depends on 17)

The system of claim 17, wherein the memory further comprises instructions that are executable by the processing device for causing the processing device to transfer attributes of the one or more corresponding pixels from the second format of display image data into the first format of display image data by:
generating segmented image data by comparing the first format of display image data and the second format of display image data to determine a plurality of image data similarities and a plurality of image data differences;
determining, based on spatial correspondence or temporal correspondence, a corresponding pixel pair between the first format of display image data and the second format of display image data from the segmented image data;
defining a local mask sequence using the corresponding pixel pair; and
outputting the local mask sequence as a mask file for generating enhanced image data to be displayed.

### Claim 19 (depends on 18)

The system of claim 18, wherein the local mask sequence includes at least one of a local dark area mask, a local highlight area mask, or a local high saturation area mask.

### Claim 20

An image enhancement system for a third type of display platform, comprising:
a processing device; and
a non-transitory computer-readable memory comprising instructions that are executable by the processing device for causing the processing device to:
receive a first format of display image data mastered to be displayed on a first type of display platform;
receive a second format of display image data mastered to be displayed on a second type of display platform that is different than the first type of display platform;
generate segmented image data by comparing the first format of display image data and the second format of display image data to determine a plurality of image data similarities and a plurality of image data differences;
determine, based on spatial correspondence or temporal correspondence, a corresponding pixel pair between the first format of display image data and the second format of display image data from the segmented image data;
define a local mask sequence using the corresponding pixel pair;
use the local mask sequence as a mask file and information that defines characteristics of the third type of display platform for generating enhanced image data to be displayed on the third type of display platform.

### Claim 21 (depends on 20)

The image enhancement system of claim 20, wherein the local mask sequence includes at least one of a local dark area mask, a local highlight area mask, or a local high saturation area mask.

### Claim 22 (depends on 21)

The image enhancement system of claim 21, wherein the memory further comprises instructions that are executable by the processing device for causing the processing device to:
determine, based on a global feature, a related pixel group between the first format of display image data and the second format of display image data for the segmented image data based on a global feature;
determine a global feature transform by analyzing the related pixel group with the global feature; and
output the global feature transform.

### Claim 23 (depends on 22)

The image enhancement system of claim 22, wherein the memory further comprises instructions that are executable by the processing device for causing the processing device to:
generate a metadata file based on the mask file and the global feature transform, the metadata file formatted to generate the enhanced image data.

### Claim 24 (depends on 22)

The image enhancement system of claim 22, wherein the memory further comprises instructions that are executable by the processing device for causing the processing device to:
apply the global feature transform to modify the first format of display image data to produce enhanced first format of display image data;
create a base layer and a detailed layer by applying layer decomposition to the enhanced first format of display image data;
modify the base layer and the detailed layer using at least one mask to create a new base layer and a new detailed layer; and
reconstruct the new base layer and the new detailed layer to create new enhanced image data for display.

### Claim 25 (depends on 22)

The image enhancement system of claim 22, wherein the memory further comprises instructions that are executable by the processing device for causing the processing device to:
modify a parameter in the global feature transform based on a third type of display platform having a third display specification with a third display format to create transformation information;
modify the first format of display image data using the transformation information to create an enhanced first format image display data;
decompose the enhanced first format image display data to create a base layer and a detailed layer;
modify the base layer and the detailed layer with at least one mask to produce a new base layer and a new detailed layer; and
reconstruct the new base layer and the new detailed layer to create new enhanced image data for display.

### Claim 26 (depends on 25)

The image enhancement system of claim 25, wherein the third type of display platform is a large format display and the first type of display platform is a small format display.

### Claim 27 (depends on 25)

The image enhancement system of claim 25, wherein the third type of display platform is configured to display different brightness images than the first type of display platform.

### Claim 28 (depends on 25)

The image enhancement system of claim 25, wherein the third type of display platform is configured to display a different field of view than the first type of display platform.

### Claim 29 (depends on 22)

The image enhancement system of claim 22, wherein the memory further comprises instructions that are executable by the processing device for causing the processing device to:
analyze and modify a local highlight area mask based on a third display characteristics, the local highlight area mask as modified is further categorized as a sparse local highlight mask or a spot local highlight mask;
modify a parameter in the global feature transform based on a third display specification with a third display format and creating transformation information based on the parameter as modified;
modify the first format of display image data using the transformation information, the sparse local highlight mask or the spot local highlight mask to create an enhanced first format image display data;
decompose the enhanced first format data image data to create a base layer and a detailed layer;
modify the base layer and the detailed layer with at least one mask to produce a new base layer and a new detailed layer; and
reconstruct the new base layer and the new detailed layer to create new enhanced image data for display.

### Claim 30 (depends on 20)

The image enhancement system of claim 20, wherein the first format of display image data is cinema image data.