# US 2022/0036804 A1 · Method and apparatus for colour imaging

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036804 A1
- Document ID: US20220036804A1
- Status: Published application
- Kind: A1
- Application number: 17/506,230
- Filed: 2021-10-20
- Published: 2022-02-03
- Earliest claimed: 2017-11-08
- Assignees: Displaylink (UK) Limited
- Applicants: DisplayLink (UK) Limited
- Inventors: Patrick Cooper; Matthew Parks; Colin Skinner
- Web page: https://patentgrep.com/patent/US20220036804A1

## CPC

- G09G 3/02: by tracing or scanning a light beam on a screen
- G09G 3/2092: {Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto (suitable for both CRT and flat panel G09G5/003; specific for a CRT G09G1/165)}
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/1407: {General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros}
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G06F 3/147: using display panels
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G09G 3/002: {to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT}
- G09G 3/2096: {Details of the interface to the display terminal specific for a flat panel (suitable for both CRT and flat panel G09G5/006; specific for a CRT G09G1/167)}
- H04N 13/344: with head-mounted left-right displays
- H04N 19/00: Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147)
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/63: using sub-band based transform, e.g. wavelets
- G02B 2027/0112: {comprising device for genereting colour display}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0147: {comprising a device modifying the resolution of the displayed image}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- G09G 2300/026: Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
- G09G 2320/04: Maintaining the quality of display appearance
- G09G 2340/02: Handling of images in compressed format, e.g. JPEG, MPEG
- G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G 2340/06: Colour space transformation
- G09G 2350/00: Solving problems of bandwidth in display systems
- G09G 2360/04: Display device controller operating with a plurality of display units
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for processing data for display on a screen involves encoding, using a first colour space, a first portion of image data intended to be displayed on a first area of the screen and encoding, using a second colour space, a second portion of image data intended to be displayed on a second area of the screen. The encoded first and second portions of the image data are compressed, and transmitted over a link for display on the screen. By using different colour spaces to encode image data that is displayed in different parts of a screen, differences in a users vision and/or aberrations caused by display equipment may be accounted for and so provide an improved user experience. Using different colour spaces for different screen areas may also reduce the amount of data that needs to be transmitted, for example by encoding image data more effectively and/or allowing more efficient compression of data.

## Claims

### Claim 1

A method for processing image data to be displayed on a screen, the method comprising:
determining a model of chromatic aberration across the screen;
selecting first and second color spaces based on the model of chromatic aberration;
encoding a first portion of the image data based on the first color space, the first portion of the image data to be displayed on a first area of the screen;
encoding a second portion of the image data based on the second color space, the second portion of the image data to be displayed on a second area of the screen;
compressing the first and second portions of image data for transmission; and
transmitting the compressed image data over a link for display on the screen.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the first area of the screen is at least one of a central zone of the screen or an area associated with a central portion of a viewer's vision; and
the second area of the screen is at least one of a peripheral zone of the screen or an area associated with a peripheral portion of the viewer's vision.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
determining a model of viewer sensitivity to light displayed at different locations on the screen, wherein the model of viewer sensitivity is a measure of the viewer's sensitivity to at least one of chrominance, luminance, or light of different wavelengths.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
comparing the model of viewer sensitivity to a threshold sensitivity;
defining the first area of the screen as an area of the screen for which the viewer's sensitivity is above the threshold sensitivity; and
defining the second area of the screen as an area of the screen for which the viewer's sensitivity is below the threshold sensitivity.

### Claim 5 (depends on 3)

The method of claim 3, wherein the model of viewer sensitivity is determined based on an expected sensitivity of the viewer to light in locations of the screen associated with a visual field of the viewer.

### Claim 6 (depends on 3)

The method of claim 3, further comprising:
displaying the light at different locations on the screen based on at least one of a configuration of a screen equipment or a position of the viewer in relation to the screen equipment.

### Claim 7 (depends on 1)

The method of claim 1, wherein the model of chromatic aberration is based on at least one of a configuration of a screen equipment or a position of an eye of the viewer.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
estimating a perceptual significance, to a viewer, of an image displayed on the screen based on the image data, the first and second color spaces being selected based at least in part on the estimated perceptual significance of the image data.

### Claim 9 (depends on 8)

The method of claim 8, wherein the perceptual significance is estimated based on at least one of movement, lines, contours, edges, color transitions, sharpness, or contrast associated with the image data.

### Claim 10 (depends on 1)

The method of claim 1, wherein:
the first color space is associated with a first color model;
the second color space is associated with a second color model;
the first color space is selected according to a first color mapping function; and
the second color space is selected according to a second color mapping function different than the first color mapping function.

### Claim 11 (depends on 1)

The method of claim 1, wherein the first color space is associated with a color model having a luminance component and at least one chrominance component, the second color space is associated with a color model having three color components, or both.

### Claim 12 (depends on 1)

The method of claim 1, wherein each of the first and second color spaces is associated with at least one of a Red-Green-Blue (RGB) color model, a Luminance-Bandwidth-Chrominance (YUV) color model, a Hue-Saturation-Lightness (HSL) model, or a modified version of the RGB, YUV, or HSL color model.

### Claim 13 (depends on 1)

The method of claim 1, wherein the encoding of at least one of the first portion of image data or the second portion of image data comprises:
altering a color space of previously encoded image data.

### Claim 14 (depends on 1)

The method of claim 1, wherein the encoding of at least one of the first portion of image data or the second portion of image data comprises:
obtaining a DC term and a plurality of AC terms for each respective frame block of the image data based on a discrete cosine transform (DCT), wherein the DC term corresponds to an average color of pixels associated with the respective frame block or an average brightness of pixels associated with the respective frame block, and wherein each of the plurality of AC terms corresponds to a difference in color among the pixels associated with the respective frame block or a difference in brightness among the pixels associated with the respective frame block.

### Claim 15 (depends on 1)

The method of claim 1, wherein the first portion of image data is compressed according to a first compression technique and the second portion of image data is compressed according to a second compression technique that is less lossy than the first compression technique.

### Claim 16 (depends on 1)

The method of claim 1, wherein the first and second color spaces are selected based on at least one of a position of a viewer's eye, an orientation of a viewer's eye, a model of a viewer's vision, a general model of vision, the image data, a content of the image data, a data speed of the link, or a latency of the link.

### Claim 17 (depends on 1)

The method of claim 1, wherein each of the first and second areas represents at least 10% of the screen.

### Claim 18 (depends on 1)

The method of claim 1, further comprising:
defining the first and second areas of the screen based on the model of chromatic aberration.

### Claim 19 (depends on 1)

The method of claim 1, wherein the model of chromatic aberration is determined based on an expected position of a viewer's retina.

### Claim 20

A system comprising:
one or more processors; and
at least one memory coupled to the one or more processors and storing instructions that, when executed by the one or more processors, cause the system to perform operations including:
determining a model of chromatic aberration across a screen;
selecting first and second color spaces based on the model of chromatic aberration;
encoding a first portion of image data based on the first color space, the first portion of the image data to be displayed on a first area of the screen;
encoding a second portion of the image data based on the second color space, the second portion of the image data to be displayed on a second area of the screen;
compressing the first and second portions of image data for transmission; and
transmitting the compressed image data over a link for display on the screen.
