# US 10,872,582 B2 · Method and apparatus for increased color accuracy of display by compensating for observer's color vision properties

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,872,582 B2
- Document ID: US10872582B2
- Status: Granted
- Kind: B2
- Application number: 16/280,866
- Filed: 2019-02-20
- Published: 2019-08-29
- Granted: 2020-12-22
- Earliest claimed: 2018-02-27
- Assignees: Vid Scale, Inc.
- Applicants: Vid Scale, Inc.
- Inventors: David Wyble
- Web page: https://patentgrep.com/patent/US10872582B2

## CPC

- G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)}
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G02B 27/0172: {characterised by optical features}
- G06F 3/147: using display panels
- G02B 2027/0112: {comprising device for genereting colour display}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G09G 2320/0242: Compensation of deficiencies in the appearance of colours
- G09G 2340/06: Colour space transformation
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- G09G 2360/16: Calculation or use of calculated indices related to luminance levels in display data
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods are described for adjusting the color spectrum of synthetic objects in augmented reality (AR) displays under varying lighting conditions and a human observers spectral sensitivities, to produce customized color matches for a specific observer. Spectral data may be captured, and color matching functions (CMFs) of the observer may be used by a spectral color workflow that produces color display values, for example coordinates in RGB space. The color rendering may custom-match for multiple observers with different color perceptions under a wide range of environmental (ambient lighting) conditions.

## Claims

### Claim 1

A method comprising:
measuring illumination conditions of an environment;
determining an estimate of spectral illumination based upon illumination condition measurements;
determining information regarding color-matching characteristics of a user of the display;
determining spectral reflectance characteristics of at least a portion of a virtual object;
based at least in part on the spectral reflectance characteristics of the at least a portion of the virtual object, the estimate of spectral illumination and the information regarding color-matching characteristics of the user of the display, determining display color information for the at least a portion of the virtual object; and
causing display of the at least a portion of the virtual object using the display using the determined display color information for the at least a portion of the virtual object.

### Claim 2 (depends on 1)

The method of claim 1, wherein the determination of the display color is further based on the color-matching characteristics of the user of the display.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining an estimate of spectral illumination comprises determining a value of an illuminating spectral radiance S(λ) for each of a plurality of wavelengths λ.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining information regarding color-matching characteristics of a user of the display comprises determining an age of the user and selecting color-matching characteristics based on the user's age.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining information regarding color-matching characteristics of a user of the display comprises retrieving color-matching characteristics based on a user profile.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
determining spectral radiance of at least the portion of the virtual object based on the spectral reflectance and the estimate of spectral illumination; and
based at least in part on the spectral radiance, the estimate of spectral illumination, and the information regarding color-matching characteristics of the user of the display, determining tristimulus values representing a color of at least the portion of the virtual object;
wherein the display color information is determined based at least in part on the tristimulus values.

### Claim 7 (depends on 6)

The method of claim 6, wherein the tristimulus values are L, M, and S values and wherein determining display color information comprises:
converting from the L, M, and S tristimulus values to X, Y, and Z tristimulus values; and
using a display profile to convert from the X, Y, and Z tristimulus values to RGB values.

### Claim 8 (depends on 7)

The method of claim 7, wherein the conversion from the L, M, and S tristimulus values to the X, Y, and Z tristimulus values is based in part on the color-matching characteristics of the user.

### Claim 9 (depends on 6)

The method of claim 6, wherein the determination of the display color information is performed using a display profile to convert from the tristimulus values to RGB values.

### Claim 10 (depends on 6)

The method of claim 6, wherein the tristimulus values are L, M, and S values, and wherein the color-matching characteristics comprise values of l(λ), m(λ), and s(λ) for each of a plurality of wavelengths λ.

### Claim 11 (depends on 6)

The method of claim 6, wherein the tristimulus values are X, Y, and Z values, and wherein the color-matching characteristics comprise values of x(λ), y(λ), and z(λ) for each of a plurality of wavelengths λ.

### Claim 12 (depends on 6)

The method of claim 6, wherein determining the object spectral radiance comprises determining values L(λ) of spectral radiance for each of a plurality of wavelengths λ using L(λ) =S(λ)R (λ), where S(λ) is an illuminating spectral radiance representing the estimate of spectral illumination and R(λ) is a spectral reflectance factor of the portion of the virtual object.

### Claim 13 (depends on 6)

The method of claim 6, wherein determining the spectral radiance comprises determining values L(λ) of spectral radiance for each of a plurality of wavelengths λ, wherein the tristimulus values are X, Y, and Z values, wherein the color-matching characteristics comprise values of x(λ), y(λ), and z(λ) for each of a plurality of wavelengths λ, and wherein the determination of the tristimulus values is performed using:
L=∫L(λ)l(λ)dλ, M=∫L(λ)m(λ)dλ, and S=∫L(λ)s(λ)dλ.

### Claim 14 (depends on 6)

The method of claim 6, wherein determining the spectral radiance comprises determining values L(λ) of spectral radiance for each of a plurality of wavelengths λ, wherein the tristimulus values are X, Y, and Z values, wherein the color-matching characteristics comprise values of l(λ), m(λ), and s(λ) for each of a plurality of wavelengths λ, and wherein the determination of the tristimulus values is performed using:
X=∫L(λ)x(λ)dλ, Y=∫L(λ)y(λ)dλ, and Z=∫L(λ)z(λ)dλ.

### Claim 15 (depends on 6)

The method of claim 6, wherein the tristimulus values are X, Y, and Z values and wherein determining the display color information comprises selecting a display color such that a spectral radiance Ldisplay(λ) of the display substantially satisfies
X=∫Ldisplay(λ)x(λ)dλ, Y=∫Ldisplay(λ)y(λ)dλ, and Z=∫Ldisplay(λ)z(λ)dλ.

### Claim 16 (depends on 1)

The method of claim 1, wherein the display is a see-through head-mounted display.

### Claim 17 (depends on 16)

The method of claim 16, wherein the determination of the display color is further based upon spectral transmission characteristics of the see-through display.

### Claim 18 (depends on 16)

The method of claim 16, wherein the measuring of illumination conditions comprises using a forward-facing sensor of the see-through head-mounted display.

### Claim 19

A method comprising:
measuring current illumination conditions at an optical-see-through augmented-reality display;
determining a color-compensating transform for a user of the display;
determining object spectral radiance of at least a portion of a virtual object;
based at least in part on the object spectral radiance, the color-compensating transform and the current illumination conditions, determining a display color of a least a portion of the virtual object; and
displaying the virtual object on the display using the display color for the portion of the virtual object.

### Claim 20

A system comprising:
a processor; and
a non-transitory computer-readable medium storing instructions operative to perform functions comprising:
measuring illumination conditions of an environment;
determining an estimate of spectral illumination based upon illumination condition measurements;
determining information regarding color-matching characteristics of a user of the display;
determining spectral reflectance characteristics of at least a portion of a virtual object;
based at least in part on the spectral reflectance characteristics of the at least a portion of the virtual object, the estimate of spectral illumination and information regarding the color-matching characteristic of the user of the display, determining display color information for the at least a portion of the virtual object; and
causing display of the at least a portion of the virtual object using the display using the determined display color information for the at least a portion of the virtual object.