# US 2019/0094554 A1 · Visual perception enhancement of displayed color symbology

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0094554 A1
- Document ID: US20190094554A1
- Status: Published application
- Kind: A1
- Application number: 16/185,952
- Filed: 2018-11-09
- Published: 2019-03-28
- Earliest claimed: 2014-12-14
- Assignees: Elbit Systems Ltd.
- Applicants: Elbit Systems Ltd.
- Inventors: Gil Benesh; Yoav Ophir
- Web page: https://patentgrep.com/patent/US20190094554A1

## CPC

- G02B 27/0172: {characterised by optical features}
- G02B 27/017: {Head mounted}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G02B 2027/0112: {comprising device for genereting colour display}
- G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility}
- G02B 2027/0181: {Adaptation to the pilot/driver}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Method and system for enhancing visual perception of augmented reality presentation. Location and line-of-sight (LOS) of user wearing see-through head-mounted display (HMD) is detected. A background environment viewed through HMD is determined based on detected location and LOS. Color-attribute(s) of background environment at background location corresponding to user LOS is determined and compared with color-attribute(s) of foreground supplementary image to be displayed on HMD overlaid onto background environment at background location. When an incompatibility condition is detected, visual parameter(s) of supplementary image is adjusted to minimize incompatibility. Color-attribute determination may use information obtained from users previously at background environment, and may be based on user perception resulting from interactions of: geographic location, time when background environment viewed, and user LOS. Supplementary image may be displayed at alternate background location determined according to non-color characteristic of supplementary image. Supplementary image may be displayed according to physical characteristics of HMD display screen.

## Claims

### Claim 1

A method for enhancing the visual perception of augmented reality presentation, the method comprising the procedures of:
detecting the location of a user, with a location measurement unit;
detecting the line-of-sight (LOS) of the user, with a line-of-sight detector;
determining a background environment viewed by the user through a see-through head-mounted display (HMD), based on at least the detected location and the detected LOS;
determining at least one color-attribute of the background environment at a background location corresponding to a LOS of the user;
comparing the determined color-attribute of the background environment at the background location with at least one color-attribute of a foreground supplementary image of a symbol, a text, or graphic or visual imagery, to be displayed on the HMD overlaid onto the view of the background environment at the background location; and
when an incompatibility condition is detected between the determined color-attribute of the background environment and the color-attribute of the foreground supplementary image, adjusting at least one visual parameter of the supplementary image in a manner that minimizes the incompatibility condition, and displaying the supplementary image with the adjusted visual parameter on the HMD at the background location.

### Claim 2 (depends on 1)

The method of claim 1, wherein the determined color-attribute of the background environment viewed by the user is determined using information obtained from at least another see-through HMD viewed by another respective user present at the background location prior to the user.

### Claim 3 (depends on 2)

The method of claim 2, wherein the information obtained from the at least another HMD comprises at least: the location of the another user; the LOS of the another user; and the color-attribute of the background environment viewed by the another user at a prior time.

### Claim 4 (depends on 1)

The method of claim 1, wherein the determined color-attribute of the background environment viewed by the user is determined based on the user perception of the background environment resulting from the interactions of: the geographic location of the background environment, the time at which the background environment is viewed, and the LOS of the user.

### Claim 5 (depends on 1)

The method of claim 1, wherein the adjusted visual parameter of the foreground supplementary image comprises displaying at least a portion of the supplementary image at an alternate background location determined in accordance with at least one non-color characteristic of the supplementary image.

### Claim 6 (depends on 1)

The method of claim 1, wherein the supplementary image with the adjusted visual parameter is displayed in accordance with physical characteristics of the HMD display screen, such that the perceived color-attributes of the supplementary image as perceived through the HMD display screen is consistent with the intended color-attributes of the supplementary image.

### Claim 7 (depends on 6)

The method of claim 6, wherein the displayed supplementary image is adaptively modified in accordance with dynamic physical characteristics of the HMD display screen.

### Claim 8

A system for enhancing the visual perception of augmented reality presentation, the system comprising:
a see-through head-mounted display (HMD), worn by a user, the HMD configured to enable the user to view a background environment, and to display foreground imagery overlaid onto the view of the background environment;
a location measurement unit, configured to detect the location of the user;
a line-of-sight detector, configured to detect the line-of-sight (LOS) of the user; and
a processor, coupled with the HMD, with the location measurement unit and with the line-of-sight detector, the processor configured to determine a background environment viewed by the user through the HMD, based on at least the detected location and the detected LOS, the processor further configured to determine at least one color-attribute of the background environment at a background location corresponding to a LOS of the user, the processor further configured to compare the determined color-attribute of the background environment at the background location with at least one color-attribute of a foreground supplementary image of a symbol, a text, or graphic or visual imagery, to be displayed on the HMD overlaid onto the view of the background environment at the background location, and when an incompatibility condition is detected between the determined color-attribute of the background environment and the color-attribute of the foreground supplementary image, the processor is further configured to adjust at least one visual parameter of the supplementary image in a manner that minimizes the incompatibility condition, such that the supplementary image is displayed with the adjusted visual parameter on the HMD at the background location.

### Claim 9 (depends on 8)

The system of claim 8, wherein the determined color-attribute of the background environment viewed by the user is determined using information obtained from at least another see-through HMD viewed by another respective user present at the background location prior to the user.

### Claim 10 (depends on 9)

The system of claim 9, wherein the information obtained from the at least another HMD comprises at least: the location of the another user; the LOS of the another user; and the color-attribute of the background environment viewed by the another user at a prior time.

### Claim 11 (depends on 8)

The system of claim 8, wherein the determined color-attribute of the background environment viewed by the user is determined based on the user perception of the background environment resulting from the interactions of: the geographic location of the background environment, the time at which the background environment is viewed, and the LOS of the user.

### Claim 12 (depends on 8)

The system of claim 8, wherein the adjusted visual parameter of the foreground supplementary image comprises displaying at least a portion of the supplementary image at an alternate background location determined in accordance with at least one non-color characteristic of the supplementary image.

### Claim 13 (depends on 8)

The system of claim 8, wherein the supplementary image with the adjusted visual parameter is displayed in accordance with physical characteristics of the HMD display screen, such that the perceived color-attributes of the supplementary image as perceived through the HMD display screen is consistent with the intended color-attributes of the supplementary image.

### Claim 14 (depends on 13)

The system of claim 13, wherein the displayed supplementary image is adaptively modified in accordance with dynamic physical characteristics of the HMD display screen.
