# US 2026/0289806 A1 · System for Displaying Virtual Images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0289806 A1
- Document ID: US20260289806A1
- Status: Published application
- Kind: A1
- Application number: 19/476,439
- Filed: 2024-04-30
- Published: 2026-09-24
- Earliest claimed: 2023-05-03
- Assignees: BAE SYSTEMS plc
- Applicants: Bae Systems PLC
- Inventors: Darren Neil Grimwood
- Web page: https://patentgrep.com/patent/US20260289806A1

## CPC

- G06T 7/593: from stereo images
- H04N 13/128: Adjusting depth or disparity
- G06T 7/292: Multi-camera tracking
- G06T 7/55: from multiple images
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/74: {involving reference images or patches}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06V 20/20: in augmented reality scenes
- G09G 3/001: {using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP)}
- G06T 7/174: involving the use of two or more images
- G06T 7/285: using a sequence of stereo image pairs
- G06T 15/00: Three-dimensional [3D] image rendering
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2207/30256: Lane; Road marking
- G06T 2207/30261: Obstacle
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A system (200) for displaying virtual images (43a, 43b), in an ambient scene, the system comprising: a display device (100) for presenting virtual images to the user in a user field of view; a first imaging device (22) generating first ambient image data (CD1) in a first portion (ABC) of the ambient scene, a second imaging device (24) generating second ambient image data (CD2) in a second portion (DEF) of the ambient scene, the first portion and second portion overlapping to define a common portion (GDB) of the ambient scene imaged by both the first and second imaging device; a processor unit (50) for: receiving virtual image data (VID) specifying a virtual image (43a, 43b) and a target real world object (T, R, S) or zone (302, 304) to which the virtual image (43a, 43b) should appear anchored; receiving the first and second ambient image data; from the first ambient image data, identifying the presence of the target real world object or zone, and determining a position of the target real world object or zone within the first portion of the ambient scene; from the second ambient image data, identifying the presence of the target real world object or zone, and determining a position of the target real world object or zone within the second portion of the ambient scene; calculating an offset between the position within the first portion and the position within the second portion; dependent on the offset, selecting a focal depth for the display of the virtual image; displaying the virtual image at the selected focal depth.

## Claims

### Claim 1

A system for displaying virtual images, in an ambient scene, the system comprising:
a display device for displaying virtual images in a user field of view at a first or a second depth;
a first imaging device for generating first ambient image data in a first portion of the ambient, scene;
a second imaging device for generating second ambient image data in a second portion of the ambient scene, the first portion and second portion overlapping to define a common portion of the ambient scene imaged by both the first and second imaging devices;
a processor unit for
receiving virtual image data specifying a virtual image and a target real world object or zone to which the virtual image should appear anchored,
receiving the first and second ambient image data,
identifying, from the first ambient image data, the presence of the target real world object or zone, and determining a position of the target real world object or zone within the first portion of the ambient scene,
identifying, from the second ambient image data, the presence of the target real world object or zone, and determining a position of the target real world object or zone within the second portion of the ambient scene,
calculating an offset between the position within the first portion and the position within the second portion,
selecting, dependent on the offset, a depth for the virtual; image, and
displaying the virtual image at the selected depth.

### Claim 2 (depends on 1)

The system according to claim 1, wherein identifying the presence of the target real world object or zone in the first or second portion of the ambient scene comprises performing object recognition by comparing the respective ambient image data against data representative of a pre-determined target or set of targets.

### Claim 3 (depends on 1)

The system according to claim 1, wherein identifying the presence of the target real world object or zone in the first and second portion of the ambient scene comprises performing object recognition by comparing the first ambient image data against the second ambient image data, to identify substantially identical image data.

### Claim 4 (depends on 1)

A The system according to claim 1, the system comprising a user-mountable frame for holding the display device in the user field of view.

### Claim 5 (depends on 4)

The system according to claim 4, wherein the first and second imaging devices are mounted at the frame.

### Claim 6 (depends on 5)

The system according to claim 5, wherein the first and second imaging devices are mounted at the frame such that they are either side of a user's eyes when the display device is held in the user field of view.

### Claim 7 (depends on 1)

The system according to claim 1, configured such that the common portion occupies at least substantially all of a user's binocular field of view.

### Claim 8 (depends on 1)

The system according to claim 1, wherein the offset is calculated by using:
an angular position of the object or zone from the first imaging device; and
an angular position of the object or zone from the second imaging device.

### Claim 9 (depends on 8)

The system according to claim 8, wherein the offset is calculated by subtracting one angular position from another.

### Claim 10 (depends on 1)

The system according to claim 1, wherein selecting, dependent on the offset, the depth for the virtual image, comprises:
applying a threshold to the offset;
selecting, for offsets above the threshold, for the virtual image at the first depth; and
selecting, for offsets below the threshold, for the virtual image at the second depth.

### Claim 11 (depends on 10)

The system according to claim 10, wherein the first depth is closer to the user than the second depth.

### Claim 12 (depends on 11)

The system according to claim 11, wherein the first depth is between 50 cm and 200 cm.

### Claim 13 (depends on 11)

The system according to claim 11, wherein the second depth is at infinity.

### Claim 14 (depends on 1)

The system according to claim 1, wherein the display device comprises a first image source for generating an optical signal bearing virtual images at the first depth, and a second image source for generating an optical signal bearing virtual images at the second depth.

### Claim 15 (depends on 1)

A helmet comprising a display system according to claim 1.

### Claim 16

A system comprising:
a display device for displaying virtual images in a user field of view;
a first imaging device configured to generate first ambient image data in a first portion of an ambient scene;
a second imaging device configured to generate second ambient image data in a second portion of the ambient scene, the first portion and second portion overlapping to define a common portion of the ambient scene imaged by both the first and second imaging devices;
a processor unit configured to
receive virtual image data specifying a virtual image and a target real world object or zone to which the virtual image should appear anchored,
receive the first and second ambient image data,
identify, from the first ambient image data, the presence of the target real world object or zone, and determine a position of the target real world object or zone within the first portion of the ambient scene,
identify, from the second ambient image data, the presence of the target real world object or zone, and determine a position of the target real world object or zone within the second portion of the ambient scene,
calculate an offset between the position within the first portion and the position within the second portion,
select, dependent on the offset, a depth for the virtual image, and
display the virtual image at the selected depth.

### Claim 17 (depends on 16)

The system according to claim 16, wherein the processor unit is configured to:
identify the presence of the target real world object or zone in the first or second portion of the ambient scene by comparing the respective ambient image data against data representative of a pre-determined target or set of targets; and/or
identify the presence of the target real world object or zone in the first and second portion of the ambient scene by comparing the first ambient image data against the second ambient image data, to identify substantially identical image data.

### Claim 18 (depends on 16)

The system according to claim 16, the system comprising a user-mountable frame for holding the display device in the user field of view, wherein the first and second imaging devices are mounted at the frame such that they are either side of a user's eyes when the display device is held in the user field of view.

### Claim 19

A system comprising:
a display device for displaying virtual images in a user field of view;
a first imaging device configured to generate first ambient image data in a first portion of an ambient scene;
a second imaging device configured to generate second ambient image data in a second portion of the ambient scene, the first portion and second portion overlapping to define a common portion of the ambient scene imaged by both the first and second imaging devices;
a processor unit configured to
receive virtual image data specifying a virtual image and a target real world object or zone to which the virtual image should appear anchored,
receive the first and second ambient image data,
identify, from the first ambient image data, the presence of the target real world object or zone, and determine a position of the target real world object or zone within the first portion of the ambient scene,
identify, from the second ambient image data, the presence of the target real world object or zone, and determine a position of the target real world object or zone within the second portion of the ambient scene,
calculate an offset between the position within the first portion and the position within the second portion, wherein the offset is calculated by using an angular position of the object or zone from the first imaging device, and an angular position of the object or zone from the second imaging device,
select, dependent on the offset, a depth for the virtual image, and
display the virtual image at the selected depth.

### Claim 20 (depends on 19)

The system according to claim 19, wherein the processor unit is configured to select, dependent on the offset, the depth for the virtual image, by:
applying a threshold to the offset;
selecting, for offsets above the threshold, for the virtual image at a first depth; and
selecting, for offsets below the threshold, for the virtual image at a second depth.
