# US 12,183,233 B2 · Display apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,183,233 B2
- Document ID: US12183233B2
- Status: Granted
- Kind: B2
- Application number: 17/955,004
- Filed: 2022-09-28
- Published: 2023-04-13
- Granted: 2024-12-31
- Earliest claimed: 2021-10-13
- Assignees: TriLite Technologies GmbH
- Applicants: TriLite Technologies GmbH
- Inventors: Franz Josef Maier; Manuel Dorfmeister; Joerg Reitterer; Louahab Noui
- Web page: https://patentgrep.com/patent/US12183233B2

## CPC

- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G09G 3/02: by tracing or scanning a light beam on a screen
- G02B 26/085: {the reflecting means being moved or deformed by electromagnetic means}
- G02B 26/105: {with one or more pivoting mirrors or galvano-mirrors (G02B26/101 takes precedence)}
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 15/005: {General purpose rendering architectures}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0147: {comprising a device modifying the resolution of the displayed image}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G09G 2320/0233: Improving the luminance or brightness uniformity across the screen
- G09G 2320/0247: Flicker reduction other than flicker reduction circuits used for single beam cathode-ray tubes
- G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/18: Use of a frame buffer in a display terminal, inclusive of the display panel
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An apparatus for displaying a virtual scene comprises a display wearable on a user's head and a graphics controller configured to calculate, from scene data representing the virtual scene, image data for the display such that the virtual scene is displayed in the environment irrespective of the head's position and pointing direction, the virtual scene appearing in the image data in a region of scene, wherein the graphics controller is configured to modulate excitation signals of a Lissajous scanning mirror assembly, which diverts the light beam of a light source, by modulation signals which are dependent on the region of scene.

## Claims

### Claim 1

An apparatus for displaying a virtual scene at a selected position in an environment to a user who has a varying head position and head pointing direction in the environment, comprising:
a display wearable on the head in front of an eye and configured to display and concurrently combine an image on an image plane with light from the environment;
a head tracker configured to detect the varying head position and head pointing direction in the environment; and
a graphics controller connected to the head tracker and the display and having an input for scene data representing the virtual scene at the selected position, the graphics controller being configured to calculate, from the scene data, image data for the display such that the virtual scene is displayed to the eye at the selected position in the environment irrespective of the varying head position and head pointing direction;
wherein the image data is a succession of image frames to be displayed on the image plane with a frame rate, each image frame being composed of pixels and being displayed for a frame period, and the virtual scene appearing in each image frame in a region of scene, ROS;
wherein the display includes a mirror assembly connected to the graphics controller, a first mirror of the mirror assembly being configured to oscillate about a first axis upon excitation by a first excitation signal of a first frequency and the first or a second mirror of the mirror assembly being configured to oscillate about a second axis upon excitation by a second excitation signal of a second frequency;
wherein the display further includes a light source configured to project a light beam onto the mirror assembly for deflection by the mirror assembly towards the image plane, each pixel in the image plane being hit by the light beam with a per-pixel refresh rate, the light source having an input via which it can be controlled according to the pixels of the image data, the image data being fed from the graphics controller to the display via a buffer and an image processor which selectively reads-out the pixels from the buffer and then sequentially applies them to the input of the light source; and
wherein the graphics controller is configured to modulate one of the first and second excitation signals by a first modulation signal which is dependent on the ROS.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the dependency of the first modulation signal on the ROS is such that the per-pixel refresh rate is higher in the ROS than in a region outside of the ROS.

### Claim 3 (depends on 2)

The apparatus according to claim 2, wherein the graphics controller is configured such that said per-pixel refresh rate is, in an intermediate region between the ROS and said region outside of the ROS, lower than in the ROS and higher than in said region outside.

### Claim 4 (depends on 1)

The apparatus according to claim 1, wherein the dependency of the first modulation signal on the ROS is such that a number of passes of the light beam per unit area of the image plane and per frame period is higher in the ROS than in a region outside of the ROS,
wherein the image processor is configured to control the number of pixels read-out per unit area and per frame period such that said number of pixels is higher in the ROS than in a region outside of the ROS.

### Claim 5 (depends on 4)

The apparatus according to claim 4, wherein the graphics controller is configured such that said number of passes is, in an intermediate region between the ROS and said region outside of the ROS, lower than in the ROS and higher than in said region outside, and in that the image processor is configured such that said number of pixels read-out is, in said intermediate region, lower than in the ROS and higher than in said region outside.

### Claim 6 (depends on 4)

The apparatus according to claim 4, wherein the image processor is configured to receive a control signal from the graphics controller, wherein said control signal indicates a pixel read-out ratio to be used by the image processor when reading-out the pixels.

### Claim 7 (depends on 1)

The apparatus according to claim 1, wherein the head tracker is mounted on the display and has a camera for capturing a 3D segment of the environment from a current head position and in a current head pointing direction,
wherein the graphics controller has a memory containing a 3D model of the environment and is configured to detect the current head position and current head pointing direction from a comparison of the 3D segment with the 3D model.

### Claim 8 (depends on 1)

The apparatus according to claim 1, wherein the head tracker is mounted on the display and has a receiver for radio signals from known locations in the environment as well as an accelerometer for dead reckoning,
wherein the graphics controller is configured to detect a current head position and a current head pointing direction by means of the receiver and the accelerometer.

### Claim 9 (depends on 1)

The apparatus according to claim 1, wherein the graphics controller is configured to decrease the intensity of the light beam for a pixel in the ROS when an amount of time the light beam spends in that pixel during an image frame increases, and vice versa.

### Claim 10 (depends on 1)

The apparatus according to claim 1, wherein the graphics controller is configured to modulate the other one of the first and second excitation signals by a second modulation signal which is dependent on the ROS in each image frame.

### Claim 11 (depends on 10)

The apparatus according to claim 10, wherein at least one of the frequency of the first modulation signal and the frequency of the second modulation signal is a one- or morefold of the frame rate.

### Claim 12 (depends on 10)

The apparatus according to claim 10, wherein the graphics controller is configured to amplitude-modulate the first excitation signal by the first modulation signal and to amplitude-modulate the second excitation signal by the second modulation signal.

### Claim 13 (depends on 10)

The apparatus according to claim 10, wherein the graphics controller has a memory with a look-up table which stores, for each one of a set of different possible ROS within the image plane, respective first and second modulation signals dependent on that ROS, wherein the graphics controller is configured to retrieve the first and second modulation signals dependent on the ROS from the look-up table.

### Claim 14 (depends on 10)

The apparatus according to claim 10, wherein at least one of the first and second modulation signals is a triangular or saw-tooth signal with an offset, wherein the slopes of the saw-teeth or triangles and the offset depend on the ROS, or
wherein at least one of the first and second modulation signals is a sequence of sine halves with an offset, wherein the amplitudes of the sine halves and the offset depend on the ROS.

### Claim 15 (depends on 10)

The apparatus according to claim 10, wherein at least one of the first and second modulation signals is a repetition of a step-like function comprised of a first and a last section with high slope, a middle section with low slope, and an offset, wherein the respective slopes and lengths of the sections and the offset depend on the ROS, or
wherein at least one of the first and second modulation signals is a repetition of a step function comprised of at least two sections of different respective constant values, wherein the respective values and lengths of the sections depend on the ROS.