# US 2019/0317600 A1 · Apparatus and a method for controlling a head-up display of a vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0317600 A1
- Document ID: US20190317600A1
- Status: Published application
- Kind: A1
- Application number: 16/473,188
- Filed: 2018-01-30
- Published: 2019-10-17
- Earliest claimed: 2017-02-13
- Assignees: Jaguar Land Rover Limited
- Applicants: Jaguar Land Rover Limited
- Inventors: Stuart WHITE; Lee SKRYPCHUK; Claudia KREHL; Robert HARDY; Jim BRAITH WAITE
- Web page: https://patentgrep.com/patent/US20190317600A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G01C 21/3647: {Guidance involving output of stored or live camera images or video streams}
- G01C 21/365: {Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G02B 2027/0181: {Adaptation to the pilot/driver}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

An apparatus (101), a method (1000), a system (120), a vehicle (103), a computer program (904) and a non-transitory computer readable medium (906) for controlling ahead-up display (102) of a vehicle (103) are disclosed. The apparatus (101) comprises control means (104) configured to obtain positional data representative of a position of an eye (105) of a user (106) of the vehicle (103), obtain environment data representative of the environment (107) external to the vehicle (103); and obtain status data representative of a current position (803) of the vehicle (103). The control means is also configured to determine a proposed position (804) and proposed orientation in dependence on the environment data and the status data, and in dependence on the proposed position (804), the proposed orientation and the positional data, generate image data for the head-up display (102) for causing the head-up display (102) to display a virtual object (108) so as to appear at the proposed position (804) and with the proposed orientation with respect to the environment (107).

## Claims

### Claim 1

An apparatus for controlling a head-up display of a vehicle, the apparatus comprising a controller configured to:
obtain positional data representative of a position of an eye of a user of the vehicle;
obtain environment data representative of an environment external to the vehicle;
obtain status data representative of a current position of the vehicle;
determine a proposed position and proposed orientation in dependence on the environment data and the status data;
in dependence on the proposed position, the proposed orientation and the positional data, generate image data for the head-up display for causing the head-up display to display a virtual object so as to appear at the proposed position and with the proposed orientation with respect to the environment; and
display an alternative graphical element in dependence on the proposed position being outside of a limit of the head-up display in which the virtual object is not present in a field of view of the head-up display.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the status data is additionally representative of a current orientation of the vehicle and the controller is configured to generate image data in dependence on the current orientation of the vehicle.

### Claim 3 (depends on 1)

The apparatus according to claim 1, wherein the environment data comprises route data representative of a route for the vehicle, the proposed position is on the route and the proposed orientation is indicative of a direction along the route.

### Claim 4 (depends on 1)

The apparatus according to claim 1, wherein the controller is configured to obtain speed data representative of a current speed of the vehicle, and determine the proposed position and proposed orientation in dependence on the environment data, the status data and the current speed of the vehicle.

### Claim 5 (depends on 1)

The apparatus according to claim 1, wherein the controller is configured to adjust an apparent distance between the vehicle and the virtual object.

### Claim 6 (depends on 5)

The apparatus according to claim 5, wherein the controller is configured to determine from the environment data a proposed speed for the vehicle at the proposed position, and to decrease the apparent distance between the vehicle and the virtual object in dependence on the current vehicle speed being greater than the proposed speed.

### Claim 7 (depends on 5)

The apparatus according to claim 5, wherein the controller is configured to decrease the apparent distance between the vehicle and the virtual object in dependence on the environment data being indicative of the vehicle approaching a section of a road/route having at least one of: a legal speed limit which is less than the current speed of the vehicle, a bend, a road junction, and traffic moving slower than the vehicle.

### Claim 8 (depends on 5)

The apparatus according to claim 5, wherein the controller is configured to determine from the environment data a proposed speed for the vehicle at the proposed position, and to increase the apparent distance between the vehicle and the virtual object in dependence on the current speed of the vehicle being less than the proposed speed.

### Claim 9 (depends on 1)

The apparatus according to claim 1, wherein the controller is configured to adjust a brightness of the virtual object in dependence on a determination that an obstruction is at the proposed position or between the vehicle and the proposed position.

### Claim 10 (depends on 9)

The apparatus according to claim 9, wherein the controller is configured to prevent the display of the virtual object in dependence on a determination that an obstruction is at the proposed position or between the vehicle and the proposed position.

### Claim 11 (depends on 9)

The apparatus according to claim 9, wherein the controller is configured to display an alternative graphical element to the virtual object in dependence on a determination that an obstruction is at the proposed position or between the vehicle and the proposed position.

### Claim 12

(canceled)

### Claim 13 (depends on 1)

The apparatus according to claim 1, wherein the controller is configured to determine the proposed position and the proposed orientation for a 3-dimensional object and to generate the image data for displaying the virtual object from a 3-dimensional model of the 3-dimensional object in dependence on the positional data, the status data and the proposed orientation.

### Claim 14 (depends on 1)

The apparatus according to claim 1, wherein the virtual object comprises a 2-dimensional virtual object.

### Claim 15

(canceled)

### Claim 16 (depends on 1)

The apparatus according to claim 1, wherein the alternative graphical element provides an indication of a direction of a route for the vehicle.

### Claim 17 (depends on 1)

The apparatus according to claim 1, wherein the controller is configured to determine, from the environment data, positions along a route where it is necessary to change direction or to turn onto a different road or to change of lane on a road while the vehicle is driven; and generate image data to cause an indication on the head-up display to provide a warning that a change in direction or a turn onto a different road or a change of lane is about to be required.

### Claim 18 (depends on 1)

The apparatus according to claim 1, wherein the controller is configured to receive environment data from at least one of: a satellite navigation module comprising a digitally stored map, one or more distance sensors, a radar system, a lidar system, and a camera.

### Claim 19 (depends on 1)

The apparatus according to claim 1, wherein the controller is configured to determine the current position and/or the current orientation of the vehicle from data obtained from a satellite navigation device, an inertial measurement unit (IMU), an accelerometer, a gyroscope and an odometer.

### Claim at position 20

20-24. (canceled)

### Claim 25

A method of controlling a head-up display of a vehicle, the method comprising:
obtaining positional data representative of a position of an eye of a user of the vehicle;
obtaining environment data representative of the environment external to the vehicle;
obtaining status data representative of a current position of the vehicle;
determining a proposed position and proposed orientation in dependence on the environment data and the status data of the vehicle;
in dependence on the proposed position, the proposed orientation and the positional data, generating image data for the head-up display for causing the head-up display to display a virtual object so as to appear at the proposed position and with the proposed orientation with respect to the environment; and
displaying an alternative graphical element in dependence on the proposed position being outside of a limit of the head-up display in which the virtual object is not present in a field of view of the head-up display.

### Claim at position 22

26-29. (canceled)

### Claim 30 (depends on 25)

A computer program which when executed by a processor causes the processor to perform the method of claim 25, wherein the computer program is stored on a non-transitory computer-readable storage medium.

### Claim at position 24

31-32. (canceled)

### Claim 33 (depends on 1)

A vehicle comprising the control apparatus of claim 1.
