# US 2021/0276422 A1 · Method for the performance-enhancing driver assistance of a road vehicle with an augmented reality interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0276422 A1
- Document ID: US20210276422A1
- Status: Published application
- Kind: A1
- Application number: 17/194,384
- Filed: 2021-03-08
- Published: 2021-09-09
- Earliest claimed: 2020-03-09
- Assignees: Ferrari S.P.A.
- Applicants: FERRARI S.p.A.
- Inventors: Erik MASOERO; Pasquale VITIELLO; Filippo SERAFINI
- Web page: https://patentgrep.com/patent/US20210276422A1

## CPC

- B60W 30/0956: {the prediction being responsive to traffic or environmental parameters}
- G02B 27/0172: {characterised by optical features}
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60K 35/285: {for improving awareness by directing driver's gaze direction or eye points}
- B60K 35/80: Arrangements for controlling instruments
- B60K 35/81: for controlling displays
- B60W 40/08: related to drivers or passengers
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G01C 21/3453: {Special cost functions, i.e. other than distance or default speed limit of road segments}
- G01C 21/365: {Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself}
- G01D 5/20: by varying inductance, e.g. by a movable armature
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 2360/177: Augmented reality
- B60K 2360/21: using cameras
- B60K 2360/334: Projection means
- B60K 2360/48: Sensors
- B60K 2360/77: Instrument locations other than the dashboard
- B60W 2050/146: {Display means}
- B60W 2420/40: Photo, light or radio wave sensitive means, e.g. infrared sensors
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2420/50: Magnetic or electromagnetic sensors
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01D: MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR

## Abstract

A method for the performance-enhancing driver assistance of a road vehicle driven by a driver comprises the steps of: determining the current position and orientation of the road vehicle, detecting a plurality of environmental data concerning the surrounding environment, detecting a plurality of dynamic data of the vehicle, determining the current position and orientation of a helmet within the road vehicle and suggesting to the driver, by means of an augmented reality interface device, one or more corrective actions to be carried out in order to accomplish a mission optimizing a cost function.

## Claims

### Claim 1

1) A method for the performance-enhancing driver assistance of a road vehicle (1) driven by a driver (DR);
the method comprises the steps of:
determining, in use, the current position (AP) and orientation of the road vehicle (1) in the space by means of a localization device (3);
detecting, in use, a plurality of environmental data (ED) concerning the environment in which the road vehicle (1) operates by means of ADAS devices (4); and
detecting, in use, a plurality of dynamic data (DD) of the vehicle (1) by means of a control system (5);
the method being characterized in that it comprises the further steps of:
cyclically determining, in use, the current position and orientation of a helmet (10), which is worn by the driver (DR), within the road vehicle (1);
suggesting to the driver (DR), by means of an augmented reality interface device (11) and depending on the current position and orientation of the helmet (10) as well as on the plurality of environmental data (ED) and dynamic data (DD), one or more corrective actions (AC) to be carried out in order to accomplish a mission (M) optimizing a cost function (CF).

### Claim 2 (depends on 1)

2) The method according to claim 1, wherein:
the mission (M) comprises an optimal trajectory (T) determined depending on the current position (AP) of the vehicle, on the environmental data (ED) and on the dynamic data (DD) of the vehicle; and
when covering the optimal trajectory, the road vehicle (1) moves from the current position (AP) to an arrival point optimizing the cost function (CF).

### Claim 3 (depends on 1)

3) The method according to claim 1 and comprising a step of compensating the movements of the helmet (10), namely of the head of the driver (DR), and/or the movements of the vehicle suggesting the corrective actions (AC) by anchoring them to an inertial reference frame (WR) so as to superimpose the corrective actions (AC) on the environment in which the road vehicle (1) operates.

### Claim 4 (depends on 3)

4) The method according to claim 3, wherein the step of compensating the movements of the helmet (10) and/or the movements of the vehicle is carried out depending on the current position (AP) and orientation of the road vehicle (1), on the current position and orientation of the helmet (10), on the plurality of environmental data (ED) and, in particular, on the plurality of dynamic data (DD).

### Claim 5 (depends on 1)

5) The method according to claim 1, wherein the step of compensating the movements of the helmet (10) and/or the movements of the vehicle is carried out depending on an expected position and orientation of the road vehicle (1), on the current position and orientation of the helmet (10), on the plurality of environmental data (ED) and, in particular, on the plurality of dynamic data (DD).

### Claim 6 (depends on 1)

6) The method according to claim 1, wherein the vehicle is inside a track (8), which is provided with delimitations (D), and comprising a step of determining, only once, a virtual model of the track (8); and a step of superimposing delimitations (D′) of the track (8) of the virtual model upon the delimitation (D) of the actual track (8), in particular detected by means of a camera, so as to optimize the compensating step.

### Claim 7 (depends on 1)

7) The method according to claim 1, wherein the position and the orientation of the helmet (10) are determined using at least one optical device, in particular an infrared camera, or at least one electromagnetic detection device (12), in particular provided with a source unit (13) and with a receiver unit (14).

### Claim 8 (depends on 1)

8) The method according to claim 1, wherein the cost function (CF) to be optimized is the time needed to go from the current position (AP) to an arrival point of the road vehicle (1).

### Claim 9 (depends on 1)

9) The method according to claim 1, wherein the plurality of environmental data (ED) comprises the presence of obstacles and/or the position of cars to be surpassed.

### Claim 10

10) A performance-enhancing driver-assistance system (9) comprising:
a helmet (10), configured to be worn, in use, by a driver (DR) of a road vehicle (1);
an augmented reality interface device (11), which is configured to be mounted on and/or connected to said helmet (10);
a detection device (12), which is configured to determine the position and orientation of the helmet (10) within a road vehicle (1).

### Claim 11 (depends on 10)

11) The system (9) according to claim 10, wherein the detection device (12) comprises an electromagnetic source unit (13), which is configured to be mounted on a road vehicle (1), and an electromagnetic receiver unit (14), which is configured to be mounted on said helmet (10) so as to be integral to the helmet (10).

### Claim 12 (depends on 11)

12) The system (9) according to claim 11, wherein the source unit (13) and the receiver unit (14) each comprise at least three coils, in particular arranged on axes that are orthogonal to one another; the three coils of the source unit (13) being configured to each emit a variable magnetic field, which excites said at least three coils of the receiver unit (14), thus allowing, through the change generated by them due to the excitation, the position and orientation of the helmet (10) to be determined based on the change in the magnetic field emitted by the three coils of the source unit (13).

### Claim 13 (depends on 10)

13) The system (9) according to claim 10, wherein the augmented reality interface device (11) comprises at least one semi-transparent lens, which is configured to be placed in front of the eyes of the driver (DR) of the road vehicle (1) and to suggest one or more corrective actions (AC) to be carried out in order to accomplish a mission (M) optimizing a cost function (CF).

### Claim 14 (depends on 11)

14) The system (9) according to claim 11, wherein the receiver unit (14) and the interface device (11) can be powered by means of a power supply cable connected to the road vehicle (1) and/or by means of a power storage device.

### Claim 15 (depends on 11)

15) A road vehicle (1) comprising:
a localization device (3) configured to identify a current position and orientation of the road vehicle (1);
one or more ADAS devices (4) configured to detect a plurality of environmental data (ED) concerning the environment in which the road vehicle (1) operates;
a control system (5) configured to detect a plurality of dynamic data (DD) of the vehicle;
the vehicle being characterized in that it comprises a system (9) according to the claim 11.
