Method and system for generating augmented reality with a display of a motor vehicle

An augmented reality system of a motor vehicle, the system comprising:

• an image capture device with a plurality of cameras which is configured to record a stereoscopic image of an environment of the motor vehicle at a 360° angle in the form of stereoscopic image data;
• an arithmetic unit which is connected to the image capture device;
• a control unit which is connected to the arithmetic unit;
• and
• a display which is connected to the arithmetic unit displaying an output image;
• wherein the arithmetic unit is configured to:
• detect a three-dimensional course of a road from the stereoscopic image data;
• determine a three dimensional virtual space from the detected three-dimensional course of the road;
• detect a real object in the stereoscopic image data;
• determine a first coordinate range of the real object in the three dimensional virtual space;
• add a virtual element having a second coordinate range to the three dimensional virtual space;
• control the second coordinate range of the virtual element in the three dimensional virtual space by means of the control unit based on a user input;
• combine the environment and the controlled virtual element in the output image;
• modify the output image when the first coordinate range of the real object and the second coordinate range of the controlled virtual element form an intersection area;
• and
• implement a video game in the three dimensional virtual space, wherein the virtual element is controlled according to a ballistic trajectory in the three dimensional virtual space, and
• wherein the display comprises a projector for projecting the output image onto a window pane from certain angles so that the output image is not visible to a driver of the motor vehicle.

An augmented reality system in a vehicle, the system comprising:

• an image capture device with a plurality of cameras configured to record a stereoscopic image of an environment about the vehicle at a 360° angle to provide stereoscopic image data;
• a display for providing an output image;
• and
• an arithmetic unit connected to the image capture device and to the display, the arithmetic unit being configured to:
• detect a three-dimensional course of a road from the stereoscopic image data;
• determine a three dimensional virtual space from the detected three-dimensional course of the road;
• detect a real object in the stereoscopic image data;
• determine a first coordinate range of the real object in the three dimensional virtual space;
• add a virtual element having a second coordinate range to the three dimensional virtual space;
• control the second coordinate range of the virtual element in the three dimensional virtual space based on a user input;
• combine the environment and the controlled virtual element in the output image;
• and
• modify the output image when the first coordinate range of the real object and the controlled second coordinate range of the virtual element form an intersection area;
• and
• implement a video game in the three dimensional virtual space, wherein the virtual element is controlled according to a ballistic trajectory in the three dimensional virtual space, and
• wherein the display comprises a projector for projecting the output image onto a window pane from certain angles so that the output image is not visible to a driver of the vehicle.