Road experience management (rem) map features delivered via augmented reality (ar)
AssigneeMobileye Vision Technologies Ltd.
InventorsEyal Bagon, Ofer Springer
Life of this patent
Estimating the term…
Abstract
Techniques are disclosed for using augmented reality (AR) displays to convey graphical representations of different types of information to a user. The information may be obtained from various sources such as objects and/or features that are dynamically detected by a vehicle or user-generated content. The graphical representations may also be based upon information that may be obtained via the use of crowdsourced AV map data. The graphical representations may be presented in as an AR view in a medium (such as a vehicle windshield) that matches a field of view of a user, thus accurately blending holographic information with the physical objects in the scene.
Claims30
A vehicle, comprising:
- processing circuitry configured to:
- determine a geographic location of the vehicle using autonomous vehicle (AV) map data that includes landmarks and corresponding predetermined geographic locations;
- compute a vehicle FoV that is associated with a position and orientation of the vehicle at the geographic location of the vehicle;
- compute an occupant field of view (FoV) associated with an occupant of the vehicle,
- identify one or more features and/or objects identified by the AV map data that are contained within the vehicle FoV;
- determine a relative location of the identified one or more features and/or objects with respect to the vehicle using the AV map data;
- and
- generate an augmented reality (AR) display frame based upon the geographic location of the vehicle, the occupant FoV, and the relative location of the identified one or more features and objects;
- and
- a display configured to present, in an AR view, the AR display frame that comprises a graphical representation associated with the one or more identified features and/or objects that are contained within the occupant FoV.
A non-transitory computer readable medium configured to store instructions that, when executed by processing circuitry of an augmented reality (AR) device, cause the AR device to:
- receive, via a communication link with a vehicle, data including (i) a geographic location of the vehicle, (ii) autonomous vehicle (AV) map data that includes landmarks and corresponding predetermined geographic locations, and (iii) a position and orientation of the vehicle;
- compute an occupant field of view (FoV) using sensor data indicative of a position and orientation of the AR device, the occupant FoV being associated with an occupant of the vehicle wearing the AR device;
- compute a vehicle FoV based upon the position and orientation of the vehicle at the geographic location of the vehicle;
- identify one or more features and/or objects identified by the AV map data that are contained within the vehicle FoV;
- determine a relative location of the identified one or more features and/or objects with respect to the vehicle using the AV map data;
- generate an AR display frame based upon the geographic location of the vehicle, the occupant FoV, and the relative location of the identified one or more features and objects;
- and
- cause a display of the AR device to present, in an AR view within the occupant FoV, the AR display frame that comprises a graphical representation of the one or more identified features and objects.
-22. (canceled)
-25. (canceled)
-35. (canceled)
An augmented reality (AR) device, comprising:
- a data interface configured to receive, via a communication link with a vehicle, data including (i) a geographic location of the vehicle, (ii) autonomous vehicle (AV) map data that includes landmarks and corresponding predetermined geographic locations, and (iii) a position and orientation of the vehicle;
- processing circuitry configured to:
- compute an occupant field of view (FoV) using sensor data indicative of a position and orientation of the AR device, the occupant FoV being associated with an occupant of the vehicle wearing the AR device;
- compute a vehicle FoV based upon the position and orientation of the vehicle at the geographic location of the vehicle;
- identify one or more features and/or objects identified by the AV map data that are contained within the vehicle FoV;
- determine a relative location of the identified one or more features and/or objects with respect to the vehicle using the AV map data;
- generate an AR display frame based upon the geographic location of the vehicle, the occupant FoV, and the relative location of the identified one or more features and objects;
- and
- a display configured to present, in an AR view within the occupant FoV, the AR display frame that comprises a graphical representation of the one or more identified features and objects.
-39. (canceled)
-42. (canceled)
-52. (canceled)
Dependencies are inferred from the claim text.