# US 2019/0317328 A1 · System and method for providing augmented-reality assistance for vehicular navigation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0317328 A1
- Document ID: US20190317328A1
- Status: Published application
- Kind: A1
- Application number: 15/955,338
- Filed: 2018-04-17
- Published: 2019-10-17
- Earliest claimed: 2018-04-17
- Assignees: Faraday & Future Inc.
- Applicants: Faraday&Future Inc.
- Inventors: Hong S. BAE
- Web page: https://patentgrep.com/patent/US20190317328A1

## CPC

- G02B 27/017: {Head mounted}
- G01C 21/365: {Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/20: in augmented reality scenes
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B 2027/0181: {Adaptation to the pilot/driver}
- G02B 2027/0183: {Adaptation to parameters characterising the motion of the vehicle}
- G02B 2027/0185: {Displaying image at variable distance}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The disclosure is related to a set of augmented reality (AR) driving glasses for use during operation of a vehicle, such as consumer automobile. In some embodiments, the AR driving glasses display one or more images related to vehicle operation, such as navigation images, hazard images, vehicle settings images, and other images. The images are generated based on data collected by one or more sensors of the vehicle (e.g., cameras, GPS, LIDAR, range sensors, ultrasonic sensors, etc.) and/or by one or more sensors included in the AR driving glasses (e.g., cameras, ambient light sensors, motion sensors, biometric sensors, etc.). The images are sized and displayed at a location on the display in accordance with at least data from one or more sensors of the AR driving glasses (e.g., motion data or camera data) and/or data from the vehicle (e.g., vehicle speed).

## Claims

### Claim 1

An augmented-reality system having an eyewear apparatus comprising:
a frame;
at first lens connected to the frame, the first lens comprising a display;
one or more sensors;
one or more processors operatively coupled to the one or more sensors; and
a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising the steps of:
generating one or more images to be displayed on the displays based at least on data from the one or more sensors.

### Claim 2 (depends on 1)

The system of claim 1, wherein:
the first lens is located such that it is in front of the eyes of a wearer of the eyewear apparatus,
the eyewear apparatus further comprises:
a second lens, the second lens comprising a display, the second lens located such that it is at a periphery of an eye of the wearer of the eyewear apparatus, and
a transceiver operatively coupled to a vehicle,
the vehicle includes a side mirror camera, and
the method performed by the processors further comprises the step of generating an image of the one or more images on the second lens based on data from the side mirror camera, the data received from the vehicle at the transceiver of the eyewear apparatus.

### Claim 3 (depends on 1)

The system of claim 1, wherein:
the first lens has a variable focal point,
the one or more sensors comprise an iris scanner, and
the method further comprises the steps of:
receiving, from the iris scanner, biometric data,
matching the received biometric data to a stored user profile, and
controlling the variable focal point of the first lens to become a stored focal point associated with the stored user profile.

### Claim 4 (depends on 1)

The system of claim 1, wherein:
the one or more sensors comprise a gyroscope, and
the method further comprises the steps of:
receiving, from the gyroscope, one or more of motion and orientation data, and
determining one or more of a location and size of the one or more images to be displayed in accordance with the one or more of motion and orientation data.

### Claim 5 (depends on 1)

The system of claim 1, further comprising:
one or more cameras directed towards eyes of a wearer of the eyewear apparatus, wherein the method further comprises the steps of:
receiving, from the one or more cameras, one or more captured images including the eyes of the wearer, and
determining one or more of a location and size of the one or more images to be displayed in accordance with the one or more captured images.

### Claim 6 (depends on 1)

The system of claim 1, further comprising:
a vibrating mechanism, wherein the method further comprises the steps of:
detecting a hazard,
generating one or more image notifications of the hazard, and
while displaying the one or more image notifications of the hazard, causing the vibrating mechanism to vibrate.

### Claim 7 (depends on 1)

The system of claim 1, further comprising:
a connector cable couplable to a vehicle, the connector cable configured to receive power from the vehicle, and transmit information to and from the vehicle.

### Claim 8 (depends on 1)

The system of claim 1, further comprising:
a wireless transceiver, wherein the method further comprises the steps of:
receiving, at the wireless transceiver, vehicle speed data from a vehicle operatively coupled to the eyewear apparatus, and
determining one or more of a location and size of the one or more images to be displayed in accordance with the vehicle speed data.

### Claim 9 (depends on 1)

The system of claim 1, further comprising:
a wireless transceiver, wherein the method further comprises the steps of:
receiving, at the wireless transceiver, vehicle settings data including an indication of a change in a vehicle setting from a vehicle operatively coupled to the eyewear apparatus,
generating a vehicle settings image based on the vehicle settings data, and
displaying the vehicle settings image at a location on the first lens corresponding to a component of the vehicle associated with the vehicle setting.

### Claim 10

A method of displaying an image on an eyewear apparatus, the method comprising:
receiving data from one or more sensors included in the eyewear apparatus; and
generating an image for display on a display included in a first lens included in the eyewear apparatus, the images generated based on at least the data from the one or more sensors.

### Claim 11 (depends on 10)

The method of claim 10, wherein:
the first lens is located such that it is in front of the eyes of a wearer of the eyewear apparatus,
the eyewear apparatus further comprises:
a second lens, the second lens comprising a display, the second lens located such that it is at a periphery of an eye of the wearer of the eyewear apparatus, and
a transceiver operatively coupled to a vehicle,
the vehicle includes a side mirror camera, and
the method further comprises the step of generating an image of the one or more images on the second lens based on data from the side mirror camera, the data received from the vehicle at the transceiver of the eyewear apparatus.

### Claim 12 (depends on 10)

The method of claim 10, wherein:
the one or more sensors comprise a gyroscope, and
the method further comprises the steps of:
receiving, from the gyroscope, one or more of motion and orientation data, and
determining one or more of a location and size of the one or more images to be displayed in accordance with the one or more of motion and orientation data.

### Claim 13 (depends on 10)

The method of claim 10, wherein:
the eyewear apparatus further includes one or more cameras directed towards eyes of a wearer of the eyewear apparatus, and
the method further comprises the steps of:
receiving, from the one or more cameras, one or more captured images including the eyes of the wearer, and
determining one or more of a location and size of the one or more images to be displayed in accordance with the one or more captured images.

### Claim 14 (depends on 10)

The method of claim 10, wherein:
the eyewear apparatus further comprises a vibrating mechanism, and
the method further comprises the steps of:
detecting a hazard,
generating one or more image notifications of the hazard, and
while displaying the one or more image notifications of the hazard, causing the vibrating mechanism to vibrate.

### Claim 15 (depends on 10)

The method of claim 10, wherein:
the eyewear apparatus further comprises a wireless transceiver, and
the method further comprises the steps of:
receiving, at the wireless transceiver, vehicle speed data from a vehicle operatively coupled to the eyewear apparatus, and
determining one or more of a location and size of the one or more images to be displayed in accordance with the vehicle speed data.

### Claim 16 (depends on 10)

The method of claim 10, wherein:
the eyewear apparatus further comprises a wireless transceiver, and
the method further comprises the steps of:
receiving, at the wireless transceiver, vehicle settings data including an indication of a change in a vehicle setting from a vehicle operatively coupled to the eyewear apparatus,
generating a vehicle settings image based on the vehicle settings data, and
displaying the vehicle settings image at a location on the first lens corresponding to a component of the vehicle associated with the vehicle setting.

### Claim 17

A non-transitory computer-readable medium including instructions, which when executed by one or more processors of an eyewear apparatus, cause the one or more processors to perform a method comprising:
receiving data from one or more sensors included in the eyewear apparatus; and
generating an image for display on a display included in a first lens included in the eyewear apparatus, the images generated based on at least the data from the one or more sensors.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein:
the first lens is located such that it is in front of the eyes of a wearer of the eyewear apparatus,
the eyewear apparatus further comprises:
a second lens, the second lens comprising a display, the second lens located such that it is at a periphery of an eye of the wearer of the eyewear apparatus, and
a transceiver operatively coupled to a vehicle,
the vehicle includes a side mirror camera, and
the method further comprises the step of generating an image of the one or more images on the second lens based on data from the side mirror camera, the data received from the vehicle at the transceiver of the eyewear apparatus.

### Claim 19 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein:
the eyewear apparatus further comprises a wireless transceiver, and
the method further comprises the steps of:
receiving, at the wireless transceiver, vehicle speed data from a vehicle operatively coupled to the eyewear apparatus, and
determining one or more of a location and size of the one or more images to be displayed in accordance with the vehicle speed data.

### Claim 20 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein:
the eyewear apparatus further comprises a wireless transceiver, and
the method further comprises the steps of:
receiving, at the wireless transceiver, vehicle settings data including an indication of a change in a vehicle setting from a vehicle operatively coupled to the eyewear apparatus,
generating a vehicle settings image based on the vehicle settings data, and
displaying the vehicle settings image at a location on the first lens corresponding to a component of the vehicle associated with the vehicle setting.