# US 2021/0279913 A1 · Augmented Reality Detection for Locating Autonomous Vehicles

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279913 A1
- Document ID: US20210279913A1
- Status: Published application
- Kind: A1
- Application number: 16/810,652
- Filed: 2020-03-05
- Published: 2021-09-09
- Earliest claimed: 2020-03-05
- Assignees: Rivian IP Holdings, LLC
- Applicants: Rivian IP Holdings, LLC
- Inventors: Matthew Hortop; Patrick Hunt; Lacey Trelfa
- Web page: https://patentgrep.com/patent/US20210279913A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- G06V 20/20: in augmented reality scenes
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- G06V 2201/08: Detecting or categorising vehicles
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed embodiments include methods, systems, and non-transitory computer readable medium for augmented reality detection for locating a particular autonomous vehicle. In a non-limiting embodiment, an illustrative method includes providing, by an electronic device to a remote server, a request for an autonomous vehicle. A first signal indicating that the autonomous vehicle is within an accessible range to an intended passenger is received by an electronic device. The passenger is prompted by the electronic device to orient an image sensor of the electronic device towards a designated area of the accessible range. The designated area is imaged by the image sensor for the autonomous vehicle. A visual representation of the imaged designated area is generated on a graphical user interface of the electronic device. The autonomous vehicle is identified within the generated visual representation.

## Claims

### Claim 1

A method of augmented reality detection for locating a particular autonomous vehicle, the method comprising:
providing, by an electronic device to a remote server, a request for an autonomous vehicle;
receiving, by the electronic device, a first signal indicating that the autonomous vehicle is within an accessible range to an intended passenger;
prompting, by the electronic device, the passenger to orient an image sensor of the electronic device towards a designated area of the accessible range;
imaging, by the image sensor, the designated area for the autonomous vehicle;
generating, by the electronic device, a visual representation of the imaged designated area on a graphical user interface of the electronic device; and
identifying, by the electronic device, the autonomous vehicle within the generated visual representation.

### Claim 2 (depends on 1)

The method of claim 1, wherein the imaging includes scanning the designated area with the image sensor and the method further comprises:
determining an orientation of the electronic device, based on data from an inertial sensor within the electronic device during scanning;
receiving, by the electronic device, a second signal from the autonomous vehicle during the scanning, the second signal being a line of sight signal between the autonomous vehicle and the electronic device; and
processing the second signal as a function of the scanning for use in the identifying, by the electronic device, the autonomous vehicle.

### Claim 3 (depends on 2)

The method of claim 2, wherein the processing of the second signal includes recording a strength of the second signal as a function of the scanning to identify a vector between the electronic device and the autonomous vehicle.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving, by the autonomous vehicle, a global positioning signal from one or more satellites;
determining, by the autonomous vehicle, a position of the autonomous vehicle within about one meter via one or more of the global positioning signal, high definition maps loaded on the autonomous vehicle, scanned information obtained by the autonomous vehicle, or imaged information obtained by the autonomous vehicle; and
providing, by the autonomous vehicle, the designated area to the remote server or the electronic device,
wherein the designated area includes the position and the electronic device includes the high definition maps.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
selecting, by the remote server, the autonomous vehicle from a pool of autonomous vehicles; and
providing, by the remote server, the request to the autonomous vehicle.

### Claim 6 (depends on 1)

The method according to claim 1, wherein identifying the autonomous vehicle includes displaying, on a display of the electronic device, an indication highlighting the autonomous vehicle by at least one of superimposing an image on the autonomous vehicle, highlighting the autonomous vehicle with a geometric annotation, or highlighting the autonomous vehicle with a color annotation.

### Claim 7 (depends on 1)

The method of claim 1, wherein the designated area includes an obstruction covering at least a portion of the autonomous vehicle.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first signal includes a Wi-Fi signal, a Bluetooth signal, or a pulsating laser light.

### Claim 9 (depends on 1)

The method of claim 1, further comprising providing access to the autonomous vehicle for the passenger via an access button on the graphical user interface of the electronic device.

### Claim 10

A system for locating autonomous vehicles, the system comprising:
a computer processing system; and a computer memory,
wherein the computer processing system is configured to execute steps including:
providing, by an electronic device to a remote server, a request for an autonomous vehicle;
receiving, by the electronic device, a first signal indicating that the autonomous vehicle is within an accessible range to an intended passenger;
prompting, by the electronic device, the passenger to orient an image sensor of the electronic device towards a designated area of the accessible range;
imaging, by the image sensor, the designated area for the autonomous vehicle;
generating, by the electronic device, a visual representation of the imaged designated area on a graphical user interface of the electronic device; and
identifying, by the electronic device, the autonomous vehicle within the generated visual representation.

### Claim 11 (depends on 10)

The system of claim 10, wherein the imaging includes scanning the designated area with the image sensor and the steps further comprise:
determining an orientation of the electronic device, based on data from an inertial sensor within the electronic device during scanning;
receiving, by the electronic device, a second signal from the autonomous vehicle during the scanning, the second signal being a line of sight signal between the autonomous vehicle and the electronic device; and
processing the second signal as a function of the scanning for use in the identifying, by the electronic device, the autonomous vehicle.

### Claim 12 (depends on 11)

The system of claim 11, wherein the processing the second signal includes recording a strength of the second signal as a function of the scanning to identify a vector between the electronic device and the autonomous vehicle.

### Claim 13 (depends on 10)

The system of claim 10, further comprising:
receiving, by the autonomous vehicle, a global positioning signal from one or more satellites;
determining, by the autonomous vehicle, a position of the autonomous vehicle within about one meter via one or more of the global positioning signal, high definition maps loaded on the autonomous vehicle, scanned information obtained by the autonomous vehicle, or imaged information obtained by the autonomous vehicle; and
providing, by the autonomous vehicle, the designated area to the remote server or the electronic device,
wherein the designated area includes the position and the electronic device includes the high definition maps.

### Claim 14 (depends on 10)

The system of claim 10, further comprising:
selecting, by the remote server, the autonomous vehicle from a pool of autonomous vehicles; and
providing, by the remote server, the request to the autonomous vehicle.

### Claim 15 (depends on 10)

The system according to claim 10, wherein identifying the autonomous vehicle includes displaying, on a display of the electronic device, an indication highlighting the autonomous vehicle by at least one of superimposing an image on the autonomous vehicle, highlighting the autonomous vehicle with a geometric annotation, or highlighting the autonomous vehicle with a color annotation.

### Claim 16 (depends on 10)

The system of claim 10, wherein the designated area includes an obstruction covering at least a portion of the autonomous vehicle.

### Claim 17 (depends on 10)

The system of claim 10, wherein the first signal includes a WiFi signal, a Bluetooth signal, or a pulsating laser light.

### Claim 18 (depends on 10)

The system of claim 10, further comprising providing access to the autonomous vehicle for the passenger via an access button on the graphical user interface of the electronic device.

### Claim 19

A non-transitory computer readable medium comprising:
program instructions for locating autonomous vehicles, the program instructions when executed causing a computer processing system to execute steps including:
providing, by an electronic device to a remote server, a request for an autonomous vehicle;
receiving, by the electronic device, a first signal indicating that the autonomous vehicle is within an accessible range to an intended passenger;
prompting, by the electronic device, the passenger to orient an image sensor of the electronic device towards a designated area of the accessible range;
imaging, by the image sensor, the designated area for the autonomous vehicle;
generating, by the electronic device, a visual representation of the imaged designated area on a graphical user interface of the electronic device; and
identifying, by the electronic device, the autonomous vehicle within the generated visual representation.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein the steps further include providing access to the autonomous vehicle for the passenger via an access button on the graphical user interface of the electronic device.
