Augmented reality wayfinding in rideshare applications

A system comprising:

• one or more processors;
• and
• memory comprising instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to:
• determine a first location of an autonomous vehicle (AV) relative to a second location of a computing device, wherein the computing device is associated with a user that requested a ride from the AV;
• based on the first location of the AV relative to the second location of the computing device, determine a direction from the second location of the computing device to the first location of the AV;
• present, at the client device, an audio cue informing the user that a user action can be performed to activate an augmented reality (AR) wayfinder feature wherein the user action comprises holding the client device vertically;
• in response to performance of the user action of holding the client device vertically, present a real-time feed from a camera sensor associated with the computing device, the real-time feed comprising a local scene captured by the camera sensor and the real-time being from a viewpoint of the camera sensor;
• present a virtual content overlay on the real-time feed, the virtual content overlay comprising a first indication of the direction from the second location of the computing device to the first location of the AV;
• present, at the client device, one or more selectable interface controls for remotely triggering activating a horn on the AV and unlocking the doors on the AV;
• determine that the AV is outside of a field-of-view (FOV) of the camera sensor;
• in response to determining that the AV is outside of the FOV of the camera sensor, present a virtual pointer instructing the user to point the camera sensor in a different direction determined to place the AV within the FOV of the camera sensor wherein a size of the virtual pointer is based on a distance between the AV and the client device;
• and
• continue, after a handoff between the AV and the computing device, to provide, on the computing device, wayfinding information from a drop-off location associated with the ride to a final destination.

A non-transitory computer-readable storage medium comprising:

• instructions stored on the non-transitory computer-readable storage medium, wherein the instructions, when executed by one or more processors, cause the one or more processors to:
• determine a first location of an autonomous vehicle (AV) relative to a second location of a client device associated with a user that requested a ride from the AV;
• based on the first location of the AV relative to the second location of the client device, determine a direction from the second location of the client device to the first location of the AV;
• present, at the client device, an audio cue informing the user that a user action can be performed to activate an augmented reality (AR) wayfinder feature wherein the user action comprises holding the client device vertically;
• in response to performance of the user action of holding the client device vertically, present a real-time feed from a camera sensor associated with the client device, the real-time feed comprising a local scene captured by the camera sensor and the real-time being from a viewpoint of the camera sensor;
• present a virtual content overlay on the real-time feed, the virtual content overlay comprising a first indication of the direction from the second location of the client device to the first location of the AV;
• present, at the client device, one or more selectable interface controls for remotely triggering activating a horn on the AV and unlocking the doors on the AV;
• determine that the AV is outside of a field-of-view (FOV) of the camera sensor;
• in response to determining that the AV is outside of the FOV of the camera sensor, present a virtual pointer instructing the user to point the camera sensor in a different direction determined to place the AV within the FOV of the camera sensor, wherein a size of the virtual pointer is based on a distance between the AV and the client device;
• and
• continue, after a handoff between the AV and the client device, to provide, on the client device, wayfinding information from a drop-off location associated with the ride to a final destination.