# US 2019/0318159 A1 · Method for identifying a user entering an autonomous vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318159 A1
- Document ID: US20190318159A1
- Status: Published application
- Kind: A1
- Application number: 16/281,078
- Filed: 2019-02-20
- Published: 2019-10-17
- Earliest claimed: 2018-02-20
- Assignees: drive.ai Inc.
- Applicants: drive.ai Inc.
- Inventors: Fabien Blanc-Paques; Gahl Levy; Tory Smith; Chip J. Alexander; Vineet Jain
- Web page: https://patentgrep.com/patent/US20190318159A1

## CPC

- G06V 40/172: {Classification, e.g. identification}
- B60R 25/25: using biometry
- B60W 40/08: related to drivers or passengers
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06Q 10/02: Reservations, e.g. for tickets, services or events
- G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083)
- G06V 10/95: {structured as a network, e.g. client-server architectures}
- B60W 2040/0809: {Driver authorisation; Driver identity check}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

One variation of a method for identifying a user entering an autonomous vehicle includes: receiving a ride request from the user, the ride request specifying a pickup location; at the autonomous vehicle, autonomously navigating to the pickup location, scanning a field near the autonomous vehicle for a human approaching the autonomous vehicle, and, in response to detecting the human proximal the autonomous vehicle, recording an image of the human; detecting a face of the human in the image; accessing a faceprint characterizing facial features of the user; and, in response to the face of the human detected in the image exhibiting features represented in the faceprint, identifying the human as the user and triggering a door of the autonomous vehicle to unlock for the user.

## Claims

### Claim 1

A method for identifying a user entering an autonomous vehicle includes:
remotely from the autonomous vehicle, receiving a ride request from the user, the ride request specifying a pickup location;
at the autonomous vehicle:
autonomously navigating to the pickup location;
scanning a field near the autonomous vehicle for a human approaching the autonomous vehicle;
in response to detecting the human proximal the autonomous vehicle, serving a conversational prompt to the human; and
recording an audible response of the human;
accessing a voiceprint characterizing speech of the user; and
in response to the audible response exhibiting characteristics represented in the voiceprint:
identifying the human as the user; and
triggering a door of the autonomous vehicle to unlock for the user.

### Claim 2 (depends on 1)

The method of claim 1:
wherein receiving the ride request from the user comprises receiving the ride request via a mobile device associated with the user; and
further comprising:
in response to the audible response exhibiting characteristics distinct from characteristics represented in the voiceprint, identifying the human as other than the user;
at the autonomous vehicle, in response to identifying the human as other than the user, serving a prompt to the user to manually enter a passcode into a keypad arranged on the exterior of the autonomous vehicle, the passcode presented to the user via the mobile device; and
at the autonomous vehicle, in response to receipt of the passcode, triggering the door of the autonomous vehicle to unlock for the human.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
in response to the audible response exhibiting characteristics distinct from characteristics represented in the voiceprint, identifying the human as other than the user;
in response to identifying the human as other than the user:
at the autonomous vehicle, recording an image of the human via an optical sensor facing outwardly from the autonomous vehicle;
detecting a face of the human in the image;
accessing a faceprint characterizing facial features of the user; and
in response to the face of the human detected in the image exhibiting features represented in the faceprint:
identifying the human as the user; and
triggering the door of the autonomous vehicle to unlock for the user.

### Claim 4 (depends on 1)

The method of claim 1, further comprising, in response to the audible response exhibiting characteristics distinct from characteristics represented in the voiceprint:
identifying the human as other than the user; and
serving a second prompt to the human indicating that the autonomous vehicle is reserved for other than the human.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
in response to identifying the human as other than the user:
accessing a set of voiceprints characterizing speech of a set of users associated with user profiles on an autonomous vehicle ride platform; and
comparing features in the audible response to the set of voiceprints;
in response to the audible response exhibiting characteristics represented in a second voiceprint, in the set of voiceprints, associated with a second user in the set of users, identifying the human as the second user associated with a second user profile on the autonomous vehicle ride platform;
at the autonomous vehicle, in response to identifying the human as the second user, prompting the second user to initiate a second ride request; and
dispatching a second autonomous vehicle to the pickup location to collect the second user according to the second ride request.

### Claim 6 (depends on 4)

The method of claim 4:
in response to identifying the human as other than the user:
identifying a second ride request received from a second user and designating a second pickup location proximal the pickup location; and
accessing a second voiceprint characterizing speech of the second user;
in response to the audible response exhibiting characteristics represented in the second voiceprint, identifying the human as the second user; and
in response to identifying the human as the second user, retrieving a status of a second autonomous vehicle assigned to the second ride request; and
at the autonomous vehicle, presenting the status of the second autonomous vehicle to the second user.

### Claim 7 (depends on 6)

The method of claim 6:
wherein retrieving the status of the second autonomous vehicle comprises retrieving:
an estimated time of arrival of the second autonomous vehicle to a second pickup location designated in the second ride request; and
a description of the second autonomous vehicle; and
wherein presenting the status of the second autonomous vehicle to the second user comprises rendering the estimated time of arrival and the description of the second autonomous vehicle on an exterior-facing display arranged on the autonomous vehicle.

### Claim 8 (depends on 1)

The method of claim 1:
wherein receiving the ride request from the user comprises receiving the ride request from the user via a mobile device;
further comprising:
at the mobile device, presenting a passphrase to the user; and
prompting the user to recite the passphrase to the autonomous vehicle;
wherein recording the audible response of the human comprises recording the human reciting the passphrase.

### Claim 9 (depends on 1)

The method of claim 1:
further comprising, during a setup period:
generating a user profile for the user;
generating a recording of the user speaking at a mobile device associated with the user;
transforming the recording into the voiceprint of the user; and
storing the voiceprint in the user profile;
wherein receiving the ride request from the user comprises receiving the ride request from the user via the mobile device at a first time succeeding the setup period;
wherein accessing the voiceprint comprises, at the autonomous vehicle, accessing the voiceprint from the user profile in response to assignment of the ride request to the autonomous vehicle; and
wherein identifying the human as the user comprises, at the autonomous vehicle, locally verifying similarities between characteristics of the audible response and characteristics represented in the voiceprint.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
in response to the user entering the autonomous vehicle, serving a departure prompt to the user to confirm departure toward a destination location specified in the ride request;
recording a second audible response to the departure prompt;
detecting confirmation of departure in the second audible response;
identifying the user as a source of the second audible response in response to the second audible response exhibiting characteristics represented in the voiceprint; and
in response to detecting confirmation of departure in the second audible response and identifying the user as the source of the second audible response, triggering the autonomous vehicle to depart toward to the destination location.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
at the autonomous vehicle:
in response to entry of the user into the vehicle and receipt of confirmation from the user to depart toward a destination location specified by the user, autonomously navigating toward the destination location;
in response to arrival at the destination location and departure of the user from the autonomous vehicle, autonomously navigating toward a waiting zone associated with pedestrian traffic;
while occupying the waiting zone, scanning the field near the autonomous vehicle for a second human approaching the autonomous vehicle;
in response to detecting the second human proximal the autonomous vehicle, serving a second conversational prompt to the second human; and
recording a second audible response of the human;
accessing a set of voiceprints characterizing speech of a set of users associated with user profiles on an autonomous vehicle ride platform associated with the autonomous vehicle;
comparing features in the audible response to the set of voiceprints;
in response to the second audible response exhibiting characteristics represented in a second voiceprint, in the set of voiceprints, associated with a second user in the set of users, identifying the second human as the second user associated with a second user profile on the autonomous vehicle ride platform;
at the autonomous vehicle, in response to identifying the human as the second user, prompting the second user to initiate a second ride request; and
in response to the second user initiating the second ride request, triggering the door of the autonomous vehicle to unlock for the second user.

### Claim 12

A method for identifying a user entering an autonomous vehicle includes:
receiving a ride request from the user, the ride request specifying a pickup location;
at the autonomous vehicle:
autonomously navigating to the pickup location;
scanning a field near the autonomous vehicle for a human approaching the autonomous vehicle; and
in response to detecting the human proximal the autonomous vehicle, recording an image of the human;
detecting a face of the human in the image;
accessing a faceprint characterizing facial features of the user; and
in response to the face of the human detected in the image exhibiting features represented in the faceprint:
identifying the human as the user; and
triggering a door of the autonomous vehicle to unlock for the user.

### Claim 13 (depends on 12)

The method of claim 12:
wherein recording the image of the human comprises recording a three-dimensional optical scan of the human via an optical sensor facing outwardly from the autonomous vehicle; and
further comprising, at the autonomous vehicle:
in response to the user entering the autonomous vehicle and submitting confirmation to depart toward a destination location specified in the ride request, recording scan data through a set of sensors arranged on the autonomous vehicle, the set of sensors comprising the optical sensor;
electing a sequence of navigational actions based on the scan data; and
autonomously executing the sequence of navigational actions.

### Claim 14 (depends on 12)

The method of claim 12, further comprising:
in response to the face of the human detected in the image exhibiting characteristics distinct from features represented in the faceprint, identifying the human as other than the user;
in response to identifying the human as other than the user:
at the autonomous vehicle:
serving a conversational prompt to the human; and
recording an audible response of the human;
accessing a voiceprint characterizing speech of the user; and
in response to the audible response exhibiting characteristics represented in the voiceprint:
identifying the human as the user; and
triggering a door of the autonomous vehicle to unlock for the user.

### Claim 15 (depends on 12)

The method of claim 12, further comprising, in response to the face of the human detected in the image exhibiting characteristics distinct from features represented in the faceprint:
identifying the human as other than the user; and
serving a second prompt to the human indicating that the autonomous vehicle is reserved for other than the human.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
in response to identifying the human as other than the user:
accessing a set of faceprints characterizing facial features of a set of users associated with user profiles on an autonomous vehicle ride platform; and
comparing features of the face of the human depicted in the image to the set of faceprints;
in response to the face of the human detected in the image exhibiting characteristics represented in a second faceprint, in the set of faceprints, associated with a second user in the set of users, identifying the human as the second user associated with a second user profile on the autonomous vehicle ride platform;
at the autonomous vehicle, in response to identifying the human as the second user, prompting the second user to initiate a second ride request; and
dispatching a second autonomous vehicle to the pickup location to collect the second user according to the second ride request.

### Claim 17 (depends on 15)

The method of claim 15:
in response to identifying the human as other than the user:
identifying a second ride request received from a second user and designating a second pickup location proximal the pickup location; and
accessing a second faceprint characterizing facial features of the second user;
in response to the face of the human detected in the image exhibiting features represented in the second faceprint, identifying the human as the second user; and
in response to identifying the human as the second user, retrieving a status of a second autonomous vehicle assigned to the second ride request; and
at the autonomous vehicle, rendering the status of the second autonomous vehicle on a display arranged on the autonomous vehicle and facing the second user.

### Claim 18 (depends on 12)

The method of claim 12:
wherein receiving the ride request from the user comprises receiving the ride request via a mobile device associated with the user; and
further comprising:
at the mobile device, recording a two-dimensional optical scan of the user via a camera integrated into the mobile device; and
storing the two-dimensional optical scan of the user with the ride request;
wherein recording the image of the human comprises recording a three-dimensional optical scan of the human via an optical sensor facing outwardly from the autonomous vehicle;
wherein accessing the faceprint of the user comprises accessing the two-dimensional optical scan of the user;
wherein identifying the human as the user comprises matching three-dimensional features in the three-dimensional optical scan to two-dimensional features in the two-dimensional optical scan; and
further comprising, in response to identifying the human as the user, updating the faceprint of the user to further comprise three-dimensional features in the three-dimensional optical scan.

### Claim 19 (depends on 12)

The method of claim 12:
further comprising, during a setup period:
generating a user profile for the user;
recording an optical scan of the user via an optical sensor integrated into a mobile device associated with the user;
transforming the optical scan into the faceprint of the user; and
storing the faceprint in the user profile;
wherein receiving the ride request from the user comprises receiving the ride request from the user via the mobile device at a first time succeeding the setup period;
wherein accessing the faceprint comprises, at the autonomous vehicle, accessing the faceprint from the user profile in response to assignment of the ride request to the autonomous vehicle; and
wherein identifying the human as the user comprises, at the autonomous vehicle, locally verifying similarities between characteristics of the face detected in the image and features represented in the faceprint.

### Claim 20 (depends on 12)

The method of claim 12, further comprising:
at the autonomous vehicle:
in response to entry of the user into the vehicle and receipt of confirmation from the user to depart toward a destination location specified by the user, autonomously navigating toward the destination location;
in response to arrival at the destination location and departure of the user from the autonomous vehicle, autonomously navigating toward a waiting zone associated with pedestrian traffic;
while occupying the waiting zone, scanning the field near the autonomous vehicle for a second human approaching the autonomous vehicle; and
in response to detecting the human proximal the autonomous vehicle, recording a second image of the second human;
detecting a second face of the second human in the second image;
accessing a set of faceprints characterizing facial features of a set of users associated with user profiles on an autonomous vehicle ride platform associated with the autonomous vehicle;
comparing characteristics of the face of the second human detected in the second image to the set of faceprints;
in response to the second face of the second human detected in the second image exhibiting features represented in a second faceprint, in the set of faceprints, associated with a second user in the set of users, identifying the second human as the second user associated with a second user profile on the autonomous vehicle ride platform;
at the autonomous vehicle, in response to identifying the human as the second user, prompting the second user to initiate a second ride request; and
in response to the second user initiating the second ride request, triggering the door of the autonomous vehicle to unlock for the second user.