# US 2019/0171218 A1 · External control of an autonomous vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171218 A1
- Document ID: US20190171218A1
- Status: Published application
- Kind: A1
- Application number: 15/833,695
- Filed: 2017-12-06
- Published: 2019-06-06
- Earliest claimed: 2017-12-06
- Assignees: Zoox, Inc.
- Applicants: Zoox, Inc.
- Inventors: Marcus Hammond; Marc Wimmershoff; Timothy David Kentley-Klay
- Web page: https://patentgrep.com/patent/US20190171218A1

## CPC

- G05D 1/221: Remote-control arrangements
- B60W 30/09: Taking automatic action to avoid collision, e.g. braking and steering
- G05D 1/0011: {associated with a remote control arrangement}
- G05D 1/024: {in combination with a laser (lasers per se H01S)}
- G05D 1/0276: {using signals provided by a source external to the vehicle (involving a plurality of vehicles G05D1/0287; automatically controlling vehicle speed responsive to externally generated signals B60K31/0058)}
- B60W 2520/10: Longitudinal speed
- B60W 2554/00: Input parameters relating to objects
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

Remote controlling of a vehicle, such as an autonomous vehicle, may sometimes be more efficient and/or reliable. Such control, however, may require processes for ensuring safety of surrounding persons and objects. Aspects of this disclosure include using onboard sensors to detect objects in an environment and alter remote commands according to such objects, e.g. by reducing a maximum permitted velocity of the vehicle as a function of distance to detected objects. In some examples described herein, such remote controlling may be performed by using objects in the environment as control objects, with movements of the control objects resulting in movement of the vehicle.

## Claims

### Claim 1

A vehicle comprising:
one or more sensors configured to sense objects in an environment of the vehicle;
one or more drive systems configured to cause the vehicle to move in the environment;
a control system configured to:
receive, from a source external to the vehicle, one or more control commands comprising a command for the vehicle to proceed in a direction at a commanded speed;
receive sensor data from the one or more sensors, the sensor data comprising information about an object in the environment;
determine a safety region proximate the vehicle;
determine, from the sensor data, a distance of the object from the vehicle;
determine, based at least in part on the distance, that the object is in the safety region;
determine, based at least in part on the object being in the safety region and the distance, a modified speed for the vehicle; and
control the one or more drive systems to move the autonomous vehicle in the direction at the modified speed.

### Claim 2 (depends on 1)

The vehicle of claim 1, wherein the safety region comprises:
a first safety region extending a first distance in the direction of travel relative to the vehicle, and
a second safety region extending a second distance in the direction of travel relative to the vehicle, wherein the second distance is greater than the first distance, and
wherein the control system determines the modified speed for the vehicle to be zero when the distance indicates that the object is in the first safety region.

### Claim 3 (depends on 2)

The vehicle of claim 2,
wherein the control system determines the modified speed to be a non-zero speed that is less than the commanded speed when the distance indicates that the object is in the second safety region.

### Claim 4 (depends on 3)

The vehicle of claim 3, wherein the modified speed is determined as at least one of a linear function or exponential function of the commanded speed, based on the distance.

### Claim 5 (depends on 2)

The vehicle of claim 2, wherein the first safety region has a first width in a lateral direction and the second region has a second width in the lateral direction.

### Claim 6 (depends on 5)

The vehicle of claim 5, wherein the one or more control commands further comprise a command for the vehicle to change the direction, and wherein the control system is further configured to alter at least one of the first width or the second width in response to the control command for the vehicle to change the direction.

### Claim 7

(canceled)

### Claim 8 (depends on 1)

The vehicle of claim 1, wherein:
the source is a person located in the environment,
the control system is further configured to determine a control region proximate the vehicle, and
the control command is determined at least in part based on a location of the person relative to the control region.

### Claim 9 (depends on 8)

The vehicle of claim 8, wherein the control system determines the speed for the vehicle based at least in part on the location of the person relative to the control region.

### Claim 10

A method of controlling a vehicle comprising:
receiving, from a source external to the vehicle, a control command for the vehicle to proceed in a direction at a commanded speed;
determining a region proximate the vehicle;
determining, from sensor data, a location of an object relative to the vehicle;
determining that the object is in the region;
determining, based at least in part on the object being in the region and the location, a modified speed for the vehicle different from the commanded speed; and
controlling the vehicle to move in the direction at the modified speed.

### Claim 11 (depends on 10)

The method of claim 10, wherein:
the region proximate the vehicle comprises a safety zone extending a distance in the direction,
the determining the location of the object comprises determining that the object is located in the first safety zone, and
the determining the modified speed comprises determining that the speed is zero at least in part in response to determining that the object is located in the first safety zone.

### Claim 12 (depends on 10)

The method of claim 10, wherein:
the region proximate the vehicle comprises a first safety zone extending a first distance in the direction and a second safety zone extending from the first distance to a second distance in the direction,
the determining the location of the object comprises determining that the object is located in the second safety zone, and
the determining the modified speed comprises determining that the modified speed as a non-zero speed less than the commanded speed at least in part in response to determining that the object is located in the second safety zone.

### Claim 13 (depends on 10)

The method of claim 10, further comprising:
determining, from sensor data, a location of a person relative to the vehicle, wherein the source comprises the person and the control command is based at least in part on the location of the person.

### Claim 14 (depends on 13)

The method of claim 13, wherein one of:
the location of the person is in a first control region on a side of the vehicle opposite the direction; or
the location of the person is outside of a second control region on a side of the vehicle in the direction.

### Claim 15 (depends on 13)

The method of claim 13, wherein the source comprises a remote controller, the method further comprising:
authenticating the remote controller at the vehicle, the authenticating comprising at least one of:
establishing a connection with the remote controller;
syncing the remote controller with the vehicle; or
recognizing the controller using at least one of pattern recognition or code recognition.

### Claim 16

An autonomous autonomous vehicle comprising:
one or more sensors configured to sense objects in an environment of the autonomous vehicle;
one or more drive systems configured to cause the autonomous vehicle to move in the environment; and
a control system configured to:
receive a command from a source external to the autonomous vehicle, the command configured to cause the vehicle to move in a direction at a speed;
receive sensor data from the one or more sensors disposed on the autonomous vehicle, the sensor data comprising information about an object in the environment;
determine a region proximate the autonomous vehicle;
determine, based on the information, that the object is in the region;
determine a distance of the object from the autonomous vehicle;
determine a modified speed as a function of the speed and the distance; and
control the one or more drive systems to move the autonomous vehicle at the modified speed.

### Claim 17 (depends on 16)

The autonomous vehicle of claim 16, wherein the source comprises a remote controller, the control system further configured to:
determine whether the distance is less than or equal to a threshold distance; and
determine an altered control command including the modified speed based on determining the distance is less than or equal to the threshold distance; and
control the vehicle based at least in part on the altered control command.

### Claim 18 (depends on 17)

The autonomous vehicle of claim 17, wherein the modified speed is a reduced speed and the reduced speed is determined as a linear function of the distance.

### Claim 19 (depends on 16)

The autonomous vehicle of claim 16, wherein the source is a person, the control system further configured to:
generate the command based on a position of the person, the command configured to control the one or more drive systems to move the autonomous vehicle to position the autonomous vehicle at a predetermined distance relative to the person.

### Claim 20 (depends on 19)

The autonomous vehicle of claim 19, wherein:
the command is a first command and the direction is a first direction,
the region extends a distance from the vehicle in the first direction and has a width, and
the control system is further configured to:
receive a second command to cause the vehicle to move in a second direction, and
alter at least one of the distance or the width of the region based at least in part on the second command.

### Claim 21 (depends on 1)

The vehicle of claim 1, wherein:
the distance is a first distance and the modified speed is a first modified speed and the first modified speed is non-zero; and
the control system is further configured to:
receive additional sensor data,
determine, based at least in part on the additional sensor data, a second distance of the object from the vehicle,
determine, based at least in part on the second object distance and the commanded speed, a second modified speed for the vehicle, the second modified speed being non-zero, and
control the one or more drive systems to move the vehicle in the direction at the second modified speed.
