US 10,564,638 B1 · Teleoperator situational awareness

Abstract

A driverless vehicle may include a processor, a sensor, a network interface, and a memory having stored thereon processor-executable instructions. The driverless vehicle may be configured to obtain a stream of sensor signals including sensor data related to operation of the driverless vehicle from the sensor and/or the network interface. The driverless vehicle may be configured to determine a confidence level associated with operation of the driverless vehicle from the sensor data, and store the confidence level and at least a portion of the sensor data. The driverless vehicle may also be configured to transmit via the network interface a request for teleoperator assistance, and the request may include the portion of the sensor data and the confidence level.

Claims20

Dependent claims

A driverless vehicle comprising:

a processor;
a sensor;
a network interface;
and
a memory having stored thereon processor-executable instructions that, when executed by the processor, configure the driverless vehicle to:
receive sensor data from at least one of the sensor or the network interface, the sensor data related to operation of the driverless vehicle;
determine a confidence level associated with the operation of the driverless vehicle based at least in part on a portion of the sensor data;
store the confidence level as a stored confidence level and at least the portion of the sensor data as associated sensor data;
transmit, based at least in part on the confidence level, a request for teleoperator assistance via the network interface, the request including the portion of the sensor data and the confidence level;
receive a teleoperations signal via the network interface;
and
control the driverless vehicle based at least in part on the teleoperations signal.

9 more elements

A teleoperations system comprising:

at least one processor;
and
at least one memory having stored thereon processor-executable instructions that, when executed by the system, configure the teleoperations system to:
receive a request for teleoperator assistance from a driverless vehicle, the request including operation state data;
receive sensor data from the driverless vehicle;
based at least in part on the operation state data, determine at least a portion of one or more of the sensor data or the operation state data to present via a user interface;
based at least in part on the operation state data, select a teleoperation option from among a plurality of teleoperation options to present via the user interface;
and
cause presentation of the teleoperation option and the portion of one or more of the sensor data or the operation state data via the user interface.

6 more elements

A non-transitory computer-readable media having stored thereon processor-executable instructions that, when executed by a computer system, cause the computer system to:

receive a request for teleoperator assistance from a driverless vehicle, the request including operation state data;
obtain an indication of teleoperator bandwidth associated with a teleoperations device;
select the teleoperations device from among multiple teleoperations devices based at least in part on the teleoperator bandwidth associated with the teleoperations device and the operation state data;
and
transmit the request to the teleoperations device.

2 more elements

Dependencies are inferred from the claim text.

Teleoperator situational awareness

Life of this patent

Teleoperator situational awareness

Life of this patent

Abstract

Claims20