US 2019/0196471 A1 · AUGMENTING AUTONOMOUS DRIVING WITH REMOTE VIEWER RECOMMENDATION

Abstract

Autonomous vehicles are an exciting prospect to the future of driving. However, concerns about the decision-making made by the AI controlling a vehicle has been of concern, particularly in light of high-profile accidents. We can alleviate some concern, introduce better decisions, and also train an AI to make better decisions by introducing a remote viewer's, e.g., a human's, reaction to a possibly complex environment surrounding a vehicle that includes a potential threat to the vehicle. One or more remote viewer may provide a recommended response to the threat that may be incorporated in whole or in part in how the vehicle reacts. Various ways to engage and utilize remote viewers are proposed to improve the likelihood of receiving useful recommendations, including modifying how the environment is presented to a remote viewer to best suit the remote viewer, e.g., perhaps present the threat in a game.

Claims20

Dependent claims

A system for operating an AD/SAD vehicle in communication over a network with at least one remote viewer, the vehicle having an associated environment the vehicle is within, the environment potentially including a threat to the vehicle, the system comprising:

a first sensor to sense the threat in the environment;
a simulator to prepare a construct to simulate the environment including the threat, the simulation to alter at least one of the environment or the threat;
an output to provide the construct over the network to the at least one remote viewer;
an input to receive at least one recommendation responsive to the construct;
and
an artificial intelligence (AI) associated with the vehicle to identify a candidate response to the threat based at least in part on knowledge associated with the AI, compare the candidate response to the at least one recommendation, and determine an action to perform in response to the threat based at least in part on the compare.

3 more elements

One or more non-transitory computer-readable media associated with a vehicle at least partially controlled by a neural network in communication with at least one sensor associated with the vehicle providing first sensor data in a first format, a control within the vehicle, and at least one remote viewer to receive second sensor data in a second format corresponding to the first sensor format, the media having instructions to provide for:

receiving the first sensor data;
identifying a threat to the vehicle;
providing the second sensor data to the at least one remote viewer;
identifying by the neural network a candidate response to the threat;
receiving one or more proposed response to the threat from the at least one remote viewer;
determining an action to perform responsive to the threat based at least in part on comparing the candidate response to selected ones of the one or more proposed response.

3 more elements

Dependencies are inferred from the claim text.

Augmenting autonomous driving with remote viewer recommendation

Life of this patent

Augmenting autonomous driving with remote viewer recommendation

Life of this patent

Abstract

Claims20