Methods and apparatuses for operating a self-driving vehicle
AssigneesHonda Motor Co., Ltd., The Regents of the University of California
InventorsAshish Tawari, Yi-Ting Chen, Teruhisa Misu, John F. Canny, Jinkyu Kim
Life of this patent
Estimating the term…
Abstract
Aspects of the present disclosure may include methods, apparatuses, and computer readable media for receiving one or more images having a plurality of objects, receiving a notification from an occupant of the self-driving vehicle, generating an attention map highlighting the plurality of objects based on at least one of the one or more images and the notification, and providing at least one of a steering control or a velocity control to operate the self-driving vehicle based on the attention map and the notification.
Claims18
A method for operating a self-driving vehicle, comprising:
- receiving one or more images having a plurality of objects;
- generating a plurality of visually-descriptive latent vectors based on the one or more images;
- receiving a notification from an occupant of the self-driving vehicle;
- generating a latent vector based on the notification;
- generating a feature vector based on the latent vector and at least one of the plurality of visually-descriptive latent vectors;
- generating an attention map highlighting at least some portions of the plurality of objects based on the feature vector;
- and
- providing at least one of a steering control or a velocity control to operate the self-driving vehicle based on the attention map and the notification.
A self-driving vehicle, comprising:
- a memory;
- one or more processors communicatively coupled to the memory, the one or more processors perform the steps of:
- receiving one or more images having a plurality of objects;
- generating a plurality of visually-descriptive latent vectors based on the one or more images;
- receiving a notification from an occupant of the self-driving vehicle;
- generating a latent vector based on the notification;
- generating a feature vector based on the latent vector and at least one of the plurality of visually-descriptive latent vectors;
- generating an attention map highlighting at least some portions of the plurality of objects based on the feature vector;
- and
- providing at least one of a steering control or a velocity control to control an operation of the vehicle based on the attention map and the notification.
A non-transitory computer readable medium having instructions stored therein, the instructions, when executed by one or more processors of the self-driving vehicle, cause the one or more processors to:
- receive one or more images having a plurality of objects;
- generate a plurality of visually-descriptive latent vectors based on the one or more images;
- receive a notification from an occupant of the self-driving vehicle;
- generate a latent vector based on the notification;
- generate a feature vector based on the latent vector and at least one of the plurality of visually-descriptive latent vectors;
- generate an attention map highlighting at least some portions of the plurality of objects based on the feature vector;
- and
- provide at least one of a steering control or a velocity control to control an operation of the self-driving vehicle based on the attention map and the notification.
Dependencies are inferred from the claim text.