Methods and systems for predicting object action
AssigneeToyota Research Institute, Inc.
InventorJens Strabo Hummelshøj
Life of this patent
Estimating the term…
Abstract
Embodiments described herein disclose methods and systems for discrete mobile object monitoring. Using location and information from the recognition process, historical action information about a discrete mobile object, and associated object statistical information derived from the historical action information, a hypothesis can be generated for future actions and movements of the discrete mobile object. The information can then be stored for later hypothesis derivation, thus providing a more human-like understanding of the discrete mobile object, useful in a variety of automated tasks.
Claims20
An object monitoring system for predicting object actions in an environment, comprising:
- one or more processors;
- and
- a memory communicably coupled to the one or more processors and storing instructions that when executed by the one or more processors cause the one or more processors to:
- obtain, using at least one image capture device having a fixed position within a traffic environment, one or more images of the traffic environment;
- monitor for a discrete mobile object in the traffic environment, the monitoring including analyzing the one or more images of the traffic environment to detect the discrete mobile object;
- uniquely identify the discrete mobile object by analyzing the one or more images of the traffic environment to detect patterns or markings of the discrete mobile object, whereby the discrete mobile object can be differentiated from other discrete mobile objects of the same class or type;
- create current action information for the discrete mobile object, wherein the current action information comprises information about pose and movement of the discrete mobile object during its current movement through the traffic environment;
- predict a future action of the discrete mobile object using the current action information and historical action information, wherein the historical action information comprises previously acquired information about the discrete mobile object during previous movements through the traffic environment collected over time, wherein the historical action information does not include the current action information, the historical action information being at least partially acquired from one or more databases of historical action information, the discrete mobile object being a single object, the current action information and the historical action information being for the single object;
- and
- remotely control a vehicle in the traffic environment using the future action, whereby the one or more processors and the memory are located remote from the vehicle.
A non-transitory computer-readable medium for predicting object actions in an environment and storing instructions that, when executed by one or more processors cause the one or more processors to:
- obtain, using at least one image capture device having a fixed position within a traffic environment, one or more images of the traffic environment;
- monitor for a discrete mobile object in the traffic environment, the monitoring including analyzing the one or more images of the traffic environment;
- uniquely identify the discrete mobile object by analyzing the one or more images of the traffic environment to detect patterns or markings of the discrete mobile object, whereby the discrete mobile object can be differentiated from other discrete mobile objects of the same class or type;
- create current action information for the discrete mobile object, wherein the current action information comprises information about pose and movement of the discrete mobile object during its current movement through the traffic environment;
- and
- predict a future action of the discrete mobile object using the current action information and historical action information, wherein the historical action information comprises previously acquired information about the discrete mobile object during previous movements through the traffic environment collected over time, wherein the historical action information does not include the current action information, the historical action information being at least partially acquired from one or more databases of historical action information, the discrete mobile object being a single object, the current action information and the historical action information being for the single object;
- and
- remotely control a vehicle in the traffic environment using the future action.
A method for predicting object actions in an environment, comprising:
- obtaining, using at least one image capture device having a fixed position within a traffic environment, one or more images of the traffic environment;
- monitoring for a discrete mobile object in the traffic environment, the monitoring including analyzing the one or more images of the traffic environment;
- uniquely identifying the discrete mobile object by analyzing the one or more images of the traffic environment to detect patterns or markings of the discrete mobile object, whereby the discrete mobile object can be differentiated from other discrete mobile objects of the same class or type;
- creating current action information for the discrete mobile object, wherein the current action information comprises information about pose and movement of the discrete mobile object during its current movement through the traffic environment;
- predicting a future action of the discrete mobile object using the current action information and historical action information, wherein the historical action information comprises previously acquired information about the discrete mobile object during previous movements through the traffic environment collected over time, wherein the historical action information does not include the current action information, the historical action information being at least partially acquired from one or more databases of historical action information, the discrete mobile object being a single object, the current action information and the historical action information being for the single object;
- and
- remotely controlling a vehicle in the traffic environment using the future action.
Dependencies are inferred from the claim text.