Back to results
US 12,600,382 B2Granted
Process scheduling based on data arrival in an autonomous vehicle
AssigneeApplied Intuition, Inc.
InventorsJohn Hayes, Volkmar Uhlig
Life of this patent
Estimating the term…
Abstract
Process scheduling based on data arrival in an autonomous vehicle, including: receiving, by a node and from one or more other nodes of a distributed automation computing system, a plurality of portions of data; generating a process schedule by scheduling, for each portion of data of the plurality of portions of data, a process for processing a corresponding portion of data within a time window, wherein an ordering of the process schedule corresponds to an order of arrival of the plurality of portions of data; and executing, during the time window, the process schedule.
Claims20
A method comprising:
- receiving, by a first compute node configured to process sensor data in an autonomous vehicle at each interval of a pipeline time window and from one or more sensor nodes of a distributed automation computing system, a first portion of sensor data in a first interval of the pipeline time window;
- detecting, during the first interval of the pipeline time window, a first characteristic of the first portion of sensor data;
- generating a process schedule by assigning a first model to process the first portion of sensor data within a time window, the first model selected from a plurality of models according to the first characteristic of the first portion of sensor data, wherein an ordering of the process schedule corresponds to an order of arrival of the first portion of sensor data within the sensor data;
- detecting, during a second interval of the pipeline time window subsequent to the first interval of the pipeline time window, that a second portion of sensor data received during the second interval of the pipeline time window failed to arrive within a particular time constraint was received too late to be processed by the first model within the second interval of the pipeline time window;
- adjusting the process schedule by assigning a second model to process the second portion of sensor data within a next interval immediately subsequent to the second interval of the pipeline time window, the second model selected from the plurality of models according to an ability of the second model to process the second portion of sensor data within a reduced processing time compared to a processing time of the first model;
- executing, according to the ordering of the process schedule, the first model on the first portion of data and the second model on the second portion of data;
- and
- executing, using a result of executing the first model on the first portion of data and a second result of executing the second model on the second portion of data, a control operation of the autonomous vehicle .
5 more elements
A method comprising:
- receiving, by a first compute node configured to process sensor data in an autonomous vehicle at each interval of a pipeline time window and from one or more sensor nodes of a distributed automation computing system, a first portion of sensor data in a first interval of the pipeline time window;
- detecting, during the first interval of the pipeline time window, a first characteristic of the first portion of sensor data;
- generating a process schedule by assigning a first model to process the first portion of sensor data within a time window, the first model selected from a plurality of models according to the first characteristic of the first portion of sensor data, wherein an ordering of the process schedule corresponds to an order of arrival of the first portion of sensor data within the sensor data;
- detecting, during a second interval of the pipeline time window subsequent to the first interval of the pipeline time window, that a second portion of sensor data received during the second interval of the pipeline time window failed to arrive within a particular time constraint was received too late to be processed by the first model within the second interval of the pipeline time window;
- adjusting the process schedule by assigning a second model to process the second portion of sensor data within a next interval immediately subsequent to the second interval of the pipeline time window, the second model selected from the plurality of models according to an ability of the second model to process the second portion of sensor data within a reduced processing time compared to a processing time of the first model;
- executing, according to the ordering of the process schedule, the first model on the first portion of data and the second model on the second portion of data;
- and
- executing, using a result of executing the first model on the first portion of data and a second result of executing the second model on the second portion of data, a control operation of the autonomous vehicle.
5 more elements
A method comprising:
- receiving, by a first compute node configured to process sensor data in an autonomous vehicle at each interval of a pipeline time window and from one or more sensor nodes of a distributed automation computing system, a first portion of sensor data in a first interval of the pipeline time window;
- detecting, during the first interval of the pipeline time window, a first characteristic of the first portion of sensor data;
- generating a process schedule by assigning a first model to process the first portion of sensor data within a time window, the first model selected from a plurality of models according to the first characteristic of the first portion of sensor data, wherein an ordering of the process schedule corresponds to an order of arrival of the first portion of sensor data within the sensor data;
- detecting, during a second interval of the pipeline time window subsequent to the first interval of the pipeline time window, that a second portion of sensor data received during the second interval of the pipeline time window failed to arrive within a particular time constraint was received too late to be processed by the first model within the second interval of the pipeline time window;
- adjusting the process schedule by assigning a second model to process the second portion of sensor data within a next interval immediately subsequent to the second interval of the pipeline time window, the second model selected from the plurality of models according to an ability of the second model to process the second portion of sensor data within a reduced processing time compared to a processing time of the first model;
- executing, according to the ordering of the process schedule, the first model on the first portion of data and the second model on the second portion of data;
- and
- executing, using a result of executing the first model on the first portion of data and a second result of executing the second model on the second portion of data, a control operation of the autonomous vehicle.
5 more elements
Dependencies are inferred from the claim text.