Back to results
US 12,443,863 B1Granted
Computer-based reasoning system for operational situation control of controllable systems
AssigneeHowso Incorporated
InventorsChristopher James Hazard, Michael Vincent Capps
Life of this patent
Estimating the term…
Abstract
Techniques are provided for operational situation vehicle control, and include determining action and context data for one or more vehicle operations in one or more operational situations, training vehicle control rules for those operational situations, and using those vehicle control rules to control vehicles in compatible operational situations.
Claims20
A method, comprising:
- during operation of a first controllable system, repeatedly:
- determining, via an operational analysis system executing on one or more computing devices, first context-action pairs, where each of the first context-action pairs comprise one or more first actions taken related to operation of the first controllable system, each first action being represented as numbers, variables, functions, or a combination of two or more of the foregoing, and a first context in which the one or more first actions were taken, the first context including one or more data elements each representing information related to the first controllable system represented as numbers, variables, functions, or a combination of two or more of the foregoing, wherein each first action is related to operation of the first controllable system in the first context, wherein the first context relates, at least in part, to the operation of the first controllable system during a period of time;
- and
- storing, via the operational analysis system executing on the one or more computing devices, a first set of context-action pairs for each first action taken and the first context in which it is taken;
- during operation of a second controllable system after operation of the first controllable system:
- determining, via the operational analysis system executing on the one or more computing devices, a second context for the second controllable system, wherein the second context is different from the first context, wherein the second context comprises one or more data elements each representing information related to the second controllable system represented as numbers, variables, functions, or a combination of two or more of the foregoing;
- determining, via the operational analysis system executing on the one or more computing devices, a second action to take based at least in part on the second context of the second controllable system and the first set of context-action pairs, wherein determining the second action to take based at least in part on the second context of the second controllable system and the first set of context-action pairs comprises:
- determining distance values of the second context to context-action pairs in the first set of context-action pairs, wherein the distance values are determined using a distance metric;
- determining N closest context-action pairs based on the distance values of the second context to the context-action pairs in the first set of context-action pairs, wherein N is two or greater;
- determining the second action to take based at least in part on the determined N closest context-action pairs;
- and
- controlling, via a control system executing on the one or more computing devices, characteristics of execution of the second controllable system based on the second action determined based on the second context.
9 more elements
A system for executing instructions, wherein said instructions are instructions which, when executed by one or more computing devices, cause performance of a process including:
- during a first operation of a first controllable system in a first operational situation, repeatedly:
- training a first machine intelligence system based on first actions taken and a first context in which those first actions were taken, wherein each first action is related to the first operation of the first controllable system in the first context and first operational situation, wherein each first action is represented as numbers, variables, functions, or a combination of two or more of the foregoing, the first context includes one or more data elements each representing information related to the first controllable system represented as numbers, variables, functions, or a combination of two or more of the foregoing, and the first operational situation relates to the operation of the first controllable system over a period of time;
- during a second operation of a second controllable system in a second operational situation, repeatedly:
- training a second machine intelligence system based on second actions taken and a second context in which those second actions were taken, wherein each second action is related to the second operation of the second controllable system in the second context and second operational situation, wherein each second action is represented as numbers, variables, functions, or a combination of two or more of the foregoing, the second context includes one or more data elements each representing information related to the second controllable system represented as numbers, variables, functions, or a combination of two or more of the foregoing, and the second operational situation relates to the operation of the second controllable system over a period of time;
- and
- determining whether to perform a third operation of a third controllable system in a third operational situation the first machine intelligence system or the second machine intelligence system based at least in part on a comparison of the third operational situation and the first operational situation and the second operational situation;
- based on the determining to perform the third operation of the third controllable system in the third operational situation using the first machine intelligence system:
- determining a third context for the third controllable system;
- determining a third action to take based at least in part on the third context of the third controllable system and the first machine intelligence system, wherein determining the third action to take based at least in part on the third context of the third controllable system and the first machine intelligence system comprises:
- determining distance values of the third context to context-action pairs in the first machine intelligence system, wherein the distance values are determined using a distance metric;
- determining N closest context-action pairs based on the distance values of the third context to the context-action pairs in the first machine intelligence system, wherein N is two or greater;
- determining the second action to take based at least in part on the determined N closest context-action pairs and
- controlling characteristics of execution based on the third action determined based on the third context and the first machine intelligence system;
- and
- based on the determining based on the determining to perform the third operation of the third controllable system in the third operational situation using the second machine learning system:
- determining a fourth context for the third controllable system;
- determining a fourth action to take based at least in part on the fourth context of the third controllable system and the second machine intelligence system;
- and
- controlling characteristics of execution of the third controllable system based on the fourth action determined based on the fourth context and the second machine intelligence system.
16 more elements
A non-transitory computer readable storage medium storing instructions which, when executed by one or more computing devices, cause the one or more computing devices to perform a process of:
- during a first operation of a first controllable system in a particular operational situation, repeatedly:
- determining first actions taken related to the first operation of the first controllable system in the particular operational situation, and a first context in which the first actions were taken, wherein each first action is related to the first operation of the first controllable system in the first context and particular operational situation, and wherein each first action is represented as numbers, variables, functions, or a combination of two or more of the foregoing, the first context includes one or more data elements each representing information related to the first controllable system represented as numbers, variables, functions, or a combination of two or more of the foregoing, and the particular operational situation relates to the operation of the first controllable system over a period of time;
- and
- storing a first set of context-action pairs for the particular operational situation related to each first action taken and the first context in which it is taken;
- during operation of a second controllable system in a second operational situation:
- determining a second context for the second controllable system;
- determining a second action to take based at least in part on the second context of the second controllable system and the first set of context-action pairs for the particular operational situation, wherein determining the second action to take based at least in part on the second context of the second controllable system and the first set of context-action pairs comprises:
- determining distance values of the second context to context-action pairs in the first set of context-action pairs, wherein the distance values are determined using a distance metric;
- determining N closest context-action pairs based on the distance values of the second context to the context-action pairs in the first set of context-action pairs, wherein N is two or greater;
- determining the second action to take based at least in part on the determined N closest context-action pairs;
- and
- controlling characteristics of execution of the second controllable system based on the second action determined based on the second context, wherein each second action is represented as numbers, variables, functions, or a combination of two or more of the foregoing, the second context includes one or more data elements each representing information related to the second controllable system represented as numbers, variables, functions, or a combination of two or more of the foregoing, and the second operational situation relates to the operation of the second controllable system over a period of time.
9 more elements
Dependencies are inferred from the claim text.