# US 11,054,807 B2 · Systems and methods for hybrid automata mining from input-output traces of cyber-physical systems > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,054,807 B2 - Document ID: US11054807B2 - Status: Granted - Kind: B2 - Application number: 16/413,018 - Filed: 2019-05-15 - Published: 2019-11-21 - Granted: 2021-07-06 - Earliest claimed: 2018-05-15 - Assignees: Arizona Board of Regents on behalf of Arizona State University - Applicants: Sandeep K. S. Gupta; Ayan Banerjee; Imane Lamrani - Inventors: Sandeep K. S. Gupta; Ayan Banerjee; Imane Lamrani - Web page: https://patentgrep.com/patent/US11054807B2 ## CPC - G05B 19/4155: characterised by program execution, i.e. part program or machine function execution, e.g. selection of a program - G06F 7/552: Powers or roots {, e.g. Pythagorean sums} - G06F 17/12: Simultaneous equations {, e.g. systems of linear equations} - G06N 5/04: Inference or reasoning models - G05B 2219/35261: Use of mathematical expression, functional equation - G05B 2219/37496: Root mean square - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Systems and methods for mining hybrid automata from input-output traces of cyber-physical systems are disclosed herein. ## Claims ### Claim 1 A system for inferring and fine tuning control parameters of a cyber-physical system, comprising: a physical system including an actuator and one or more sensors that produces an input signal and an output signal, a relationship between the input signal and the output signal being representative of physical dynamics of the physical system; and a controller that generates a hybrid automaton based on continuous variables measured from the one or more sensors of the physical system and computes a next controller output for the actuator of the physical system based on the hybrid automaton, wherein to generate the hybrid automaton, the controller accesses as inputs the continuous variables including time series input and output traces of the physical system, segments the time series input and output traces into a plurality of segments according to a sudden change in a slope of the continuous variables, infers a controller strategy for each segment of the plurality of segments such that the controller clusters each segment into one of a plurality of equivalence classes based on their respective controller strategies, each equivalence class corresponding to a controller mode of a plurality of controller modes, derives one or more polynomial flow equations representative of physical dynamics of the physical system for each mode, and derives one or more guard conditions representative of a boundary that causes a controller mode change for each mode. ### Claim 2 (depends on 1) The system of claim 1, wherein the hybrid automaton defines an output of the controller and includes the plurality of control modes, the one or more polynomial flow equations, and the one or more guard conditions the cyber-physical system. ### Claim 3 (depends on 2) The system of claim 2, wherein the controller strategy includes a reset condition and one or more jump conditions. ### Claim 4 (depends on 1) The system of claim 1, wherein the controller is adapted to: compare a set of collected controller input-output traces associated with the physical system with a set of inferred controller input-output traces to validate safety and optimal performance of the physical system and the hybrid automaton, wherein the set of inferred controller input-output traces are generated by the hybrid automaton. ### Claim 5 (depends on 4) The system of claim 4, wherein the root mean square error is taken between the set of collected controller input-output traces and a set of inferred controller input-output traces, wherein an amount of input-output traces taken as input by the system within a predetermined period of time is iteratively increased until the root mean square error is close to zero. ### Claim 6 (depends on 1) The system of claim 1, wherein each of a set of timestamps associated with the plurality of segments is representative of a potential controller mode change, wherein each one of the set of timestamps corresponds with a peak in the rate of change of observed controller inputs or observed controller outputs defined by the continuous variables. ### Claim 7 (depends on 6) The system of claim 6, wherein the controller is further adapted to: associate a linear equation with each one of the plurality of segments, wherein the linear equation maps the set of observed controller outputs to the set of observed controller inputs. ### Claim 8 (depends on 1) The system of claim 1, wherein the physical system is an artificial pancreas such that the actuator is an infusion pump and the continuous variables include one or more glucose-meter values, the hybrid automaton generated by the controller being implemented by the controller to access the one or more glucose-meter values and to output by the controller an amount of insulin infusion rate for the infusion pump. ### Claim 9 (depends on 8) The system of claim 8, wherein hybrid automaton implemented by the controller linearizes a plurality of non-linear differential equations associated with blood glucose levels and insulin levels of a specific patient such that the amount of insulin infusion rate for the infusion pump is computed for the specific patient. ### Claim 10 A system for optimizing control parameters of a cyber-physical system, comprising: a physical system including an actuator and one or more sensors that produces one or more input signals and one or more output signals, a relationship between the one or more input signals and the one or more output signals being representative of physical dynamics of the physical system; and a controller that generates a hybrid automaton based on continuous variables measured from the one or more sensors of the physical system and computes a next controller output for the actuator of the physical system based on the hybrid automaton, wherein to generate the hybrid automaton, the controller: identifies a mode transition of the physical system by identifying a sudden change in a derivative of the one or more output signals, wherein a time interval between a mode transition is a segment of a plurality of segments, identifies jump conditions and reset conditions relating the one or more output signals to the one or more input signals for each segment of the plurality of segments, clusters the plurality of segments into one or more discrete modes according to their respective jump conditions and reset conditions, determines one or more polynomial flow equations for each discrete mode, each polynomial flow equation relating the one or more input signals and the one or more output signals and being indicative of dynamics of the physical system, and derives one or more guard conditions representative of a boundary that causes a controller mode change for each discrete mode based on the one or more input signals and the one or more output signals, wherein the hybrid automaton includes the one or more discrete modes, the one or more polynomial flow equations and the one or more guard conditions. ### Claim 11 (depends on 10) The system of claim 10, wherein reset conditions are representative of an initialization of each new segment and wherein reset conditions include a linear relationship between the input signal and the output signal for each segment. ### Claim 12 (depends on 10) The system of claim 10, wherein jump conditions include values for one or more input signals and the one or more output signals associated with two neighboring segments, wherein jump conditions compare a mode transition between the two neighboring segments. ### Claim 13 (depends on 10) The system of claim 10, wherein polynomial flow equations are determined for each mode by determining relationships between the one or more input signals and the one or more output signals associated with each mode based on an unbiased estimator. ### Claim 14 (depends on 10) The system of claim 10, wherein guard expressions are determined for each mode transition by determining relationships between controller output values at each mode transition. ### Claim 15 (depends on 14) The system of claim 14, wherein to determine the guard expressions for a mode transition, the controller: expresses each of a plurality of continuous variables associated with the one or more input signals or the one or more output signals as a linear combination of each other continuous variable of a plurality of continuous variables associated with the one or more input signals or the one or more output signals; and determines a coefficient matrix for the linear combination using Fisher Information, wherein the linear combination expression is expressed as a conditional inequality. ### Claim 16 A method for inferring and fine tuning control parameters of a cyber-physical system, comprising: accessing, by a controller, continuous variables defining input and output traces from a cyber-physical control system, the cyber-physical system including a physical system and a control system for controlling the physical system, the physical system including an actuator and one or more sensors; and learning, by the controller, a hybrid automaton to compute a set of parameters for enhancing control of the physical system, by: identifying a set of control modes of the hybrid automaton, by: segmenting the input and output traces according to observed sudden changes in differential of controller output, and classifying the set of control modes by determining a total number of the set of control modes and clustering the input and output traces as segmented into equivalence classes corresponding to each of the set of control modes, deriving, for each of the set of control modes, a flow function that assigns a set of differential equations that relates the continuous variables to its derivatives and the controller outputs, and computing guard conditions defining transitions between the set of control modes. ### Claim 17 (depends on 16) The method of claim 16, wherein the observed sudden changes in controller output include (a) a step output where after a transition in controller mode change the controller output stays level unless another transition occurs, or (b) an output defining a linear function of the continuous variables of the physical system. ### Claim 18 (depends on 16) The method of claim 16, further comprising: transmitting to the actuator, by the controller, a decision to perform a change in mode; and effectuating the change in mode by the actuator of the physical system. ### Claim 19 (depends on 16) The method of claim 16, further comprising: verifying accuracy of the hybrid automaton, by: comparing a portion of the input and output traces from the cyber-physical system to inferred input output traces as inferred from the hybrid automaton; and calculating, by the controller, a root mean square error between the input and output traces and the inferred input and output traces to output a matching rate, the matching rate evaluated in view of a predefined rank value to access the accuracy of the hybrid automaton.