# US 12,120,838 B2 · Semantic labeling analysis > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,120,838 B2 - Document ID: US12120838B2 - Status: Granted - Kind: B2 - Application number: 17/409,636 - Filed: 2021-08-23 - Published: 2022-03-03 - Granted: 2024-10-15 - Earliest claimed: 2020-08-26 - Assignees: PassiveLogic, Inc. - Applicants: PassiveLogic, Inc. - Inventors: Troy Aaron Harvey; Jeremy David Fillingim - Web page: https://patentgrep.com/patent/US12120838B2 ## CPC - H05K 7/1465: {Modular PLC assemblies with separable functional units} - F24F 11/32: Responding to malfunctions or emergencies - F24F 11/49: ensuring correct operation, e.g. by trial operation or configuration checks - F24F 11/63: Electronic processing - F24F 11/88: Electrical aspects, e.g. circuits - G01R 31/55: Testing for incorrect line connections - G05B 13/0265: {the criterion being a learning criterion} - G05B 15/02: electric - G05B 19/048: Monitoring; Safety - G05B 23/0216: {Human interface functionality, e.g. monitoring system providing help to the user in the selection of tests or in its configuration} - G05B 23/0264: {Control of logging system, e.g. decision on which data to store; time-stamping measurements} - G05B 23/0272: {Presentation of monitored results, e.g. selection of status reports to be displayed; Filtering information to the user} - G06F 1/3209: Monitoring remote activity, e.g. over telephone lines or network connections - G06F 1/3246: by software initiated power-off - G06F 3/04186: {Touch location disambiguation} - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/147: using display panels - G06F 8/436: {Semantic checking} - G06F 8/51: Source to source - G06F 8/53: Decompilation; Disassembly - G06F 8/74: Reverse engineering; Extracting design information from source code - G06F 9/4418: {Suspend and resume; Hibernate and awake} - G06F 30/12: characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD - G06F 30/13: Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads - G06F 30/18: Network design, e.g. design based on topological or interconnect aspects of utility systems, piping, heating ventilation air conditioning [HVAC] or cabling (circuit design at the physical level G06F30/39; network planning tools for wireless communication networks H04W16/18) - G06Q 30/0283: Price estimation or determination - H02J 3/00: Circuit arrangements for AC mains or AC distribution networks - H02J 13/182: the equipment comprising loads connected to the power network - H04B 3/46: Monitoring; Testing - H04L 43/50: Testing arrangements - H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks - H04L 67/125: involving control of end-device applications over a network - H04L 67/75: Indicating network or usage conditions on the user display - H04M 3/305: {testing of physical copper line parameters, e.g. capacitance or resistance (locating faults in cables G01R31/08)} - H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication - H04W 84/00: Network topologies - H05K 7/1468: {Mechanical features of input/output (I/O) modules} - H05K 7/1477: {including backplanes} - H05K 7/1481: {User interface, e.g. status displays; Programming interface, e.g. connector for computer programming; Monitoring} - G06F 30/392: Floor-planning or layout, e.g. partitioning or placement - G06F 2111/04: Constraint-based CAD - G06F 2111/16: Customisation or personalisation - G06F 2113/04: Power grid distribution networks - G06F 2113/16: Cables, cable trees or wire harnesses - G06F 2115/12: Printed circuit boards [PCB] or multi-chip modules [MCM] - H02J 2105/12: supplying households or buildings - H05K: PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS - F24F: AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING (removing dirt or fumes from areas where they are produced B08B15/00; vertical ducts for carrying away waste gases from buildings E04F17/02; tops for chimneys or ventilating shafts, terminals for flues F23L17/02) - G01R: MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES (indicating correct tuning of resonant circuits H03J3/12) - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - H02J: ELECTRIC POWER NETWORKS; CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY - H04B: TRANSMISSION - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract Tools and techniques are described to create an interface that can translate a device language into an internal language, and describe the device to the controller in terms of actors and quanta such that when a device is attached to a controller, the controller can understand what the device does and why it does it. This internal language can then be translated back to a natural language, such as English. This allows the controller to track errors, determine what upstream or downstream device and action of the device caused the error, and to track many different facts of the system that allow for detailed reports. ## Claims ### Claim 1 A system comprising: a controller, display screen, and devices, the controller comprising computer hardware and memory, the controller operationally able to control the devices, the controller operationally able to track the devices; a computer program in the memory configured to display, on the display screen, at least one of: state of the devices over a given time, an event associated with at least one of the devices, length of time of the event, an action associated with the event, or detail associated with the event; a digital twin comprising a neural network with nodes modeling devices in a physical space, the nodes arranged with reference to connections between the devices, at least one of the nodes comprising at least one property and at least two computed properties; wherein the controller operationally able to track the devices comprises tracking device errors; wherein at least one of the device errors is tracked through more than one device using the digital twin; and wherein at least one node within the digital twin has an actor type and is acted on by a quanta type to model behavior of an associated device. ### Claim 2 (depends on 1) The system of claim 1, wherein the digital twin is opcrationally able to simulate the devices from a first time to a second time, and wherein the display screen is operationally able to display simulated physical space behavior from the first time to the second time. ### Claim 3 (depends on 2) The system of claim 2, wherein the event associated with at least one of the devices comprises: a state change associated with at least one of the devices and a state change action that is a reason for the state change. ### Claim 4 (depends on 1) The system of claim 1, wherein the at least one node uses the at least one property and the at least two computed properties to model behavior of the associated device. ### Claim 5 (depends on 1) The system of claim 1, wherein the digital twin uses machine learning methods utilizing utilizes historical data of the devices to simulate the devices from a current time to a future time. ### Claim 6 (depends on 1) The system of claim 1, wherein the actor comprises a producer, a consumer, a transformer, a transporter, a store, a router, a mixer, a path, or a branch. ### Claim 7 (depends on 1) The system of claim 1, wherein the actor interacts with a quanta. ### Claim 8 (depends on 1) The system of claim 1, further comprising the devices comprising a first device connected to a second device connected to a third device; the nodes comprising a first node representing the first device connected to a second node representing the second device, the second node connected to a third node representing the third device; and wherein the connection between the first device and the third device is determined through the connection between the first node and the second node. ### Claim 9 (depends on 8) The system of claim 8, wherein the connection between the first device and the third device can be determined through the connection between the first node and the second node and the connection between the second node and the third node. ### Claim 10 (depends on 9) The system of claim 9, wherein the connection between the first node and the second node is represented by a quanta. ### Claim 11 (depends on 9) The system of claim 9, further comprising a second property of the first node and wherein the property of the first node is used to calculate a first computed property of the first node, and the second property of the first node is used to calculate a second computed property of the first node. ### Claim 12 (depends on 9) The system of claim 9, wherein the first device is a boiler and wherein the first node has an efficiency coefficient property. ### Claim 13 (depends on 9) The system of claim 9, wherein the property and at least one of the computed properties of the second node is interrogated to determine a fault in the first device. ### Claim 14 (depends on 9) The system of claim 9, wherein the property and at least one of the computed properties of the third node is interrogated to determine a fault in the first device. ### Claim 15 (depends on 1) The system of claim 1, wherein the actor comprises a producer, a consumer, a transformer, a transporter, a store, a router, a mixer, a path, or a branch. ### Claim 16 A non-transitory computer readable storage medium configured with data and instructions that upon execution by at least one processor with programmable memory in a controller computing system having a devices attached thereto, the programmable memory storing instructions for using a digital twin of the devices, when the instructions, when executed by a processor, cause the processor to perform steps including: instructions for accessing the digital twin, the digital twin comprising a neural network with nodes modeling devices in a physical space, the nodes arranged with reference to connections between the devices, at least one of the nodes comprising at least one property and at least two computed propertics; instructions for running a computer program stored in a memory, the computer program displaying on a display screen, at least one of: state of the devices over a given time, an event associated with at least one of the devices, length of time of the event, an action associated with the event, or detail associated with the event; instructions for running tracking errors of the devices; wherein at least one of the device errors is tracked through more than one of the devices using the digital twin; and wherein at least one node within the digital twin has an actor type and is acted on by a quanta type to model behavior of an associated device. ### Claim 17 A method comprising: accessing a digital twin, the digital twin comprising a neural network with nodes modeling devices in a physical space, the nodes arranged with reference to connections between the devices, at least one of the nodes comprising at least one property and at least two computed properties; running, using a processor, a computer program stored in a memory, the computer program displaying on a display screen, at least one of: state of the devices over a given time, an event associated with at least one of the devices, length of time of the event, an action associated with the event, or detail associated with the event; tracking errors of the devices; wherein at least one of the device errors is tracked through more than one of the devices using the digital twin; and wherein at least one node within the digital twin has an actor type and is acted on by a quanta type to model behavior of an associated device. ### Claim 18 (depends on 17) The method of claim 17, wherein the digital twin utilizes historical data of the device to simulate the device from a current time to a future time. ### Claim 19 (depends on 17) The method of claim 17, further comprising: the devices comprising a first device connected to a second device connected to a third device; the nodes comprising a first node representing the first device connected to a second node representing the second device, the second node connected to a third node representing the third device; and wherein the connection between the first device and the third device is determined through the connection between the first node and the second node. ### Claim 20 (depends on 19) The method of claim 19, further comprising a second property of the first node and wherein the property of the first node is used to calculate a first computed property of the first node, and the second property is used to calculate a second computed property of the first node.