# US 2019/0356539 A1 · Fine grained network management to edge device features > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0356539 A1 - Document ID: US20190356539A1 - Status: Published application - Kind: A1 - Application number: 16/411,441 - Filed: 2019-05-14 - Published: 2019-11-21 - Earliest claimed: 2018-05-18 - Assignees: Nant Holdings IP, LLC - Applicants: Nant Holdings IP, LLC - Inventors: Patrick Soon-Shiong; John Wiacek - Web page: https://patentgrep.com/patent/US20190356539A1 ## CPC - H04L 41/0803: Configuration setting - H04Q 9/00: Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom - G06N 5/022: Knowledge engineering; Knowledge acquisition - G06N 20/00: Machine learning - H04L 41/069: using logs of notifications; Post-processing of notifications - H04L 41/082: the condition being updates or upgrades of network functionality - H04L 41/22: comprising specially adapted graphical user interfaces [GUI] - H04L 43/16: Threshold monitoring - H04Q 9/02: Automatically-operated arrangements - G06N 3/08: Learning methods - G06N 20/10: using kernel methods, e.g. support vector machines [SVM] - H04L 41/0213: Standardised network management protocols, e.g. simple network management protocol [SNMP] - H04Q 2209/40: using a wireless architecture - H04Q 2209/70: Arrangements in the main station, i.e. central controller - H04Q 2209/80: Arrangements in the sub-station, i.e. sensing device - H04Q 2209/823: where the data is sent when the measured values exceed a threshold, e.g. sending an alarm - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04Q: SELECTING (switches, relays, selectors H01H; wireless communication networks H04W) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Network management systems and methods are provided. A system is provided that includes an event database that provides a mapping of multimodal sensor data to events of devices coupled to a network, such as operational or behavioral events. A network management engine obtains a set of multimodal sensor data relating to a device, which may include sensor measurement or output data relating to each of multiple device operation or behavior parameters. The engine determines, utilizing the mapping, a match of the set of multimodal sensor data to a specific event associated with the device. Based at least in part on the determined match, the engine causes generation or updating of event data associated with the specific event, the data being accessible by network management software of the network management system. ## Claims ### Claim 1 A network management system, comprising: an event database providing a mapping of multimodal sensor data to events of one or more devices coupled to a network; and a network management engine, coupled to the event database, configured to: obtain a set of multimodal sensor data relating to a device of the one or more devices; determine, utilizing the mapping, a match of the set of multimodal sensor data to a first event associated with the device; and based at least in part on the determined match, cause generation or updating of first event data associated with the first event, the first event data being accessible by network management software of the network management system. ### Claim 2 (depends on 1) The system of claim 1, wherein the events of the one or more devices comprise operational events and the first event is related to at least one of chemical, mechanical and electrical operation of the device. ### Claim 3 (depends on 1) The system of claim 1, wherein an event is associated with a biological, physiological, electrical, magnetic, electromagnetic, environmental, structural, or weather-related occurrence, condition or phenomenon. ### Claim 4 (depends on 1) The system of claim 1, the events of the one or more devices comprise behavioral events and the first event is related to behavior of an entity interacting with the device. ### Claim 5 (depends on 1) The system of claim 1, wherein the first event data reflects occurrence, continued occurrence or repeated occurrence of the first event. ### Claim 6 (depends on 1) The system of claim 1, wherein multimodal sensor data comprises multiple outputs or measurements, each relating to a different sensed parameter. ### Claim 7 (depends on 1) The system of claim 1, wherein the multimodal sensor data is stored in the event database. ### Claim 8 (depends on 1) The system of claim 1, wherein multimodal sensor data is collected, and computationally modified, or filtered, at the device. ### Claim 9 (depends on 1) The system of claim 1, wherein multimodal sensor data is collected, and computationally processed or filtered, at the device prior to wireless transmission over the Internet and prior to storage in the event database. ### Claim 10 (depends on 1) The system of claim 1, wherein the match is determined based on the multimodal sensor data falling within a range or being above a threshold. ### Claim 11 (depends on 1) The system of claim 1, wherein: the match is determined based on the multimodal sensor data falling within a range or being above a threshold; and the range or the threshold requires that, for each of multiple single outputs or single measurements of the multimodal sensor data, the single output or the single measurement falls within a specified range or is above a specified threshold, the specified range or the specified threshold relating to the single output or the single measurement. ### Claim 12 (depends on 1) The system of claim 1, wherein: multimodal sensor data comprises multiple sensor outputs, each relating to a different sensed parameter; and only a combination of all of the multiple sensor outputs, and not any single one of the multiple sensor outputs or any subset of the multiple sensor outputs, matches to the first event. ### Claim 13 (depends on 1) The system of claim 1, wherein the network management engine is further configured to: cause monitoring for, and detection of, the first event data utilizing the network management software. ### Claim 14 (depends on 1) The system of claim 1, wherein the network management engine is further configured to: upon detection of the first event data by the network management software, cause generation of an alert. ### Claim 15 (depends on 1) The system of claim 1, wherein the network management engine is further configured to: upon detection of the first event data by the network management software, based at least in part on the on the first event, cause modification of function of the device to better optimize function of the device. ### Claim 16 (depends on 1) The system of claim 1, wherein the event database specifies, in terms of multimodal sensor data, definitions or thresholds relating to events. ### Claim 17 (depends on 1) The system of claim 1, wherein an event relates to operation or behavior of a device or of a person. ### Claim 18 (depends on 1) The system of claim 1, wherein an event is associated with a person, animal, plant, or organ. ### Claim 19 (depends on 1) The system of claim 1, wherein an event is associated with a feature, aspect, element, portion, or condition of a living entity. ### Claim 20 (depends on 1) The system of claim 1, wherein the network management engine is further configured to: utilize one or more machine learning techniques in determining the mapping. ### Claim 21 (depends on 1) The system of claim 1, wherein the network management engine is further configured to: utilizing event data, determine and store data regarding sensed operation or behavior; track and store data regarding outcomes resulting from sensed operation or behavior; and utilize one or more machine learning techniques, determine patterns associating sensed operation or behavior with outcomes. ### Claim 22 (depends on 1) The system of claim 1, wherein the network management engine is further configured to: utilize one or more machine learning techniques in: determining or updating the mapping, comprising utilizing multimodal sensor data associated with devices as machine learning training data; and updating the event database based on the determined or updated mapping. ### Claim 23 (depends on 1) The system of claim 1, wherein the network management engine is further configured to: store a log over time of varying multimodal sensor data associated with the device. ### Claim 24 (depends on 1) The system of claim 1, wherein the network management engine is further configured to: store a log over time of varying multimodal sensor data associated with the device using one or more blockchains. ### Claim 25 (depends on 1) The system of claim 1, wherein the device comprises a battery or power cell and wherein the multimodal sensor data comprises data relating to each of multiple parameters of the battery or power cell. ### Claim 26 (depends on 1) The system of claim 1, wherein the device comprises a component of a battery or power cell and wherein the multimodal sensor data comprises data relating to the component. ### Claim 27 (depends on 1) The system of claim 1, wherein the device comprises a component of a vehicle. ### Claim 28 (depends on 1) The system of claim 1, wherein the device comprises a medical device. ### Claim 29 (depends on 1) The system of claim 1, wherein the event is associated with a patient or a consumer. ### Claim 30 (depends on 1) The system of claim 1, wherein the network management engine is further configured to: generate a user interface dashboard displaying an indication or alert of the first event; and allowing a user, through the dashboard, to take action based on the first event. ### Claim 31 (depends on 1) The system of claim 1, wherein the event database comprises a Management Information Base (MIB). ### Claim 32 (depends on 1) The system of claim 1 wherein the event database comprises a Management Information Base (MIB), and wherein the MIB is ontologically organized relative to operational or behavioral events and utilizes a defined hierarchical vocabulary relating to the organization structure of the MIB. ### Claim 33 (depends on 1) The system of claim 1, wherein the network management software utilizes Open Database Connectivity (ODBC) standards. ### Claim 34 (depends on 1) The system of claim 1, wherein the network management software utilizes simple network management protocol (SNMP). ### Claim 35 (depends on 1) The system of claim 1, wherein the network management software utilizes OpenNMS. ### Claim 36 A network management method, comprising: maintaining an event database providing a mapping of multimodal sensor data to events of one or more devices coupled to a network; obtaining a set of multimodal sensor data relating to a device of the one or more devices; determining, utilizing the mapping, a match of the set of multimodal sensor data to a first event associated with the device; and based at least in part on the determined match, causing generation or updating of first event data associated with the first event, the first event data being accessible by network management software of the network management system; detecting the first event data; and based at least in part on the detection the first event data, causing a modification of operation of the device. ### Claim 37 (depends on 36) The method of claim 36, wherein causing the modification of the operation of the device is to better optimize operation of the device based at least in part on the first event data. ### Claim 38 (depends on 36) The method of claim 36, wherein the first event is related to at least one of chemical, mechanical or electrical operation of the device. ### Claim 39 A computer readable medium or media containing instructions for executing a method comprising: maintaining an event database providing a mapping of multimodal sensor data to events of one or more devices coupled to a network; obtaining a set of multimodal sensor data relating to a device of the one or more devices; determining, utilizing the mapping, a match of the set of multimodal sensor data to a first event associated with the device; based at least in part on the determined match, causing generation or updating of first event data associated with the first event, the first event data being accessible by network management software of the network management system; detecting the first event data; and based at least in part on the detection the first event data, causing a modification of operation of the device. ### Claim 40 (depends on 39) The computer readable medium or media of claim 39, wherein the first event is related to at least one of chemical, mechanical or electrical operation of the device.