# US 10,320,635 B2 · Methods and apparatus for providing adaptive private network centralized management system timestamp correlation processes > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,320,635 B2 - Document ID: US10320635B2 - Status: Granted - Kind: B2 - Application number: 14/972,353 - Filed: 2015-12-17 - Published: 2016-06-23 - Granted: 2019-06-11 - Earliest claimed: 2014-12-23 - Assignees: Talari Networks Incorported - Applicants: Talari Networks Incorporated - Inventors: Todd Martin; Adam Phillip Schultz - Web page: https://patentgrep.com/patent/US10320635B2 ## CPC - H04L 41/122: of virtualised topologies, e.g. software-defined networks [SDN] or network function virtualisation [NFV] - G06F 21/33: using certificates - H04L 43/04: Processing captured monitoring data, e.g. for logfile generation - H04L 43/065: related to network devices - H04L 43/067: using time frame reporting - H04L 43/0829: Packet loss - H04L 43/0894: Packet rate - H04L 43/103: with adaptive polling, i.e. dynamically adapting the polling rate - H04L 45/76: Routing in software-defined topologies, e.g. routing between virtual machines - H04L 63/04: {for providing a confidential data exchange among entities communicating through data packet networks} - H04L 63/0823: {using certificates (cryptographic mechanisms or cryptographic arrangements for entity authentication involving certificates H04L9/3263)} - H04L 43/0817: by checking functioning - H04L 43/10: Active monitoring, e.g. heartbeat, ping or trace-route - H04W 84/12: WLAN [Wireless Local Area Networks] - H04W 88/12: Access point controller devices - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract System and techniques are described which provide a method for time correlated monitoring of nodes in a network. A statistics request message is sent from a centralized control point to a node in a network having a plurality of nodes, wherein the statistics request message contains a centralized control point time stamp tn of when the message was sent. The statistics request message is received at the node which records a node timestamp ta when the message was received in the node. Node statistics are converted to system time at the centralized control point according to a first delta between tn and ta to generate adjusted node statistics. A second delta is determined at the centralized control point which is applied to the adjusted node statistics to provide consistent system time information for feedback or presentation through a network attached user interface. ## Claims ### Claim 1 A method to provide a consistent system timeline of node communications in an adaptive private network (APN) having a plurality of nodes, the method comprising: providing a first APN virtual machine that maintains an APN time used for forwarding packets through conduits in the APN; providing an APN appliance that forwards packets through the conduits in the APN and that maintains time local to the APN appliance; repeatedly sending statistics request messages from the first APN virtual machine to the APN appliance, wherein the first APN virtual machine comprises monitor, manager, and network statistics processing functions which are configured to provide the consistent system timeline and each of the statistics request messages contains a timestamp tn of when the statistics request message was sent in the APN time maintained by the first APN virtual machine; receiving each of the statistics request messages at the APN appliance and recording a timestamp ta in the local time of the APN appliance when each of the statistics request messages was received at the APN appliance; in response to each received statistics request message, returning requested node statistics from the APN appliance to the first APN virtual machine, wherein the requested node statistics each include a timestamp recorded in the local time of the APN appliance and state information regarding the APN appliance; determining, by the first APN virtual machine and using the timestamps associated with successive statistics received from the APN appliance, a time jump in the local time of the APN appliance that does not correspond to a timestamping interval between the successive statistics; and adjusting, by the first APN virtual machine and using the time jump, the timestamps of the statistics received from the APN appliance to form adjusted node statistics which are included in the consistent system timeline of node communications in the APN at the first APN virtual machine, wherein the consistent system timeline is provided for feedback through a network attached user interface. ### Claim 2 (depends on 1) The method of claim 1, wherein time-stamped counter values are received from nodes in the APN and converted to the APN time maintained by the first APN virtual machine without requiring time synchronization between any nodes in the APN. ### Claim 3 (depends on 1) The method of claim 1 wherein determining the time jump includes subtracting a timestamp value from a first statistic from a timestamp value associated with a second statistic recorded after the first statistic. ### Claim 4 (depends on 1) The method of claim 1 wherein adjusting the timestamps includes adjusting the timestamps to correspond to the APN time maintained by the first APN virtual machine. ### Claim 5 (depends on 1) The method of claim 1, wherein the timestamping interval is guaranteed at each node in the APN to be of a fixed time period and each requested set of statistics data is time-stamped in consecutive time periods. ### Claim 6 (depends on 1) The method of claim 1, wherein the timestamping interval is guaranteed to be of a fixed time period allowing the received node statistics to be adjusted using the time jump and the timestamping interval. ### Claim 7 (depends on 1) The method of claim 1, wherein a local clock in each node in the APN is synchronized with a network time in a second APN virtual machine separate from the first APN virtual machine based on an evaluation of a function of a ratio of an average send time from the second APN virtual machine versus average arrival time for a plurality of timing messages received at each node, current time in each node, and a round trip time between the second APN virtual machine and each node in the APN, wherein timestamps of data gathered from the second APN virtual machine and each node in the APN are correlated to a master time specified by the second APN virtual machine and the synchronized clocks in each node in the APN are calculated separately from providing the consistent system timeline. ### Claim 8 (depends on 1) The method of claim 1, wherein communication objects are counted by counters and sampled for inclusion in the node statistics in responding to the statistics request message. ### Claim 9 (depends on 1) The method of claim 1, wherein the consistent system timeline accounts for different gaps in time that occur in different nodes in the APN. ### Claim 10 A method for adapting a system timeline at an adaptive private network (APN) virtual machine based on correlated monitoring of appliances in an APN having time jumps that occur at the appliances, the method comprising: providing an APN virtual machine that maintains an APN time used for forwarding packets through conduits in the APN; providing an APN appliance that forwards packets through the conduits in the APN and that maintains time local to the APN; receiving, at the first APN virtual machine, statistics from the APN appliance, each of the statistics including a timestamp recorded in the local time of the APN and state information regarding the APN appliance, wherein the first APN virtual machine comprises monitor, manager, and network statistics processing functions which are configured to provide a consistent system timeline; determining, by the first APN virtual machine and using the timestamps associated with successive statistics received from the APN appliance, a time jump in the local time of the APN appliance that does not correspond to a timestamping interval between the successive statistics; and adjusting, by the first APN virtual machine and using the time jump, the timestamps of the statistics received from the APN appliance to correlate in time the statistics received from the APN appliance with statistics received from other nodes in the APN on the consistent system timeline and the time correlated received node statistics provided at a program accessible storage location. ### Claim 11 (depends on 10) The method of claim 10, wherein an aggregate bandwidth limit is specified for total statistics of request and reply messaging across the appliances in the APN and actual used bandwidth across the APN may be modified by adjusting polling parameters. ### Claim 12 (depends on 10) The method of claim 10 further comprising: sending a request for statistics to the APN appliance for one polling period and repeatedly sending the request according to a periodic polling process. ### Claim 13 (depends on 12) The method of claim 12, wherein the periodic polling process is based on a fixed prespecified period between sending requests for statistics. ### Claim 14 (depends on 10) The method of claim 10 further comprising: sending, to the APN appliance, a statistics request message indicating that statistics are to be gathered for a number of fixed prespecified periods since a last statistics request message was received. ### Claim 15 (depends on 14) The method of claim 14, wherein sending of a statistics request message to gather statistics over a number of fixed prespecified periods is a catch up mode that is entered if no response has been received for prior requests sent to the APN appliance. ### Claim 16 (depends on 10) The method of claim 10, wherein time-stamped counter values are received from the nodes in the APN and converted to the APN time maintained by the first APN virtual machine without requiring time synchronization between any nodes in the APN. ### Claim 17 (depends on 16) The method of claim 16, wherein local time changes on remote nodes in the APN are converted to the APN time maintained by the first APN virtual machine according to timing information included in statistic information received from each of the remote nodes. ### Claim 18 (depends on 16) The method of claim 16, wherein the first APN virtual machine connects to a management server that provides a user interface for presenting the time correlated received node statistics on APN maps and in APN reports. ### Claim 19 (depends on 10) The method of claim 10, wherein each node in the APN has a local clock synchronized to a master clock in a second APN virtual machine separate from the first APN virtual machine and each node's local synchronized clock is calculated separately from providing the consistent system timeline. ### Claim 20 A computer readable non-transitory medium storing a computer program which causes a computer system to perform a method to provide a consistent system timeline of node communications in an adaptive private network (APN) having a plurality of nodes, the method comprising: providing a first APN virtual machine that maintains an APN time used for forwarding packets through conduits in the APN; providing an APN appliance that forwards packets through the conduits in the APN and that maintains time local to the APN appliance; repeatedly sending statistics request messages from the first APN virtual machine to the APN appliance, wherein the first APN virtual machine comprises monitor, manager, and network statistics processing functions which are configured to provide the consistent system timeline and each of the statistics request messages contains a timestamp tn of when the message was sent in the APN time maintained by the first APN virtual machine; receiving each of the statistics request messages at the APN appliance and recording a timestamp ta in the local time of the APN appliance when each of the statistics request messages was received at the APN appliance; in response to each received statistics request message, returning requested node statistics to the first from the APN appliance to the first APN virtual machine, wherein the requested node statistics each include a timestamp recorded in the local time of the APN appliance and state information regarding the APN appliance; determining, by the first APN virtual machine and using the timestamps associated with successive statistics received from the APN appliance, a time jump in the local time of the APN appliance that does not correspond to a timestamping interval between the successive statistics; and adjusting, by the first APN virtual machine and using the time jump, the timestamps of the statistics received from the APN appliance to form adjusted node statistics which are included in the consistent system timeline of node communications in the network at the first APN virtual machine, wherein the consistent system timeline is provided for presentation through a network attached user interface. ### Claim 21 (depends on 20) The computer readable non-transitory medium method of claim 20, wherein timestamped counter values are received from the nodes in the APN and converted to the APN time maintained by the first APN virtual machine without requiring time synchronization between any nodes in the APN. ### Claim 22 (depends on 20) The computer readable non-transitory medium method of claim 20 wherein determining the time jump includes subtracting a timestamp value associated with a first statistic from a timestamp value associated with a second statistic recorded by the APN appliance after the first statistic. ### Claim 23 (depends on 20) The computer readable non-transitory medium method of claim 20 wherein adjusting the timestamps includes adjusting the timestamps to correspond to the APN time maintained by the first APN virtual machine. ### Claim 24 (depends on 20) The computer readable non-transitory medium method of claim 20 further comprising: sending a second statistics request message to the APN appliance that statistics are to be gathered for a number of fixed prespecified periods since the last request was received, wherein the sending a request to gather statistics over the number of fixed prespecified periods is a catch up mode that is entered if no response has been received for prior requests sent to the APN appliance.