Overall system and processes for cluster file system serviceability

A system comprising serviceability components for a cluster network having a plurality of nodes, the system comprising:

• a processor and a memory, the memory containing program code which when executed by the processor, causes:
• a collector collecting system statistics, system information, and logs for each node in a cluster system during system operation to form collected data;
• a hardware-based monitor monitoring system operation to detect occurrence of an error condition;
• a logging component generating log files from the logs for each node, wherein the log files comprise core files having a uniform format;
• an interface providing the log files upon request to an auditor for analysis, and transmitting the support bundle to a vendor providing support for the cluster network;
• a support bundle component combining the collected data from the plurality of nodes into a support bundle for transmission upon detection of the error condition;
• and
• a service node providing, to the vendor, debugging tools to address a problem encountered by a node executing an application, wherein the cluster network comprises a Santorini network processing containerized data utilizing a Kubernetes-based framework, and wherein the cluster network comprises part of a Data Domain deduplication backup system performing backup and restore operations for the nodes, and further wherein the containerized applications comprise at least one of a Data Domain container running deduplication and compression processes, a cloud-native data protection manager, and a scalable object storage manager.

A system for providing serviceability for a cluster system operated by a user and having a plurality of nodes executing containerized applications, comprising:

• a processor and a memory, the memory containing program code which when executed by the processor, causes:
• a monitor monitoring system operation to detect a problem in the cluster system;
• a collector collecting logs for each node of a plurality of nodes in the cluster system, wherein the logs record transactions of the nodes during execution of the applications,
• one or more persistent data stores storing the log files outside of any application pod;
• an audit log processing function compiling the logs for audit purposes;
• a set of debugging tools to help analyze, debug, and correct the problem;
• a support bundle component to generate and compile the logs and information of the system and the problem for transfer to a vendor supporting the cluster network;
• an aggregator aggregating the logs by writing logs for critical components to dedicated persistent volumes for each respective component, writing logs for non-critical components to a central persistent volume (PV), and combining the collected logs for the critical and non-critical components into a data element for further log processing by the system, capturing a memory state of each node at a time of a problem in the system, and embodying the captured memory state as a respective core file for each node;
• and
• a collector collecting respective core files of the plurality of nodes using a PV mounter pod for transfer to a debugging process using the debugging tools, and wherein the core files are automatically generated upon a crash of a pod or node in the cluster system, or upon user command.