# US 11,030,046 B1 · Cluster diagnostics data for distributed job execution > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,030,046 B1 - Document ID: US11030046B1 - Status: Granted - Kind: B1 - Application number: 17/161,989 - Filed: 2021-01-29 - Granted: 2021-06-08 - Earliest claimed: 2021-01-12 - Assignees: Snowflake Inc. - Applicants: Snowflake Inc. - Inventors: Bing Li; Zihan Li; Edward Ma; Mingli Rui; Srinath Shankar - Web page: https://patentgrep.com/patent/US11030046B1 ## CPC - G06F 11/1435: {using file system or storage system metadata} - G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals} - G06F 16/215: Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors - G06F 16/28: Databases characterised by their database models, e.g. relational or object models - G06F 2201/80: Database-specific techniques - G06F 2201/82: Solving problems relating to consistency - G06F 2209/505: Clust - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A shared database platform can interface with a cluster computing platform over a network through a database connector and one or more cluster connectors. The data transferred over the network can include telemetry metadata that can be distributed to execution nodes of the cluster computing platform for generation and transmission of cluster data to the shared database platform. ## Claims ### Claim 1 A method comprising: receiving, by a computing cluster, an application for processing by nodes of the computing cluster, the nodes including a driver node and a plurality of execution nodes for processing of tasks of the application; distributing, by the driver node, the tasks of the application for processing by the plurality of execution nodes; processing the tasks by the plurality of execution nodes; identifying, by the computing cluster, one or more errors in the application received by the computing cluster; in response to the one or more errors, re-processing the tasks of the application by the plurality of execution nodes with a telemetry setting active in the application, the driver node passing a log request to a log object of a wrapper to bypass a native logging service of the computing cluster in response to the telemetry setting being active, the driver node further receiving telemetry metadata for access to a telemetry network service of a distributed database that provides data to the computing cluster through a database connector, the driver node receiving the telemetry metadata through the database connector of the distributed database; distributing, by the driver node, the telemetry metadata to the plurality of execution nodes for re-processing; and transmitting, by the plurality of execution nodes, to the telemetry network service of the distributed database, log data that is generated by the plurality of execution nodes in re-processing the tasks of the application. ### Claim 2 (depends on 1) The method of claim 1, wherein the log data is transmitted to the telemetry network service by one or more database connectors integrated in one or more of the plurality of execution nodes. ### Claim 3 (depends on 1) The method of claim 1, further comprising: transmitting, by the driver node, to the telemetry network service of the distributed database, additional log data that is generated by the driver node while processing the application. ### Claim 4 (depends on 3) The method of claim 3, wherein the additional log data is transmitted to the telemetry network service by a driver database connector integrated in the driver node. ### Claim 5 (depends on 1) The method of claim 1, wherein the log object transmits the log data to the telemetry network service of the distributed database using the telemetry metadata for access to the telemetry network service. ### Claim 6 (depends on 1) The method of claim 1, wherein the telemetry setting is set by default in the application to inactive and log data is not transmitted to the telemetry network service by the computing cluster while the telemetry setting is set to inactive. ### Claim 7 (depends on 1) The method of claim 1, wherein the telemetry network service is an electronic message network service of one or more servers of the distributed database. ### Claim 8 A system comprising: one or more processors of a machine; and a memory storing instructions that, when executed by the one or more processors, cause the machine to perform operations comprising: receiving, by a computing cluster, an application for processing by nodes of the computing cluster, the nodes including a driver node and a plurality of execution nodes for processing of tasks of the application; distributing, by the driver node, the tasks of the application for processing by the plurality of execution nodes; processing the tasks by the plurality of execution nodes; identifying, by the computing cluster, one or more errors in the application received by the computing cluster; in response to the one or more errors, re-processing the tasks of the application by the plurality of execution nodes with a telemetry setting active in the application, the driver node passing a log request to a log object of a wrapper to bypass a native logging service of the computing cluster in response to the telemetry setting being active, the driver node further receiving telemetry metadata for access to a telemetry network service of a distributed database that provides data to the computing cluster through a database connector, the driver node receiving the telemetry metadata through the database connector of the distributed database; distributing, by the driver node, the telemetry metadata to the plurality of execution nodes for purposes of re-processing; and transmitting, by the plurality of execution nodes, to the telemetry network service of the distributed database, log data that is generated by the plurality of execution nodes in re-processing the tasks of the application. ### Claim 9 (depends on 8) The system of claim 8, wherein the log data is transmitted to the telemetry network service by one or more database connectors integrated in one or more of the plurality of execution nodes. ### Claim 10 (depends on 8) The system of claim 8, the operations further comprising: transmitting, by the driver node, to the telemetry network service of the distributed database, additional log data that is generated by the driver node while processing the application. ### Claim 11 (depends on 10) The system of claim 10, wherein the additional log data is transmitted to the telemetry network service by a driver database connector integrated in the driver node. ### Claim 12 A non-transitory machine storage medium embodying instructions that, when executed by a machine, cause the machine to perform operations comprising: receiving, by a computing cluster, an application for processing by nodes of the computing cluster, the nodes including a driver node and a plurality of execution nodes for processing of tasks of the application; distributing, by the driver node, the tasks of the application for processing by the plurality of execution nodes; processing the tasks by the plurality of execution nodes; identifying, by the computing cluster, one or more errors in the application received by the computing cluster; in response to the one or more errors, re-processing the tasks of the application by the plurality of execution nodes with a telemetry setting active in the application, the driver node passing a log request to a log object of a wrapper to bypass a native logging service of the computing cluster in response to the telemetry setting being active, the driver node further receiving telemetry metadata for access to a telemetry network service of a distributed database that provides data to the computing cluster through a database connector, the driver node receiving the telemetry metadata through the database connector of the distributed database; distributing, by the driver node, the telemetry metadata to the plurality of execution nodes for re-processing; and transmitting, by the plurality of execution nodes, to the telemetry network service of the distributed database, log data that is generated by the plurality of execution nodes in re-processing the tasks of the application. ### Claim 13 (depends on 8) The system of claim 8, wherein the log object transmits the log data to the telemetry network service of the distributed database using the telemetry metadata for access to the telemetry network service. ### Claim 14 (depends on 8) The system of claim 8, wherein the telemetry setting is set by default in the application to inactive and log data is not transmitted to the telemetry network service by the computing cluster while the telemetry setting is set to inactive. ### Claim 15 (depends on 8) The system of claim 8, wherein the telemetry network service is an electronic message network service of one or more servers of the distributed database. ### Claim 16 (depends on 12) The non-transitory machine storage medium of claim 12, wherein the log data is transmitted to the telemetry network service by one or more database connectors integrated in one or more of the plurality of execution nodes. ### Claim 17 (depends on 12) The non-transitory machine storage medium of claim 12, further comprising: transmitting, by the driver node, to the telemetry network service of the distributed database, additional log data that is generated by the driver node while processing the application. ### Claim 18 (depends on 17) The non-transitory machine storage medium of claim 17, wherein the additional log data is transmitted to the telemetry network service by a driver database connector integrated in the driver node. ### Claim 19 (depends on 12) The non-transitory machine storage medium of claim 12, wherein the log object transmits the log data to the telemetry network service of the distributed database using the telemetry metadata for access to the telemetry network service. ### Claim 20 (depends on 12) The non-transitory machine storage medium of claim 12, wherein the telemetry network service is an electronic message network service of one or more servers of the distributed database.